martinberlin / udpx-app Goto Github PK

In accordance with martinberlin/pixels#3 let's add in Tab ESP a new section called "Advanced output settings"

|_| Set chunk size headers (Width*Height)

Marking this checkbox it will fill up headers 2-3 with a 16 bit LSB unsigned integer representing chunk size. For our test we will use two 44x11 panels, so this two bytes will represent a 484 chunk size.

The firmware will interpret this setting and send first chunk to channel 1 (gpio 19) and the remaining to channel 2 (gpio 20) reducing the send time to the stripe and sending parallel output to two different RMT channels in ESP32

I will implement this and reorganize last branch:
https://github.com/martinberlin/udpx-app/tree/feature/11-reverse-option Referencing the commits with this issue number

Check out ESP32WiFiBLE app and also:

https://github.com/don/cordova-plugin-ble-central

In order to enable a Config tab that will scan BLE devices or alternatively use Bluetooth serial and have the following options:

1. Reset device
2. Set configuration

I want to keep it as simple as possible since maintaining both BLE and Bluetooth Serial methods is already complicated per se. So the fruit of the cake here would be to end up the set credentials process with a push over Bluetooth of a json:

    {"status":true, "msg":"Connected", "ip":"IP_ADDRESS", "port":"UDP_PORT"}

or

    {"status":false, "msg":"Did not found WiFi AP NAME_OF_AP, could not connect"}

    {"status":false, "msg":"Wrong credentials, could not connect to NAME_OF_AP"}

In the app, only if status is true, display a Dialog box:

Connected with IP: IP_ADDRESS Port: UDP_PORT
Do you want to update your Controller connection parameters?

If you select YES, then it will set that on the Controller tab, opening that Tab for you to check if it's everything like expected. Then you can press play and see if it works.

Both discarded in the First Version:

• As an alternative for security PIN, it would be possible just to have a "Lock ESP32" option. After confirming, if lock is done, the only way to update WiFi credentials will be to upload a new firmware.
• Optionally it will read configuration on startup when the ESP32 is paired (Discarded, for simplicity)
  Eventually would be nice to know just for the record, what SSID it was inside the ESP32, but no old passwords flying around Ble.

suggested: flate WASM

zlib_encode_raw(buffer)

uses eval() which is not nice, but we can live with it I hope.

FIRMWARE to test this: https://github.com/martinberlin/udpx/tree/feature/miniz

In the Android app, increasing the brightness generates a strange degrade that generates yellow in the bottom of every RMT channel. Not sure if it's the app or if I drunk one glass of white wine too much.
Interesting if you are into yellow.

Check if there is a configuration setting or a way to restart the mDns discovery if it does not discover anything for 5 seconds. At the moment is necessary to restart the udpx App which is quite bad for usability and too time consuming.

Since I started testing with bigger Matrixes, like 50*20, I realized even with compression is always on the limit and skips frames all the time.
So I would like to try to implement 565:

5 bits for Red
6 for Green
5 for Blue

Issue to support this on the Pixels library:
IoTPanic/pixels#7

As a user, I would like to have an advanced stettings option, that is collapsed by default.
If you open it, will display a more detailed control of the output, for now let's add a:

 |_| Invert direction per unit

If checked will invert the direction of the lines after the first unit. Let's imagine our unit has 11 lines:

1 --> in first unit
11--> if that checkbox is checked then
01<-- of second unit

1 --> in first unit
11--> if that checkbox is not checked then
01--> of second unit

Brightness will be not done anymore in the Android side. When converting and byte shifting to achieve 565, this makes all colors quite flat and also greenish white. But also we are doing multiplications over 1000 of RGB colors in slow javascript.

It will be send as the byte[1] via UDP and will be calculated in the Firmware side.
Firmware reference: martinberlin/udpx#17

Dropdown in the UX should be like

|___v| Byte[1] value

10% | 2
15% | 3
20% | 4
25% | 5
30% | 6
35% | 7
40% | 8
45% | 9
50% | 10
55% | 11
60% | 12
65% | 13
70% | 14
75% | 15
80% | 16
85% | 17
90% | 18
95% | 19
100% | 20

UPDATE: There has to be a round operation that flattens the image diving each byte value /2

        r = Math.round(pixels[k][0]*0.5);
        g = Math.round(pixels[k][1]*0.5);
        b = Math.round(pixels[k][2]*0.5);

This reduces a lot the compression, since it works much better when they are patterns to compress, but it won't help much in videos that have a rainbow of colors on each frame.
This will be implented on branch : feature/13-pix565
Since it's related to this new protocol.

Location: In Controller Tab, below IP / Port config

UDP text message:
_______________ SEND

Now message says:
NNN compressed bytes sent

or
NNN bytes send

Just wrap the number with:

<span color="#FF0000">NNN</span>

To give a clean indication that the ESP32 Max. transport unit is being surpassed

Only as a test since I want to make some benchmarks add a dropdown that will let the user select between:
|_| Reverse matrix pair lines in Android (checked by default)

Measure before implementing anything in the Firmware side how much we gain doing this. If the difference is insignificant for the 968 Pixels tests, then we can leave it as is.

First we will assign just ip, then we could setup a naming convention like

ESP32_MAC_PORT to explode _ and get pieces[2] to get the port number

Related to #1
The config will have two tabs: Blue config | Discovery service

The commands are going to be preceded by c

Then 0,0 will follow to identify this as "all off" in the udpx Firmware side.
This should happen if at any time the user decides to change in the Video tab any of this parameters:

Width, Height or Units

Related: Firmware udpx Issue 14

Update: There will be 2 short commands that send 3 bytes each

99,0,0   Put all stripe off
114,0,0  Reset WiFi credentials

So we can force WiFi Credentials delete in case we are on the go, to leave the strip ready to be configured elsewhere.
There is already a Reset in + Wifi tab, but is actually sending a Bluetooth message, so we can send both and display clearly the Controller name you are addressing.

@carlosfasani identified this issue, since if you decide to send less pixels on a live session, the pixels at the end will remain with last values. With this small fix, this won't happen, since on every onchange on Width, Height or Units, will send first the command and then keep on with the Video rendering.

Related:
https://github.com/wayneparrott/cordova-plugin-ezar-videooverlay

Very low prio for now. But it will be a very nice to have

Samuel @IoTPanic suggested:
I think to make it easier for people to understand, you should change the ms/Frame into a set FPS field and do the math in the app

After Play Console feedback I need to update jquery to:

https://snyk.io/test/npm/jquery/3.4.0

And in a second though, the only reason is still there is because I use the Tabs from bootstrap, but I would love to get rid of it. Anyone knows any good alternative to use Tabs without any complex Javascript that works good in mobile?

In the Android app we turn around pair lines using javascript array reverse function which according to this performance report is very slow:
https://github.com/martinberlin/udpx-app/blob/master/www/js/app.js#L598

Here there is a suggestion on how to make a function that might be faster:
https://stackoverflow.com/questions/5276953/what-is-the-most-efficient-way-to-reverse-an-array-in-javascript/9113136

As home is starting to be too crowded with too many options we are planning to add some tabbed navigation.
From top of my frontal lobe:

• Led matrix
• Controlller

Led matrix will group all related configurations such as width, height, units:

Controlller will host Espressif IP, Port and Protocol used to send the binary data.

BLE explained in #1 will be a future 3rd tab that will list, pair and set up the WiFi credentials for the controllers