Giter VIP home page Giter VIP logo

esp-box's Introduction

ESPRESSIF

ESP-BOX AIoT Development Framework

GitHub

Try it with ESP Launchpad

Important Note:

Upon receiving the ESP32-S3-BOX-3, we advise updating the built-in factory firmware to ensure you have the latest bugfixes via Espressif's online firmware flashing tool ESP Launchpad. Up till now, the latest version is ESP-BOX-3_Demo_V1.2.4. To verify the software version, please go to the 'About Us' Page.

The ESP-BOX is an advanced AIoT, Edge AI, and IIoT applications development platform released by Espressif Systems. The ESP32-S3-BOX, ESP32-S3-BOX-Lite, and ESP32-S3-BOX-3 are a series of development boards designed for this platform, they are built on Espressif’s powerful ESP32-S3 Wi-Fi + Bluetooth 5 (LE) SoC and feature compact and beautiful enclosures. Leveraging the multi-functional accessories and reliable examples from the repo’s, these development boards cater to both prototyping new projects and building complex IoT systems, providing a perfect balance of form and function.

ESP-BOX provides a platform for developing applications in various domains, including Offline Voice Assistants, Online AI Chatbots (developed using OpenAI and other large language model platforms), Matter Device/Controller, Robot Controller, USB Device/Host, Wireless Sensor Application and a wide range of Human Machine Interaction (HMI) applications. Experience the possibilities—add one to your toolkit and explore the limitless potential!

Product Name Product Figure Marketing Status
ESP32-S3-BOX 1 End of Life
User Guide
ESP32-S3-BOX-Lite 1 End of Life
User Guide
ESP32-S3-BOX-3 2 Active
User Guide

Note 1: Upon receiving the ESP32-S3-BOX and ESP32-S3-BOX-Lite, we advise updating the built-in factory firmware to ensure you have the latest bug fixes. In the master branch, we will gradually offer limited support for these two development boards. For further information, kindly refer to the examples readme.

Note 2: The ESP32-S3-BOX-3 offers two different versions: ESP32-S3-BOX-3 and ESP32-S3-BOX-3B. The ESP32-S3-BOX-3 represents the standard edition with four blue accessories, the ESP32-S3-BOX-3B provides fewer accessories to meet starters who don’t need much unnecessary hardware. For more details on the distinctions, please check here.

Versions

ESP-BOX Dependent ESP-IDF Branch Note Support State
master >= release/v5.1
commit id: 22cfbf30c3
Latest developing firmware
esp-sr components version: v1.4.1
Partial support for ESP32-S3-BOX, ESP32-S3-BOX-Lite, and ESP32-S3-BOX-3
Use menuconfig to select board
Refer to the Examples README for more details.
Tag 0.5.0 release/v5.1
commit id: 22cfbf30c3
esp-sr components version: v1.3.4 Compatible with ESP32-S3-BOX and ESP32-S3-BOX-Lite
Use menuconfig to select board
Tag 0.3.0 release/v4.4
commit id: 2bdea81b2a
esp-sr version: dev/v2.0
commit id: c873a35
Compatible with ESP32-S3-BOX and ESP32-S3-BOX-Lite
Tag 0.2.1 release/v4.4 with patch esp-sr version: close v1.0
commit id: 3ce34fe
Support ESP32-S3-BOX only
Tag 0.1.1 release/v4.4 with patch esp-sr version: v0.9.6
commit id: 3ce34fe
Support ESP32-S3-BOX only

Features

  • An out-of-the-box entry-level edge AI + HMI application development board.
  • FreeRTOS-based four-in-one voice interaction panel: offline voice recognition, network communication, screen display, peripheral control.
  • Supports far-field voice interaction with 2 mics.
  • Offline voice wake-up and commands recognition with high wake-up rate.
  • Allows continuous recognition, wake-up interrupt, and over 200 customizable command words.
  • Flexible and versatile home automation solutions: Matter, Home Assistant, ESP-RainMaker
  • Visual drag-and-drop GUI development: LVGL SquareLine Studio, Embedded Wizard, etc.
  • Rich development framework: ESP-IDF, Arduino, PlatformIO, Circuit Python, and more.

Open-Source Content

Based on Apache 2.0 open source license, you can modify, develop, or distribute the contents freely.

Built-in Firmware User Guide

Developer Guide

ESP-BOX integrates ESP-IDF components commonly used in AIoT development from ESP Registry that you can leverage to build your own applications.

Quick Start

Cloud Quick Start

The ESP BOX APP is built based on the commercial mobile APP architecture, Nova Home, which provides fancy UI and better user experience but has limited openness. To gain access to it, customers are required to contact us commercially via email at [email protected]. For developer, we offer ESP RainMaker solution, which includes publicly available development document and API guide. Below is the pathway to access them:

NuttX

The ESP32-S3-BOX-3 also supports integration with NuttX, offering further flexibility and functionality. Nuttx is a real-time operating system (RTOS) known for its compact size, efficiency, and real-time performance, making it an excellent choice for embedded systems.

Great Projects from Developers

We actively collect outstanding projects based on ESP-BOX to inspire more developers to innovate. We thank the enthusiasts promoting thriving community culture and welcome more developers to contribute to the vibrant ESP32 community.

Contact Us

  • If you have any technical issues, please submit issue tickets at GitHub Issues or forum esp32.com for help.
  • If you are interested in ESP-BOX project, welcome to the ESP-BOX forum to share with us your ideas.

Contributing Examples

We welcome any open-source software or hardware contribution. If you have any examples you want to share with us, please click the Contributions Guide and commit to the Pull Requests to contribute your code.

esp-box's People

Contributors

alibukharai avatar alic-maker avatar chmorgan avatar esp-mars avatar espressif2022 avatar jerry-esp avatar jiaqi-li2021 avatar krzychb avatar leeebo avatar lhyhorion avatar liangshuzhi5193 avatar lijunru-hub avatar lindazhxy avatar lzw655 avatar mahavirj avatar real-yuzhe avatar tda-2030 avatar wangvirginia avatar wujiangang avatar zhanzhaocheng avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

esp-box's Issues

TT21100 touch driver does not support interrupt based reading

TT21100 touch driver does not support interrupt based reading.

bool tt21100_data_avaliable(void)
{
int level = gpio_get_level(GPIO_NUM_3);
if (level) {
return false;
}
return true;
}

Suggested functionality:

esp_err_t tt21100_tp_init(void)
{
...
    // Register interrupt for GPIO_NUM_3 falling edge / tt21100_touch_interrupt()
...
}

void tt21100_set_callback(void (*callback)())
{
    // Store callback function
}

void tt21100_touch_interrupt()
{
    // Call the callback function if it is set
}

我无法使用内置的JTAG调试器调试

image
报错的界面如图片所示。
launch.json如下所示,程序可以正常的下载运行。

{
  "version": "0.2.0",
  "configurations": [
    {
      "name": "ESP32-S3 DEBUG",
      "type": "cppdbg",
      "request": "launch",
      "MIMode": "gdb",
      "miDebuggerPath": "${command:espIdf.getXtensaGdb}",
      "program": "${workspaceFolder}/build/${command:espIdf.getProjectName}.elf",
      "windows": {
        "program": "${workspaceFolder}\\build\\${command:espIdf.getProjectName}.elf"
      },
      "cwd": "${workspaceFolder}",
      "environment": [{ "name": "PATH", "value": "${config:idf.customExtraPaths}" }],
      "setupCommands": [
        { "text": "target remote :3333" },
        { "text": "set remote hardware-watchpoint-limit 2"},
        { "text": "mon reset halt" },
        { "text": "thb app_main" },
        { "text": "flushregs" }
      ],
      "externalConsole": false,
      "logging": {
        "engineLogging": true
      }
    }
  ]
}

factory_demo build fail

Hi, I tried to build the factory_demo however it failss with:

/home//esp/esp-idf/components/freertos/FreeRTOS-Kernel/portable/port_common.c:134: undefined reference to `app_main'
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
ninja failed with exit code 1

In file: port_common.c, line 60 there is the definition: extern void app_main(void);
and in line 135: app_main();

I am using esp-idf version: ESP-IDF v5.0-dev-3567-ge8d172eb87-dirty.

I started the build process with: idf.py flash monitor.

Can you please advice me how to get this build working?

Quality of LCD display for the S3 Box

If I started out using one of the templates that already had display, then the quality was good (It is white and bright, fonts are readable). But if I started out from a non-display template, the LCD quality was not quite there (the display is not as bright and has a light green color, fonts are very poor).

What settings in the menuConfigure or else where that I need to check for?

[After playing well for one day ...] A device attached to the system is not functioning

Hi,
I have followed some tutorials, and do

idf.py -p COMX build flash

... things go well.
But one day later, when I open my PC again, trying to run

idf.py -p COMX monitor

I got

serial.serialutil.SerialException: Cannot configure port, something went wrong. Original message: PermissionError(13, 'A device attached to the system is not functioning.', None, 31)`

I have tried to change my COM number or uninstall&&reinstall the driver of the serial, but nothing works T.T
Any ideas? Thx.
P.S. win10 env~

Matter Example App for esp-box? (AEGHB-263)

Hi,
Would it be possible for a matter (project chip) example app to be provided? I have been successfully prototyping with the esp32 development board and matter by following this example code in the matter open sourc library:
https://github.com/project-chip/connectedhomeip/tree/master/examples/all-clusters-app/esp32

I would like to try this code on the new esp-box but I suspect it may work but would not provide the Ai voice activation and UI that Is in the "out of the box" firmware?

If there were plans to provide a matter enabled esp-box sample application I would really appreciate that as it would safe loads of time and I suspect others would be interested too.

many thanks
Oide

sd card and mp3_demo

Trying to incorporate sd card with the mp3_demo for the S3 Box. I could get the mp3_demo to play mp3 on the sd card with no problem. Except the UI elements would not show up. And vice versa if I got the UI working then the sd card will have issue.

The problem is down to these two initialization functions:
lv_port_init for LCD and spi_bus_initialize for the sd card.

Any hints what needed to be done?

Here are the errors. (Based on the sd card was initialized first)

E (880) spi_master: check_trans_valid(689): txdata transfer > host maximum
E (880) lcd_panel.io.spi: panel_io_spi_tx_color(358): spi transmit (queue) color failed
E (5890) task_wdt: Task watchdog got triggered. The following tasks did not reset the watchdog in time:
E (5890) task_wdt: - IDLE (CPU 0)
E (5890) task_wdt: Tasks currently running:
E (5890) task_wdt: CPU 0: lvgl_Task
E (5890) task_wdt: CPU 1: IDLE
E (5890) task_wdt: Print CPU 0 (current core) backtrace

Build problems Demo Software for S3-BOX in Eclipse (AEGHB-275)

Hi,

I installed from sckratch new ESPIDF and EClipse plugin for ESP32, imported projects from Examples folder on ESP32-S3-BOX GIT, but when I build whatever example I get this message during compiling:

CMake Error at D:/ESP32IDE/esp-idf-v4.4.1/tools/cmake/component.cmake:301 (message):
Include directory
'D:/ESP32PRojects/S3-BOX/esp-box-master/components/lvgl/lvgl/src' is not a
directory.
Call Stack (most recent call first):
D:/ESP32IDE/esp-idf-v4.4.1/tools/cmake/component.cmake:472 (__component_add_include_dirs)
D:/ESP32PRojects/S3-BOX/esp-box-master/components/lvgl/CMakeLists.txt:27 (idf_component_register)

-- Configuring incomplete, errors occurred!
See also "D:/ESP32PRojects/S3-BOX/esp-box-master/examples/image_display/build/CMakeFiles/CMakeOutput.log".
cmake --build . -- -v
ninja: error: loading 'build.ninja': The system cannot find the file specified.

Build complete (0 errors, 0 warnings): D:\ESP32PRojects\S3-BOX\esp-box-master\examples\image_display\build
Total time taken to build the project: 12,567 ms

Does anybody have idea what can be the reason?

Thanks,
Vojko

I2C read error is not handled correctly in TT21100 driver

I2C read error is not handled correctly as ret_val == ESP_OK and data_len > 0 is not checked here:

This will cause that tt21100_read will be called with data_len == 0

tt21100_read(data, data_len);

i2c_master_read(cmd, data, data_len, I2C_MASTER_LAST_NACK);

esp_err_t i2c_master_read(i2c_cmd_handle_t cmd_handle, uint8_t *data, size_t data_len, i2c_ack_type_t ack)
{
...
    ESP_RETURN_ON_FALSE(data_len > 0, ESP_ERR_INVALID_ARG, I2C_TAG, I2C_DATA_LEN_ERR_STR);

我应该使用哪一个bsp?

esp-s3-box分别在esp-box仓库与esp-skainet仓库各有一个bsp,区别在于esp_board_init文件,部分函数名也有细微区别,例如esp_audio_play()与bsp_audio_play(),在一个project的component中同时包含两个bsp,编译时有概率会导致函数重定义。

Running esp-box examples on a ESP32-S3-DevKitM-1

I think it should be possible to run esp-box examples on S3 dev boards. I would like to reduce the partition sizes and remove some features such as playing music files, codec staff and even the AI voice recognition.

I've tried to make these examples work on the ESP32-S3-DevKitM-1 dev board that has 8 MB SPI flash with LCD connected to GPIO but the device keeps resetting for the image_display example and shows invalid header: 0x00010001 in the terminal for the factory_demo example.

This should be possible so I can start a proper development using these examples as a starting point since the esp-box and the S3 dev boards has the same chip.

Actually all I need is a working LVGL GUI with 3 physical buttons, wifi setup and ESP BOX mobile APP integration. By the way, how can we modify the ESP BOX mobile APP?

How can this be achieved? Any help would be appreciated.

example factory_demo CMakeLists.txt line 16 refers to moved example led_strip

Just for your info:

It did not (yet) cause me a problem:

The factory_demo example adds in CMakeLists.tst, line 16 $ENV{IDF_PATH}/examples/common_components/led_strip.
In the latest version of es-idf, the common_component led_strip has been moved. It existed before in esp-idf/examples/common_components, however: in the README.md of that component was stated the warning: Please note that this component is not considered to be a part of ESP-IDF stable API. It may change and it may be removed in the future releases.

2022-06-19_18h10utc_esp_box_example_factory_demo_CMakeLists txt_not_more_existing_led_strip

In the latest version of esp-idf there I found a component led_strip in the esp-idf/examples/peripherals/rmt folder.
I suggest to you to modify line 16 to: $ENV{IDF_PATH}/examples/peripherals/rmt/led_strip.

Interest in switching to mono mp3s for reduced programming size? (AEGHB-86)

For my application I've been looking at using mono mp3s for size, and because the es8311 codec is mono output only.

Would there be interest in a PR to switch the mp3s to mono, reduce the partition size to reduce programming, and the code to properly handle the mono mp3s? This part isn't too tricky but did require some test and debug and it could help the next person.

I'd like to get the ok that the idea made sense to the maintainers here.

烧录factory_demo出错

操作系统:macOS Mojave
ESP-IDF版本:4.4
问题描述:运行idf.py -p /dev/cu.usbmodem14701 flash
已确认cu.usbmodem14701是esp-box设备。
出现如下错误,看信息是连接不上ESP_BOX:

esptool.py esp32s3 -p /dev/cu.usbmodem14701 -b 460800 --before=default_reset --after=hard_reset --no-stub write_flash --flash_mode dio --flash_freq 80m --flash_size 16MB 0x0 bootloader/bootloader.bin 0x20000 factory_demo.bin 0x8000 partition_table/partition-table.bin 0x16000 ota_data_initial.bin 0x3bd000 storage.bin 0x647000 model.bin
esptool.py v3.2-dev
Serial port /dev/cu.usbmodem14701
Connecting......................................

A fatal error occurred: Failed to connect to ESP32-S3: No serial data received.
For troubleshooting steps visit: https://github.com/espressif/esptool#troubleshooting
CMake Error at run_serial_tool.cmake:56 (message):
/Users/rainbow/.espressif/python_env/idf4.4_py3.7_env/bin/python
/Users/rainbow/WorkSpace/esp/esp-idf/components/esptool_py/esptool/esptool.py
--chip esp32s3 failed

make[3]: *** [CMakeFiles/flash] Error 1
make[2]: *** [CMakeFiles/flash.dir/all] Error 2
make[1]: *** [CMakeFiles/flash.dir/rule] Error 2
make: *** [flash] Error 2
make failed with exit code 2

Display Chinese Text

How do you display Chinese text? I flashed my box with the Chinese firmware version. The factory_demo came with the CN firmware is in Chinese. But when I modified the image_display example to display Chinese text (I just supplied the file_name with Chinese string), it just displayed all with a strange symbol. The log showed in Chinese fine. Any hints?

Compiling with Lottie Library enabled in LVGL configuration

Describe the bug

Compiling examples/rlottie fails x

To Reproduce

Compile latest LVGL on master with lottie library enabled in sdkconfig
lv_lib_rlottie added as a submodule under lvgl/lv_lib/lv_lib_rlottie

LVGL otherwise works as intended, but havent been able to get it to compile with the lottie option in the sdkconfig. Very interested in trying on the S3 specifically to see how large of a lottie animation can play on a 240x320 SPI TFT (ESP32 was not performant enough to play larger than 120x120 animations)

Expected behavior

Will not compile

rlottie_capi.h is a dependency from the full rlottie lib (also in lv_lib_rlottie)

Screenshots or video

image

Can't flash new firmware to ESP32-S3-BOX (AEGHB-273)

Hello, I just received the ESP32-S3-BOX. Following the recommendations I was hoping I could upgrade the latest firmware according to these instructions: https://github.com/espressif/esp-box/blob/master/docs/firmware_update.md Although I have used this tool successfully multiple times on various other ESP devices, it does not work here. And yes, I also tried holding the boot button etc. It initializes the upload:

AP: 7CDFA1E1C781 STA: 7CDFA1E1C780
BT: 7CDFA1E1C782 ETHERNET: 7CDFA1E1C783

... and then I always get this error:

Uploading stub...
Running stub...
Stub running...

is stub and send flash finish

Is there any other thing I could try? It's not the cable or computer as I was also able to flash other firmware onto it (Tasmota via the Tasmota Web Installer for instance).

Thank you for your help!

编译出厂工程(factory_demo)失败

系统:win10 64位 企业版

idf用的v4.4 release

已经按照README应用了补丁.编译到最后link阶段就报错了
[1466/1468] Linking CXX executable factory_demo.elf
FAILED: factory_demo.elf
FAILED

请问有解决方案吗?

esp32box 下的factory demo编译时提示错误

你好,编译example下factory demo的时候总是提示以下错误,请问如何解决
CMake Error at /home/king5/code/idfCode/esp-idf/tools/cmake/build.cmake:200 (message):
Failed to resolve component 'rmaker_common'.
Call Stack (most recent call first):
/home/king5/code/idfCode/esp-idf/tools/cmake/build.cmake:226 (__build_resolve_and_add_req)
/home/king5/code/idfCode/esp-idf/tools/cmake/build.cmake:512 (__build_expand_requirements)
/home/king5/code/idfCode/esp-idf/tools/cmake/project.cmake:378 (idf_build_process)
CMakeLists.txt:22 (project)

idf 的版本是4.4的
ESP-IDF v4.4.1-64-g4b2098bc58-dirty

esp-box收到后确定是否正常

我在淘宝乐鑫店买的ESP-BOX。收到后,我有两个问题想知道。期待您的回复
I bought the esp-box in Lexin Store on Taobao. After receiving the goods, I have two questions to know. Looking forward to your reply

  1. 我给开发板上电之后,使用”Hi 乐鑫“唤醒了开发板,屏幕也显示唤醒成功了,但是扬声器并没有回复词”好的“,这是否是正常现象,我不确定这是不是扬声器有问题
  After I give the development board power, use "Hi Loxin" wake up the development board, the screen also shows the wake up success, but the speaker did not reply to the word "good", this is a normal phenomenon, I am not sure if this is the speaker has a problem
  2.我唤醒开发板之后说一个命令词,就得再次唤醒,但是我看说明书可以体验连续语音识别,出厂固件可以连续识别吗?怎么进入连续识别?还是说是要我自己代码开发固件烧进去才能连续识别? 
  After I wake up the development board and say a command word, I have to wake up again, but I see the manual can experience continuous speech recognition, factory firmware can continuous recognition? How to enter continuous recognition? Or do I have to develop my own code to burn the firmware in order to continuously identify?

Porting from S3-Box LVGL Demo to custom board

Hi,

I have a custom LCD board with an ESP32S3 using LVGL. Previously, I had been building with an ESP32.

I was wondering what it would take to port the LVGL demos from the S3Box to this custom LCD.

The custom board uses an ST7789 display driver. Resolution is the same 320x240.

Pinout for my board is:
MOSI - 9
MISO - NC
SCLK - 19
CS - 47
DC - 16
RST - 17

I've compiled it, but cpu will not start as expected. I've also tried making the necessary changes from the original ESP32 project I've been working on, but to no avail (Boots as expected and starts on its main loop, but doesnt display to screen with the below pin changes)

I've adjusted, in the SDKCONFIG, the HMI Board Config such that:
HMI Board -> Custom HMI Board
Select LCD Interface -> LCD_INTERFACE_SPI
I2C GPIO Config (Unchanged)
SPI GPIO Config ->
SPI CS -> 47
SPI MISO -> 0 (NC?)
SPI MOSI -> 9
SPI SCLK -> 19

In esp32_s3_box.h:
#define GPIO_LCD_BL (GPIO_NUM_NC)
#define GPIO_LCD_BL_ON (1)
#define GPIO_LCD_CS (GPIO_NUM_47)
#define GPIO_LCD_RST (GPIO_NUM_17)
#define GPIO_LCD_DC (GPIO_NUM_16)
#define GPIO_LCD_CLK (GPIO_NUM_19)
#define GPIO_LCD_DIN (GPIO_NUM_9)
#define GPIO_LCD_DOUT (GPIO_NUM_NC)

Notably, when running the esp-box demo, I do not see the statement below printed.
(In doc)
image
(idf.py monitor)
image

When running the ESP32S3 on the previous repo I was using for esp32, I am able to pass this point without issue

Any suggestions would be much appreciated!

SD card with S3 Box

Can one use SD card with the S3 Box? Since the Box does not have a SD card slot, but it does have the USB-C. Or any other way?

rebooting problem

Quantized8 Multinet5: MN5Q8_v2_english_8_0.9_0.90, (Feb 17 2022 11:49:42)
I (13514) app_sr: cmd_number=15
I (13514) app_sr: New 15 command set to :[TkN nN jc LiT;SWgp nN jc LiT;SWgp eF jc LiT;TkN eF jc LiT;TkN RfD;TkN GRmN;TkN BLo;KcSTcMiZ KcLk;Sgl c Sel;PLd MYoZgK;NfKST Sel;PeZ PLdgl;RmqgST YkSfLF;RmMoV YkSfLF;KeL FeR hfLP;;]
I (13515) MN: ---------------------SPEECH COMMANDS---------------------
I (13516) MN: Command ID0, phrase ID0: TkN nN jc LiT
I (13516) MN: Command ID1, phrase ID1: SWgp nN jc LiT
I (13516) MN: Command ID2, phrase ID2: SWgp eF jc LiT
I (13517) MN: Command ID3, phrase ID3: TkN eF jc LiT
I (13517) MN: Command ID4, phrase ID4: TkN RfD
I (13517) MN: Command ID5, phrase ID5: TkN GRmN
I (13517) MN: Command ID6, phrase ID6: TkN BLo
I (13518) MN: Command ID7, phrase ID7: KcSTcMiZ KcLk
I (13518) MN: Command ID8, phrase ID8: Sgl c Sel
I (13518) MN: Command ID9, phrase ID9: PLd MYoZgK
I (13519) MN: Command ID10, phrase ID10: NfKST Sel
I (13519) MN: Command ID11, phrase ID11: PeZ PLdgl
I (13519) MN: Command ID12, phrase ID12: RmqgST YkSfLF
I (13520) MN: Command ID13, phrase ID13: RmMoV YkSfLF
I (13520) MN: Command ID14, phrase ID14: KeL FeR hfLP
I (13520) MN: ---------------------------------------------------------

I (13522) app_sr: audio_chunksize=1024, feed_channel=3

assert failed: tcpip_send_msg_wait_sem IDF/components/lwip/lwip/src/api/tcpip.c:455 (Invalid mbox)

Backtrace:0x40379e36:0x3fcc5e600x4038d1b5:0x3fcc5e80 0x403932dd:0x3fcc5ea0 0x420b1b43:0x3fcc5fc0 0x420bc995:0x3fcc5ff0 0x420bca1e:0x3fcc6010 0x420b11a4:0x3fcc6060 0x42008101:0x3fcc6080 0x420027d8:0x3fcc60d0 0x4038d671:0x3fcc60f0

I have an esp-box,I use the chip for dual-threaded work, but the chip keeps rebooting after programming.
And the error is shown above.
How can I solve this problem?

Running Detect and Feed Task on the same core

Can you set these two tasks to run on the same core? I have tried either both are on core 0 or core 1, but to no avail.

xTaskCreatePinnedToCore(&feed_Task, "feed", 8 * 1024, (void*)afe_data, 5, NULL, 0);
xTaskCreatePinnedToCore(&detect_Task, "detect", 8 * 1024, (void*)afe_data, 5, NULL, 1);

Ransomware contained in flash_download_tool_3.9.2.exe

The mentioned Flash downloader might contain ransomware that tries to encrypt your hard drive. I am not 100% sure, but since this was the last executable that was installed on my PC, the probability is very high. The encryption starts from svchost.exe as soon as the system is idle for 15-30 minutes. The mentioned file does not need to be started, the installation process seems to be enough.

请问下esp-box的界面是用的哪个设计器?

是用的官方的EdgeLine吗?

另外问下font_cmd_cn_36.c里的字体也是设计器生成的吗?能提供下字体名吗?

我这边同时购买了s3-box跟se-box-lite裸板,看了电路原理图跟s3-box对比应该是一样的屏幕接口,区别只是是否支持触屏.我把s3-box的屏幕的排线插到了Lite裸板上,为啥点亮不了屏幕呢?代码里我注释了触控驱动初始化(bsp_tp_init)

lite出厂例程有吗?生成的固件也行阿..

谢谢

Chinese_tts demo with MP3_demo.

I have been trying to get the audio player from the MP3_DEMO (esp-box example) to work with the tts from the CHINESE_TTS (esp-skainet) demo without much success.

Can it be done? Has anyone done it already? Any pointers?

ESP_BOX APP会开源吗?

我注意到,ESP_BOX设备端需要和ESP_BOX APP来配套使用,设备厂家可能使用ESP_BOX进行Claim;终端用户需要使用ESP_BOX来进行配网和user Mapping。或者是其他的使用方式,那么,ESP_BOX APP会开源吗?

EN Extremely bad wake word recognition

Hi downloaded https://github.com/espressif/esp-box/releases/download/v0.2.1/ESP-Box_Demo_EN_V0.2.1.bin and flashed.

I have spent over ten minutes several reboots to get only 3 recognitions with worry that my neighbours may be thinking I have gone mad.

If you do manage the wake word then the command turn on/off light works great.
Actually getting the wake word to activate is another matter in a silent room.

I have a feeling it could be your dataset and now it actually has a english male voice it doesn't fit well or this firmware / model is not good.
I have no problems recording some samples if you tell me format and sampling rate...
Maybe community members could contribute if its merely a esp32-s3-box dataset accent problem.

Actually with more playing seems you need to be 2-3 meters away (further the better) for it to work relatively well if you pull the unit out on place close on your desk it doesn't work well maybe AGC?
Maybe its as simple as the MAP of mic spacing is 50mm whilst the box is 34mm, dunno but currently does not seem to be well.

The hardware design and software of the esp-box is brilliant and is really polished but the results currently of ESP_SR wow I really don't want to comment and due to the module being a .a with no source code there is little I can do, but wait fingers crossed.
ESP_DL lacks LSTM/GRU support which for audio is likely to be restrictive but always struggle what the xtensa hifi / esp32-s3 are capable of.
Maybe TFLite-Micro might come to the esp32-s3's rescue with vector optimisation as what is available and that its closed source is a huge stumbling block for anyone wanting to do ML on the S3

esp-box iot_button button_adc.c function name spelled wrong

When searching for something else I came across this:

in file: esp-box/components/iot_button/button_adc.c
lines: 169 - 181

static uint32_t get_adc_volatge(adc1_channel_t channel)
{
    uint32_t adc_reading = 0;
    //Multisampling
    for (int i = 0; i < NO_OF_SAMPLES; i++) {
        adc_reading += adc1_get_raw(channel);
    }
    adc_reading /= NO_OF_SAMPLES;
    //Convert adc_reading to voltage in mV
    uint32_t voltage = adc_reading; //esp_adc_cal_raw_to_voltage(adc_reading, &g_button.adc_chars);
    ESP_LOGV(TAG, "Raw: %d\tVoltage: %dmV", adc_reading, voltage);
    return voltage;
}

I guess the name of the function should be: get_adc_voltage() like the word voltage is used four times inside the function.
However, maybe the function is never used. I don't see it defined inside the file: button_adc.h.

Moving audio file management out of audio.c and into the ui for better reuse of audio logic?

I find myself editing the esp-box mp3 example pretty heavily in order to support a new ui that wants to play a single file based on a user input.

If audio.c/.h would have an api like:

  • play, pause, play_file

It would let me modify the ui to call play_file() based on button events, for example, and I think it could make the code a bit more reusable.

Other changes that would be made would be:

  • event type for playback completion (so the caller can play the next song and maintain the functionality web ave today)
  • move of file scanning and file list maintenance into the ui

I know it sounds like a bit of change, I'm having to make almost all of it here though, so if it was something of interest I could make it in the esp-box mp3 demo project and submit a PR.

Thoughts?

SPI bus master in the Box

For the Box, since the SPI LCD display is internally wired as a bus master with GPIO 7 and 6, can any other SPI peripherals be able to connect to the Box at all if the internal LCD is active?

Speech Recognition went haywire when MP3 player plays file from SD card

In your factory_demo, under the play_present function of the ui_player.c file:

`static void play_present()
{
ESP_LOGE(TAG, "play_present");
char filename[] = "/sdcard/song1.mp3"; // a mp3 song from SD card
start_sdcard_my(); //initialzing and mounting SD card.
// char filename[128];
// file_iterator_get_full_path_from_index(file_iterator, file_iterator_get_index(file_iterator), filename, sizeof(filename));
FILE* fp = fopen(filename, "rb");
if(!fp) {
ESP_LOGE(TAG, "unable to open '%s'", filename);
return;
}

audio_player_play(fp);

}`

It will play music fine. But the SR went haywire and no longer recognized ww or commands. Other functions seemed to be ok. Any suggestions?

E (19017) SR_AFE: ERROR! aec init false, rb_out slow!!!
E (19081) SR_AFE: ERROR! aec init false, rb_out slow!!!
E (19111) SR_AFE: ERROR! aec init false, rb_out slow!!!

Algorithm example (AEC)

Hi,
I am using a esp-box device to test live microphone feedback rejection. I have changed the original code of the algorithm example to output the audio processed through AEC directly to the speaker. But I am getting choppy/scratchy output. Is live AEC not supported by this board? Or am I doing something wrong?
Thanks

mp3 player problem

Hi!
I have an esp-box, I used two thread on this chip.
And I copied the function play_mp3() in my second thread.Then I used a flag to trigger it.
However, every time I trigger it,it would stuck like this:

I (39665) main: start to decode /spiffs/mp3/warning.mp3
I (39679) main: audio info: sr=48000, bit=16, ch=1

I think the problem might be this line: "i2s_channel_t channel = (nChans == 1) ? I2S_CHANNEL_MONO : I2S_CHANNEL_STEREO;"
How can I solve this question?Thanks!

Demo V0.3.0 FW showing Beijing time instead of Lisbon time (utc+1)

After flashing the latest demo firmware (V0.3.0), ESP-IDF Ver: v4.4-264-g2bdea81b2A, SR LANG: English, Board: S3_BOX,
after installing the APP in an iPhone8Plus, after Pairing BlueTooth, the S3_BOX is showing Beijing time instead of Lisbon (Portugal) time (= utc +1).

IMG_5468

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.