Hi ,
I would like to use the AVS demo with the audio output directly from the Matrix voice device 3.5,, jack instead of that from Raspberry pi. Additionally I would like to access the same audio output buffer to use it as reference signal for echo cancellation algorithm inside . Could you please give me some directions in this area?

Has anyone else run into issues with the mic_demo_direct demo? I've encountered segmentation faults when modifying the demo (such as adding variables, etc.) that I haven't been able to explain.

So I enabled debug builds in cmake (setting CMAKE_BUILD_TYPE to Debug) for mic_demo_direct and the matrix_creator_hal library, and then I ran gdb to see where the segmentation fault was occurring. It took me to line 40 of demos/mic_demo_direct.cpp. Stepping through, the MicrophoneArray is initialized with enable_beamforming = true and proceeds on to the MicrophoneArray::CalculateDelays() method.

In CalculateDelays() (cpp/driver/microphone_array.cpp), it goes to line 122. The segfault happens here, where the bus_ pointer (cpp/driver/matrix_driver.h:32) references an invalid address. If I run gdb with the unmodified demo it will continue to run, but with bus_ referencing an uninitialized MatrixIOBus.

Basically, it seems the root of the issue is that if the MicrophoneArray constructor is run with beamforming enabled then MicrophoneArray ends up trying to call MatrixIOBus::MatrixLeds() using an unset bus pointer. This happens before the bus can be initialized with MicrophoneArray::Setup().

The Sensor seems to be unable to go above or below the following integers.

humidity = 29.043 %
temperature (from humidity sensor) = 33.263 °C

Output is from HAL's sensor_demo

Hi,

Thanks for your efforts in maintaining and organizing this repo.
I would like to ask about the direction of arrival demo. I tried it and monitor the leds colors and the printed angles. It gave me wrong directions and it is not stable at all. The values keep changing while having the same voice in the room.
How can I get accurate and stable results?

Thanks in Advance!

hello, i have a matrix-io.

i want to use that "Direction of Arrival Algorithm" but this page DoA is actually calculate the DOA in a very weird way.

could you check it plz?

Hi Andrés and Kevin.

Could you normalize the scale of the LEDs somehow? This will make the everloop driver more useful.

Hello everyone!!
[ 45%] Building CXX object demos/driver/CMakeFiles/matrix_creator_hal.dir/uart_control.cpp.o
Linking CXX static library libmatrix_creator_hal.a
Error running link command: No such file or directory
demos/driver/CMakeFiles/matrix_creator_hal.dir/build.make:410: recipe for target 'demos/driver/libmatrix_creator_hal.a' failed
make[2]: *** [demos/driver/libmatrix_creator_hal.a] Error 2
CMakeFiles/Makefile2:719: recipe for target 'demos/driver/CMakeFiles/matrix_creator_hal.dir/all' failed
make[1]: *** [demos/driver/CMakeFiles/matrix_creator_hal.dir/all] Error 2
Makefile:117: recipe for target 'all' failed
make: *** [all] Error 2

I am using a Raspberry Pi 3 with a Matrix Creator board and resin.io. Resin uses dockerfiles to push deployments to multiple connected devices, and using the Matrix documentation in the matrix-creator-hal readme I installed the necessary dependencies for the board through the dockerfile and tried to run the “mic_energy_direct” demo.

However, I get the following output when running any of the matrix examples that involve the microphones:

“can’t send spi message”

This does not occur with any LED or sensor examples, just ones involving the microphone array. I have no problem running the examples in a regular (non-Resin) installation.

Resin enables spi by default, but I also used modprobe spi-bcm2835 in the RUN command to no avail.

Has anyone had success using Matrix+Resin.io? Any help would be greatly appreciated.

Here is my dockerfile, for reference:

FROM resin/%%RESIN_MACHINE_NAME%%-python

RUN curl https://apt.matrix.one/doc/apt-key.gpg | apt-key add - &&
echo "" >/boot/cmdline.txt &&
apt-get update && apt-get upgrade &&
apt-get install --no-install-recommends apt-utils && \
apt-get -y install python3-pip python-pip &&
apt-get install lsb-release apt-transport-https &&
echo "deb https://apt.matrix.one/raspbian $(lsb_release -sc) main" | tee /etc/apt/sources.list.d/matrixlabs.list &&
apt-get update && apt-get upgrade

RUN curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py &&
python3 get-pip.py --force-reinstall

RUN apt-get install cmake g++ git libfftw3-dev wiringpi matrixio-creator-init matrixio-malos libgflags-dev &&
apt-get install sox alsa-utils &&
apt-get install python-cryptography &&
apt-get install python3-dev &&
apt install libmatrixio-creator-hal libmatrixio-creator-hal-dev libsdl1.2-dev &&
apt-get clean && rm -rf /var/lib/apt/lists/*

WORKDIR /usr/src/app

COPY ./requirements.txt /requirements.txt

RUN pip3 install -r /requirements.txt

COPY . ./

ENV INITSYSTEM on

CMD python3 src/loop.py

In microphone_array.cpp there is a function GetSamplingRate and SetSamplingRate

Set uses MIC_sampling_frequencies[i][1]; to write a value but Get uses MIC_sampling_frequencies[i][0]; to match back on.

Shouldn't these be the same?

Hi,
I'm confused about the algorithm.
in matrix-creator-hal/demos/mic_demo.cpp
at line 60 and line 61, the code is

   float x = filter_bank_hp[c].Filter(mics.At(s, c));
   magnitude[c] += filter_bank_lp[c].Filter(x * x);

this piece of code seems like first pass the value into high-pass filter with corresponding high-pass coefficient, and then pass the result into low-pass filter with power of 2.

Is there anyone can tell me what is the purpose of x * x? And why not directly pass the signal into a band-pass filter?

Hi,
Do we have a schematic available for the hardware components, and how they are wired to one another? Is that something that will be made available as open source?

Hi,

Excuse me, I would like to ask about the sampling rate which is used in the "micarray_recorder" Demo?
I reduced the time to 5 seconds and build so
uint16_t seconds_to_record = 5;
And I am getting 160000 samples for every channel, which means that the sampling rate is
160000/5 = 32000
Am I missing some thing?

I notice this definition in this file
const uint32_t kSamplingRate = 16000;

What is wrong? Could you please clarify ?

curl https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add -
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (60) SSL certificate problem: certificate has expired
More details here: https://curl.haxx.se/docs/sslcerts.html

curl failed to verify the legitimacy of the server and therefore could not
establish a secure connection to it. To learn more about this situation and
how to fix it, please visit the web page mentioned above.
gpg: no valid OpenPGP data found.

CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
FFTW_LIBRARIES
linked by target "direction_of_arrival_demo" in directory /home/pi/matrix-creator-hal/demos
linked by target "matrix_creator_hal" in directory /home/pi/matrix-creator-hal/cpp/driver

-- Configuring incomplete, errors occurred!
See also "/home/pi/matrix-creator-hal/build/CMakeFiles/CMakeOutput.log".
See also "/home/pi/matrix-creator-hal/build/CMakeFiles/CMakeError.log".

Hello,

(I apologize if I'm writing this in wrong project)

I have a Matrix Voice (connected to Raspberry Pi 3). I setup device and run micarray_recorder_direct.
I got recording so I can confirm that I have connection

Question: as a result I got 8 files, I'm guessing that eight file is result of 7 mic inputs?

This is my arecord -l

**** List of CAPTURE Hardware Devices ****
card 1: Dummy [Dummy], device 0: Dummy PCM [Dummy PCM]
  Subdevices: 8/8
  Subdevice #0: subdevice #0
  Subdevice #1: subdevice #1
  Subdevice #2: subdevice #2
  Subdevice #3: subdevice #3
  Subdevice #4: subdevice #4
  Subdevice #5: subdevice #5
  Subdevice #6: subdevice #6
  Subdevice #7: subdevice #7
card 2: Device [USB PnP Sound Device], device 0: USB Audio [USB Audio]
  Subdevices: 1/1
  Subdevice #0: subdevice #0

As you can see I have Matrix and USB microphone.

I installed Snowboy and run nodejs script which listens to default capture device and if I use my USB microphone it works. cat ~/.asoundrc

pcm.!default {
  type asym
   playback.pcm {
     type plug
     slave.pcm "hw:0,0"
   }
   capture.pcm {
     type plug
     slave.pcm "hw:2,0"
   }
}

Questions: How do I setup ~/.asoundrc to set Matrix Voice as my default capture?

Thank you so much for your uploading. This package is very helpful for me!
I wanna use the microphone array to do multi-channel recording. Everything is working well except the noise in the recorded audio.

For test, I recorded one speech using micarray_record. I still can understand the speech from the output, however, there are a lot of noise sounds like gaps or clippings.

Can you help me with this?

Best Regards,
Yiya Hao

I cannot install from sources because an SSL certificate has expired.

 curl https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add -
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (60) SSL certificate problem: certificate has expired
More details here: https://curl.haxx.se/docs/sslcerts.html

curl failed to verify the legitimacy of the server and therefore could not
establish a secure connection to it. To learn more about this situation and
how to fix it, please visit the web page mentioned above.
gpg: no valid OpenPGP data found.

Please advise.

Hi all,
when I run the file "mic_demo" under matrix-creator-hal/build/demo, the output shown in terminal is always zero.

Thanks,
Arlene

The Demo only pipes the Crestor mics an not from Matrix Voice

Hi,
Please help me with the below issue,
I am using Matrix Creator along with Raspi3 [Jessie Pixel]

When i was trying to run the Microphone test recorder , i was getting 8 Audio streams as RAW and after converting them to WAC when i tried to play the Channel 0 Audio track using aplay it was total Silent.

All the other wav tracks were having noises like "GRRR" . Am i missing something here ?

Is there any steps i need to do with ALSA Mixer ?
Should i need to replace any file configurations in Raspbian to map the Microphones..
I really think that the Documentation can be little improved and i will also be happy to contribute on the Documentation if i was able to success fully run this sample.

Kindly help me, since i am gonna procure more devices based upon this experiment, thanks

Regards
JK

I tried getting humidity and temperature values thus:

hal::WishboneBus* bus = new hal::WishboneBus();
bus->SpiInit();
hal::HumiditySensor humidity_sensor;
humidity_sensor.Setup(bus);

hal::HumidityData humidity_data;
humidity_sensor.Read(&humidity_data);

std::cout << "humidity = " << humidity_data.humidity << "\t";
std::cout << "temperature = " << humidity_data.temperature << std::endl;

both humidity and temperature are always 0.

What happens if led_image_size() is bigger than the number of leds?

for (const LedValue& led : led_image->leds) {
    ..
}

curl https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add -
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 252 100 252 0 0 2739 0 --:--:-- --:--:-- --:--:-- 2739
gpg: no valid OpenPGP data found.

When looking into using the Matric voice microphone locations I re-cloned your repo to see what's changed.
When I opened the file on disk I saw the familiar Matrix Creator locations so I had a look at the version history in qgit.
The most recent version of microphone_array_location.h has changes in it to detect what device your code is running on to pick the correct mic locations at runtime, something I want.

I checked this twice!

git clone https://github.com/matrix-io/matrix-creator-hal.git
cd matrix-creator-hal
qgit

If I press 'T' to get the directory tree view and double-click microphone_array_location.h it shows the most recent version to be from origin/bes/miclocation 2018-07-18 15:44.

Going through the rev list the file wasn't modified since then, but somehow it is!
Also, when launched from the command line, I see the following:

ASSERT getFileAnnotation: no revision 82ed19f
ASSERT in doAnnotate: annotation for 82ed19f not valid
ASSERT in lookupAnnotation: no annotation for cpp/driver/microphone_array_location.h

I am trying to customize my own version of MicrophoneArray::Read(), but cannot get the linker to recognize the new method.

Steps:

1. Forked matrix-creator-hal to my own repository.
2. Created a new method: MicrophoneArray::Read2(). The code in the method is not relevant at this point. microphone_array.h and .cpp files changed correctly.
3. Pushed changes to my forked copy of the repository.
4. Pulled changes down to RasPi.
5. (Re)installed Matrix HAL from sources, as noted at this link: https://matrix-io.github.io/matrix-documentation/matrix-hal/getting-started/installation-source/. Except, of course, I am using my altered forked copy of the repository.
6. When my own code calls Read2(), I get the following error.

/tmp/ccWgMLxt.o: In function `SLS_record<short, (unsigned short)8, (unsigned short)512, (unsigned short)2000>::start()': /home/pi/Projects/Matrix-HAL-demos/SLS_record.hpp:129: undefined reference to `matrix_hal::MicrophoneArray::Read2()' collect2: error: ld returned 1 exit status

undefined reference looks like a linker error to me. If I substitute the standard Read() call, everything builds correctly (but I don't have the new functionality I need).
7. I confirmed the altered version of microphone_array.h is installed in /usr/local/include/matrix_hal.
8. I have tried manually removing the headers and the lib matrix_creator_hal.so files to be sure old version were not updated.
9. My compiler command is very simple:
g++ -std=c++11 -g test_api.cpp -o test_api -lmatrix_creator_hal
10. I can correctly build the Matrix Voice sample programs with the altered library with the above compiler command.

Any help appreciated.

I'm trying to test using PWM on gpio pins 0-9, using the gpio_demo as my starting part, but am having trouble reading the output (4-bit hex value). Can you give me some insight into what this demo is outputting?

This is the error i get when using make:

[ 35%] Linking CXX executable servo_demo
/usr/local/lib/libwiringPi.so: undefined reference to `shm_open'
collect2: error: ld returned 1 exit status
demos/CMakeFiles/servo_demo.dir/build.make:99: recipe for target 'demos/servo_demo' failed
make[2]: *** [demos/servo_demo] Error 1
CMakeFiles/Makefile2:123: recipe for target 'demos/CMakeFiles/servo_demo.dir/all' failed
make[1]: *** [demos/CMakeFiles/servo_demo.dir/all] Error 2
Makefile:127: recipe for target 'all' failed
make: *** [all] Error 2

I'm using matrix creator with raspberry pi. Can someone help?
Thanks in advance

Hello:

I'm interested in getting the db level of the sound recorded by each microphone, accompanied by the timestamp at which this was recorded.

The goal of this is to use all the data, to uncover when the microphone recorded an audio sample, and use this to calculate an angle believed to be closest to the audio source.

What needs to be updated in order to attain this information?

The reason I need this data is so that I can build out this logic from scratch for our use case.

"./micarray_recorder_direct" returns "can't open any device"

How can I solve this?

Here is what I get when I run the mic_demo_direct program in HAL. Anyone know what is wrong?

INFO: [/dev/spidev0.0] was opened
Audio Configuration:
Sampling Frequency: 16000
Gain : 4
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0

I did the record sound using the microphone array. The first thing I tried was running the micarray_recorder demo. i just worked with creator hal and i didn't use the MALOS .
When i was trying to run the Microphone test recorder , i was getting 8 Audio streams as RAW and after converting them to "AWAVE Audio" when i tried to play the Channels Audio track , the output is very noisy.
I listened to all 8 audio channels and they all have the noise
Are there any steps i need to do ??
Kindly help me
https://drive.google.com/drive/folders/1AG_LQUPSndJmT4eh0OO512g1CEYENvmf?usp=sharing

Hello everyone!!

-- * * * A D M O B I L I Z E * * *
-- Admobilize: Please treat warnings as errors. Use: -DADM_FATAL_WARNINGS=ON
-- * * * * * * * * * * * * * * * *
-- * * * A D M O B I L I Z E * * *
-- Admobilize: Please treat warnings as errors. Use: -DADM_FATAL_WARNINGS=ON
-- * * * * * * * * * * * * * * * *
-- gflags found =>GFLAGS_LIB-NOTFOUND
-- * * * A D M O B I L I Z E * * *
-- Admobilize: Please treat warnings as errors. Use: -DADM_FATAL_WARNINGS=ON
-- * * * * * * * * * * * * * * * *
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
GFLAGS_LIB
linked by target "micarray_recorder" in directory /home/pi/matrix-creator-hal/demos

-- Configuring incomplete, errors occurred!
See also "/home/pi/matrix-creator-hal/build/CMakeFiles/CMakeOutput.log".
See also "/home/pi/matrix-creator-hal/build/CMakeFiles/CMakeError.log".

Any sugestion of this issue?

it shows positive gyroscope values
///////////////////////
[ IMU Sensor Output ]
[ Acceleration In X : -0.06 ] [ Acceleration In Y : 0.126 ] [ Acceleration In Z : 0.965 ]
[ Gyroscope In X : 5.981 ] [ Gyroscope In Y : 5.981 ] [ Gyroscope In Z : 0.897 ]
[ Yaw : 88.903 ] [ Pitch : 3.52798 ] [ Roll : 7.43902 ]
[ Magnetometer in X : -0.009 ] [ Magnetometer in Y : 0.47 ] [ Magnetometer in Z : -0.33 ]

even though it is static

i build matrix-creator-hal in raspberry pi, and run direction_of_arrival_demo_direct with different direction, the output

std::cout << "azimutal angle = " << azimutal_angle
              << ", polar angle = " << polar_angle << ", mic = " << mic
              << std::endl;

the mic seems not correct, even I speak in direction of mic4 , the output is still mic2

I started with a fresh raspberry pi and a fresh matrix creator. I installed and built matrix-creator-hal and its prerequisites. The demos all work. However some of the sensors are giving low quality results. Specifically the micarray_record demo produces audible recordings but with a fixed tone around 6800 Hz on all channels. Also, the resulting 16 bit data is not centered at 0, but rather several hundred away, at some other number that varies by time and channel.

Have gotten this with two fresh pis and two fresh matrix creators.

Any tips on how to fix appreciated, or just to know that it's a known issue. Would also be happy to review my build/setup procedure to see if I did everything right.

The values ive been getting from the temperature sensor have been in a range of about 3-6

Got following error while trying to compile with
any advise? @kdpatino @hpsaturn

mkdir build && cd build && cmake .. && make
.......................
Linking CXX executable pocketsphinx_demo
/usr/bin/ld: cannot find -lasound
collect2: error: ld returned 1 exit status
demos/CMakeFiles/pocketsphinx_demo.dir/build.make:86: recipe for target 'demos/pocketsphinx_demo' failed
make[2]: *** [demos/pocketsphinx_demo] Error 1
CMakeFiles/Makefile2:490: recipe for target 'demos/CMakeFiles/pocketsphinx_demo.dir/all' failed
make[1]: *** [demos/CMakeFiles/pocketsphinx_demo.dir/all] Error 2
Makefile:117: recipe for target 'all' failed
make: *** [all] Error 2

MatrixIOBus::Init() instantiates local heap-allocated versions of both BusDirect and BusKernel.

However, only one or zero of these is ever assigned to an external variable that is managed and later deleted. In the case of an initialization error, both will leak, but even on success, one always leaks.

Hi,
hen i run the mic demos after installing the latest matrix creator hal software, i can see that it throws floating point exception, Could you let me know if there is a solution ?

Hello,

Humidity value stays around the same value always, even if warm, humid air is directed at the sensor. Temperature from humidity sensor also seems incorrect.

Ran HAL sensor_demo on two just-booted creators and received similar results from both.

I'm trying to install the HAL on a new Raspbian image - but it appears there are no release files for Bullseye. Is there a workaround to this - or should I try to install on Buster ?

I tried fetching the keys using curl -L https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add - however it showed me Error: gpg: no valid OpenPGP data found.
I looked up https://apt.matrix.one on browser, the domain has expired on 28/10/2023, request to please renew the domain