patrickfrueh / sensor_fusion-mediapipe-depth_camera Goto Github PK

• Description
• Requirements
• Installation
• License
• Contact

Hand detection using Google MediaPipe and multiple depth (stereovision) cameras. Alignment of point clouds; fusion of multiple landmarks using Unscented Kalman Filter.

• pip

After cloning the repo, installing the requirements should suffice.

• git clone [email protected]:PatrickFrueh/sensor_fusion-mediapipe-depth_camera.git
• pip install -r requirements.txt
  Depending on your OS pyrealsense2 might need a different approach for the installing process.

• Under src/calibration the different methods for stereo camera calibration are displayed. It is suggested to use the 3d/point_clouds approaches, as these have repeatedly shown the best results. The resulting homogenous transformation matrix is used in the following steps.
• Under src/unscented-kf-fusion an adjusted cvzone_fork.py is used for the hand detection. It is used for the final fusion in fusion.py and fusion-visualization.py.

Stanard MIT license