Portable sign language (ASL) recognition device that utilizes real-time and efficient programming to help mute and deaf by establishing two-way communication channel with people who have never studied sign language.

License: MIT License

C++ 73.48% Makefile 24.96% Shell 0.47% CMake 1.09%

american-sign-language asl-recognizer cpp gesture-recognition hand-detection oled-display-sh1106 opencv raspberry-pi raspberry-pi-camera sign-language-recognition

realtime-sign-language-recognition's People

Contributors

Stargazers

Watchers

Forkers

abdullah-alfakhrey

realtime-sign-language-recognition's Issues

Implement Multi threading for Pi

Implement multithreading code to process I/O into separate threads to increase the program responsiveness

Create system diagram

Create project demo

Hand presence detection

Detect if a hand is insight to remove the background and start the recognition

TensorFlow building issue

Fix the TensorFlow Lite build error with Raspberry Pi

Model Tuning

Inference model need more training and bigger dataset to provide better recognition

Code optimization

Use callbacks and event-driven approach to achieve better performance

Source code documentation

Create Instructables article

Clean up the code

optimize the code for the final release

Create Github pages

Create and run Github page for kNOw SIGN

Raspberry Pi camera integration

integrate OpenCV code with Raspberry Pi camera

Social Media Post 4

Create content for weekly post
Design weekly post graphics

Create unit tests

Create unit tests for the different parts of the program and create executable for the tests

Create Sequence Diagrams for the project

Update Readme

Repo Readme need to be updated with the current progress

add openCV installation guide
add hardware configuration
add model training methodology

Background Removal Script Issue

Background removal code in kNOw SIGN-pc branch is not working. Black screen appears after running and the detection is incorrect.

Remove background for better recognition

The background need to be removed from the camera live stream in ordered to improve the accuracy.

Preparation for the first release

Create OLED display driver

Create the display driver for RPi and implement the recognition output class

raj99-code / realtime-sign-language-recognition Goto Github PK