Speech to Braille Translator and Sign Language Recognition System

The purpose of this project is to provide a system that will allow people with special needs to access audio-video content. This system will convert speech to Braille and detect signs in order to teach Sign Language. This could be a great asset to those who are deaf and blind, as well as to Sign Language Coaches, NGOs, and Braille Publishing Companies.

We would like to express our sincere appreciation to the SHEBUILDS Hackathon for providing us with the opportunity to work on this project. We would also like to thank our mentors and team members for their valuable guidance and support throughout the project. Finally, we would like to thank all the people who have supported and contributed to this project. Your help has been invaluable and we are truly grateful.

This system will convert spoken words or written text to Braille and print the same, making it easier for the blind to access audio-video content. The system consists of the following steps:

1. Loading Audio File
2. Audio to Text
3. Text to Braille

This system will detect signs in order to teach Sign Language. The system consists of the following steps:

1. Realtime Video Input
2. Sign Detection
3. Output Letter

This system serves an important purpose by providing an accessible way for the deaf and blind to stay up to date with the latest trends in education and politics. It also provides a two-way approach, allowing normally-abled people to learn braille script and sign language so they may be of help to the deaf and blind.

• The Speech Recognition System includes Word Sense Disambiguation, Speech Tagging, and Natural Language Processing (NLP).
• The Hand Sign Recognition System includes OpenCV, Media Pipe Holistic, and a Convolutional Neural Network (CNN) Model.

• The Audio File is first converted to text, followed by the text being converted to Braille.
• The Sign Language Detection System will output a letter corresponding to the sign shown.

This project is a great asset to those who are deaf and blind, as well as to Sign Language Coaches, NGOs, and Braille Publishing Companies. The Speech and Sign Language Recognition System will make it easier for the differently-abled to access audio-video content, thereby bridging the gap between them and modern society.