Giter VIP home page Giter VIP logo

meet244 / sign-language-translator Goto Github PK

View Code? Open in Web Editor NEW
6.0 1.0 0.0 14.9 MB

A helpful application that uses your camera to turn sign language into written words, making communication easier for Deaf and Hard of Hearing people.

License: MIT License

Python 2.80% Jupyter Notebook 97.20%
customtkinter hackathon indian-sign-language sign-language sign-language-recognition sign-language-recognition-system sign-language-recognizer sign-language-translation sign-recognition tkinter-gui

sign-language-translator's Introduction

Sign Language Translator

Translate sign language to text with camera and python (GUI and ML) ๐Ÿ“ท๐Ÿค–๐Ÿ“

demo.mp4

Problem Statement ๐Ÿงฉ

Develop an innovative system that utilizes camera technology in web and mobile applications to translate sign language gestures into text. The primary goal is to enhance communication accessibility for the Deaf and Hard of Hearing community by providing a real-time sign language-to-text translation solution. ๐ŸŒ๐ŸคŸ๐Ÿ“ฑ

Key Features ๐Ÿš€

  1. Real-Time Gesture Recognition: Advanced algorithms for recognizing sign language gestures in real-time through the device's camera. ๐Ÿ“น๐Ÿ‘‹

  2. Text Translation: Accurate translation mechanism to convert recognized gestures into text. ๐Ÿ“๐Ÿ”„

  3. Accessible Interface: User-friendly interface for both sign language users and those who rely on the translated text. ๐Ÿ–ฅ๏ธ๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿฆณ

  4. Multiple Sign Languages: Support for a variety of sign languages to cater to a diverse user base. ๐ŸŒ๐ŸคŸ

  5. Customizable Settings: Allow users to personalize the system's settings and preferences. โš™๏ธ๐Ÿ› ๏ธ

Solution Overview ๐ŸŒŸ

We first understood how sign language functions and what the signs for India. Here's the signs we made this project for and you can try this out :

signs

We solved this problem by implementing a comprehensive system that combines customtkinter (an enhanced version of tkinter), Mediapipe for hand sign recognition, and TensorFlow for machine learning to recognize signs. Here's a more detailed breakdown of our solution:

  • Real-Time Gesture Recognition: We leveraged Mediapipe's advanced hand tracking capabilities to recognize sign language gestures in real-time through the device's camera. This allowed us to precisely track hand movements and gestures. ๐Ÿ‘๐Ÿ•

  • Text Translation: To convert recognized sign language gestures into text, we utilized TensorFlow for machine learning. Our machine learning model was trained to understand a wide range of sign language signs, ensuring high accuracy and reliability in translation. ๐Ÿค–๐Ÿ’ฌ

  • Accessible Interface: We designed a user-friendly interface using customtkinter, which offers enhanced customization and a smoother user experience. Our interface facilitates seamless communication for both sign language users and those who rely on the translated text. ๐Ÿ–ผ๏ธ๐Ÿค

Installation โš™๏ธ

# Clone the repository
git clone https://github.com/meet244/Sign-Language-Translator.git
cd Sign-Language-Translator

# Install modules
pip install -r requirements.txt

# Start the application
python app.py

Contributing ๐Ÿค

If you'd like to contribute to this project, please follow guidelines. ๐Ÿ™Œ

License ๐Ÿ“œ

This project is licensed under the MIT License. ๐Ÿ“„

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.