Giter VIP home page Giter VIP logo

hand-gesture-recognition's Introduction

Hand-Gesture-Recognition

Used Google's Mediapipe library to detect human hands and generate landmarks on them, used the OpenCV library from Python to mark those landmarks and use them suitably.

Working

Basically it works like this: We fetch all the hand landmark values (indexes) and its current coordinates in our video frame and from there we apply conditions on those coordinate values to detect different hand gestures

For example when we show the "call me hand gesture" our thumb tip index is at the top followed by the index, middle, ring (all three folded) and the little finger at the bottommost, so we can get those x and y coordinate values to check whether the fingers are in that position or not using their index values.

Then based on each hand gesture detected we can call a function which resembles the gesture, like we can define and call a function to voice call someone when the "call me" gesture is shown by the user

HandLandmarks

image X and Y coordinate values of every landmark indexes in each frame

image In the above image as you can see my index and little finger are up so its 1 and the middle and ring are folded so its 0.

image

Called a specific function to a specific gesture

Future Applications

  1. We can also use the face landmarks or the full body landmarks from the library itself to add different functionalities to our codebase.
  2. It can be used in various devices like smartphones to elevate hands free use or for the needs of physically challenged users.
  3. It can also be used in camera drones to recognize different hand gestures to perform multiple autonomous tasks, like when we show a thumbs up, it can take a photo of us during its flight, also it will keep tracking us based on our full body movements.

Human-Action-Recognition

Overview

Human-Action-Recognition is a project designed to detect and recognize various human actions or activities from video footage. By using Google's Mediapipe library for human figure detection and an LSTM (Long Short-Term Memory) model for classification, this project can identify actions such as walking, running, jumping, fighting, clapping, and more.

Working

Human Figure Detection: The project leverages Google's Mediapipe library to detect human figures in video frames. Body Landmark Extraction: It captures body landmark coordinates from each consecutive frame of the video. Action Classification: The extracted coordinates are then fed into an LSTM model to classify the actions into predefined categories. The model was initially trained on three basic hand movements to fine-tune the action recognition capability. Human-Body-Landmarks

Applications

The potential applications of this project include:

  1. Criminal or Illegal Activity Detection: Analyzing live CCTV footage to detect suspicious or unlawful activities.
  2. Patient Activity Monitoring: Monitoring patients to prevent accidents such as falling from bed or slipping.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.