Giter VIP home page Giter VIP logo

yarasa's Introduction

Yarasa

Visual Alert System for Drivers with Hearing Loss

Samsung Innovation Campus: Final Project
Source Code File w/o Sound Source Localization Function

Overview

This project aims to gather and classify the traffic sounds with Raspberry Pi, and later display them visually from a mobile app to the driver with hearing loss. I hope this will be beneficial for future work for providing safe driving for everyone.

URBANSOUND8K DATASET: Link to Dataset

What's included?

Yarasa - Android.zip is to-be-created .apk file may be installed on an Android device.

Contents of Yarasa - Pi should be placed on a directory of your choice on your Raspberry Pi.

Usage

These project elements are yet to be set for an automatic connection. Following steps shall be followed for a smooth operation.

You need a Raspberry Pi 3+, a ReSpeaker 4-Mic Array for Raspberry Pi, and an Android smartphone for this system.

Firstly, your Raspberry needs to know how to operate a ReSpeaker. Simply follow the instructions on ReSpeaker Wiki.
Hint: This process might be a little challenging, but remember that instead of using "sudo ./install.sh", using the following can save your life:
sudo ./install.sh --compat-kernel
Not my favorite solution, but gets things done.

On your Raspberry Pi, you should follow the instructions given on Yurockkk's Repistory to obtain a successful Bluetooth connection between Android & Raspberry Pi. Shout-out to them for the help of their project for establishing the Bluetooth connection between these parts.

Simply run Yarasa-Pi.py on your Raspberry Pi. If this is your first time running such a program on your Pi, you might struggle with libraries for some time, thanks to the limited resources of the Rasbian environment.

The Android device that has the Yarasa - Android.rar on it should be connected to your Pi via Bluetooth.

And that should do it. This project is a very basic first step, and certainly open for improvements, especially for sound source localization. Together we can build an equally safe, easy, and enjoyable living for everyone.

Onur

Major Shout-Outs To

For this great dataset, URBANSOUND8K
Bluetooth connection, Pi side: Yurockkk's Bluetooth-RPi-Python
Bluetooth connection, Android side: Yurockkk's Bluetooth-RPi
Signal processing: Shubham Gupta's work

yarasa's People

Contributors

aonurakman avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.