Giter VIP home page Giter VIP logo

emojoy's Introduction

Gitpod Ready-to-Code

Emojoy

The aim of this project is to help people with autism to recognize and use facial expressions.

For this purpose we are developing a web app that uses face recognition and a playful approach to introduce the user to the task of dealing with facial expressions.

Technologies:

  • React frontend
  • AntDesign
  • Face recognition with FaceAPI

Contribution:

We are grateful for any form of support!

Play Now

emojoy's People

Contributors

jonathangpk avatar robinmnk avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar

Forkers

amorstoic

emojoy's Issues

Multi Language support

Instead of writing the texts directly into the components we could use json files for our texts. One file per language or so? We can start with english & german and ask users to contribute translations

Pong mobile friendly

Make pong usable on mobile devices. Maybe only in landscape mode?

Write it in TypeScript

improve user landing page

We should provide the users with more information than we do today.

  • Emotions: What emotions we are addressing and definitions or descriptions of these emotions.
  • How we help: Our approach to the problem. E.g. different phases during training and playing
  • How we respect privacy
  • Who we are
  • That we are open for help (from developers) or donations (patreon?)

memory game

What do you guys think about a memory game?

We can use open datasets to create cards of faces that show the same emotion. This way our users can try to match cards based on the emotion of the faces on the cards.

Different difficulties or versions are possible:

  • two faces with the same emotion
  • one face with emotion and name of emotion
  • face with emotion and emoji

memory game example https://github.com/sandraisrael/Memory-Game-fend
data https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge/data

highscores

We could support individual high scores and some success statistics to the user.

This of course needs user accounts and a database in the backend. We can continue respecting privacy by only asking for username, mail and password. I wouldn't recommend cookies because then high scores are locked to the device.

Maybe this feature should be only available for supporters in order to get the servers paid?

tests

do we want this project to be tested?

mobile device capability

We should work on a mobile version of this app soon. Maybe we can switch our way of designing this app into a "mobile first approach" in which we think about a desktop UI afterwards, since chances are high that users will try to use this app on their mobile devices.

Ask users to provide facial expression data

We could enhance our facial expression feature once we have more data of different facial expressions. This data can be provided (or donated) by users to help us improving our service

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.