Giter VIP home page Giter VIP logo

SPACECHAT

What if you could magically understand anyone in the world?
What if you could experience a conversation beyond words?

Spacechat is a virtual reality chatroom that allows users to interpret and experience speech with multiple senses. Users enter a mesmerizing digital world where they can speak with others in twelve languages using automatic realtime translation, and watch the emotional content of their conversation rendered dazzlingly in virtual reality.

Created by @elsa-brown, @thefishter, @keziyah, and @ssundby
Powered by A-Frame, WebGL, socket.io, React.js, Redux, Node.js, Express.js

An immersive multi-sensory communication experience

  • Users select one of twelve supported languages
    • English, Spanish, French, Italian, Portuguese, German, Dutch, Arabic, Russian, Chinese, Japanese, Korean
  • Users enter one of four mysterious abstracted worlds
    • bubbles, plasma, cosmos, ufo
  • Web sockets enable real-time communication between users and the VR environment
  • Web Speech API both captures spoken messages in the user's browser and speechifies incoming messages
  • Google Translate API powers seamless communication and understanding between all users, across languages
  • Indico Text APIs continuously analyze conversation content
    • Sentiment: analyzes the positivity of a message
    • Emotion: analyzes a message's alignment with five emotions - anger, fear, joy, sadness, and surprise
    • Personality: predicts the personality of a speaker based on the Five Factor Model
  • Virtual environments respond to Indico analyses by changing color, size, and movement patterns

Future directions

  • open source release, to allow users to create and submit their own VR worlds
  • avatars to represent users, which visually respond specifically to that user's message content
  • incorporation of WebRTC audio, to enable users subscribed to the same language to hear each other's voices

space-chat's Projects

space-chat icon space-chat

A VR chatroom that translates speech in real time, while emotional analysis of the conversation unfolds via responsive, visually dazzling scenes (A-Frame, WebGL, socket.io, React, Web Speech/Google Translate/Indico Text APIs)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.