Giter VIP home page Giter VIP logo

szimek / webrtc-translate Goto Github PK

View Code? Open in Web Editor NEW
71.0 11.0 26.0 536 KB

Highly experimental (read: "barely working") app that uses WebRTC API and Web Speech API to provide almost (read: "not really") real-time translations during a video call. Chrome only, because of Web Speech API. Demo: https://youtu.be/Tv8ilBOKS2o

Home Page: https://webrtc-translate.herokuapp.com

License: MIT License

JavaScript 98.99% CSS 0.37% HTML 0.64%
webrtc speech-recognition webrtc-api video-call video javascript translation chrome

webrtc-translate's Introduction

WebRTC Translate

Highly experimental (read: "barely working") app that uses WebRTC API and WebSpeech API to provide almost (read: "not really") real-time translations during a video call. At the moment it works only in Chrome, though there's an experimental Web Speech Recognition API implementation in Firefox Nightly, so it's possible that it will work in Firefox soon as well. The UI was inspired by iTranslate app. If you want to host it yourself, you'll need a Google Translate API key.

You can see a short demo video here or you can try it out yourself at https://webrtc-translate.herokuapp.com - once you open this page it will redirect you to a URL with randomly generated room ID. Open the same URL on another computer and you should see and hear the other person. If you really want to, you can try it out on a single computer as well, but you'll have to turn off audio to avoid nasty feedback and miss speech synthesis :/

You can select the language you speak in from the select box on the top left. Click the flag button under the video to start speech recognition. The speech recognition will stop automatically once you stop speaking or press the flag button again.

The previous version had speech recognition always on, but due to the way Web Speech API works it was rather unstable. This version is still available in continuous branch and there's a short screencast of it available here.

Prerequisites

You will need the following things properly installed on your computer.

Installation

  • git clone <repository-url> this repository

  • change into the new directory

  • yarn

  • bower install

Running / Development

  • * GOOGLE_TRANSLATE_API_KEY='xxx' yarn start --environment development
  • Visit your app at http://localhost:4200.
  • If you're having issues with accessing your mic and camera via HTTP, you can run ssh -R 80:localhost:4200 serveo.net and then access the app via provided HTTPS URL.

webrtc-translate's People

Contributors

jmak avatar szimek avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

webrtc-translate's Issues

Better UI for large screens

At the moment it doesn't really work on any mobile device, so it's not that important to have nice design there.

Cannot read property 'pkg' of null

When I try to run this with ember I get the following:

Cannot read property 'pkg' of null
TypeError: Cannot read property 'pkg' of null
at Function.Addon.resolvePath (C:\project\node_modules\ember-cli\lib\models\addon.js:251:18)
at Function.Addon.lookup (C:\project\node_modules\ember-cli\lib\models\addon.js:266:22)
at C:\project\node_modules\ember-cli\lib\models\project.js:153:34
at visit (C:\project\node_modules\ember-cli\lib\utilities\DAG.js:23:3)
at DAG.topsort (C:\project\node_modules\ember-cli\lib\utilities\DAG.js:82:7)
at Project.initializeAddons (C:\project\node_modules\ember-cli\lib\models\project.js:151:9)
at Project.eachAddonCommand (C:\project\node_modules\ember-cli\lib\models\project.js:176:10)
at module.exports (C:\project\node_modules\ember-cli\lib\cli\lookup-command.js:52:13)
at CLI. (C:\project\node_modules\ember-cli\lib\cli\cli.js:31:26)
at $$$internal$$tryCatch (C:\project\node_modules\ember-cli\node_modules\rsvp\dist\rsvp.js:470:16)

Demo Not Working

Hello,

The demo doesn't seem to be working. Is this a problem with the code or the app hosting?

Thanks!

GOOGLE_TRANSLATE_API_KEY=XXXXXX ember server

It looks not working properly, I have replaced XXXXXX by my Google API Key already.
Is the format changed or any further advices? See log for reference below:
~/webrtc-translate$ GOOGLE_TRANSLATE_API_KEY= ember server
module.js:559
throw err;
^
Error: Cannot find module 'internal/util/types'
at Function.Module._resolveFilename (module.js:557:15)
at Function.Module._load (module.js:484:25)
at Module.require (module.js:606:17)
at require (internal/module.js:11:18)
at evalmachine.:31:26
at Object. (/home/jianglong98/webrtc-translate/node_modules/ember-cli/node_modules/configstore/node_modules/graceful-fs/fs.js:11:1)
at Module._compile (module.js:662:30)
at Object.Module._extensions..js (module.js:673:10)
at Module.load (module.js:575:32)
at tryModuleLoad (module.js:515:12)

not able to run in dev mode

how should I run the code I installed all the dependency.

* GOOGLE_TRANSLATE_API_KEY='xxx' yarn start --environment development
this command as it is where should I enter in cmd or somewhere else

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.