Giter VIP home page Giter VIP logo

zip-captions's People

Contributors

crippit avatar cwebb02 avatar jptrsn avatar shaunpearsondev avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

zip-captions's Issues

[APP-37] INSTALL.txt Please

Would be great to have some basic installation instructions to get folks going and have that linked from the README.

Repeating speech recognition and network communication errors

Describe the bug
When I use Zip Captions for a lecture at a college class, it will repeatedly stop transcribing and give a speech recognition error stating the required network communication for completing the recognition has failed. This only occurs through basic listening as I do not use the sharing/broadcast feature.

To Reproduce
Steps to reproduce the behavior:

  1. Go to Google Chrome, visit https://zipcaptions.app/
  2. Click on the microphone (๐ŸŽค) icon in the top-right corner.
  3. Transcribed audio will appear and works for certain amount of time.
  4. The error (in red text) will appear and the microphone (๐ŸŽค) icon in the top-right corner becomes a warning (โš ๏ธ) symbol. When hovering over the warning symbol, a yellow tooltip appears saying Network.

Expected behavior
Zip Captions should continue to transcribe as normal, as long there is no issue with Google's speech recognition service.

Actual behavior
At random interval, Zip Captions will stop transcribing and give me an error, Speech recognition error: Network communication required for completing the recognition failed. Sometimes it is not clear an error has occurred as it is usually hidden towards the top instead of appearing at the bottom for me to easily see.

Screenshots
If applicable, add screenshots to help explain your problem.

Screenshots from 1/22/2024 Discord discussion

error1
error2
error3

1/24/2024 DevTools network log

image

Desktop (please complete the following information):

  • OS: Windows 11
  • Browser: Google Chrome
  • Version: 120.0.6099.227
  • Microphone: built into a HP all-in-one system, can get more information if necessary

Additional context
I was directed here after a brief discussion in the #bugs channel of the Discord server.

Captions Stop without being pause

While running captions via a Google Chrome session, captions were paused 6 times during the church sermon without any action on our side. We were using the Share functionality and the first time this happened, we lost connection to the tablets viewing our session. The remaining times it auto paused we had to start the captions back.

CEA 608-708 don't work well

Hello and congratulations on your project!

I've tried it on OBS Studio 29.1.3 for Linux Debian 12 and I'm having problems getting the CEA 608-708 to work.
When I stream to Youtube, the subtitling stops, or worse, whole sentences or words are missing.
I don't know if it's related to OBS or Youtube.

Have you ever noticed this?

Thanks for your help.

[APP-82] Speech Recognition Error: Speech Input Was Aborted In Some Manner.

I'm getting a persistent error: whilst speaking after a few seconds this pops up and the input stops completely until I double click the microphone button (it then does it again a few seconds later). Browser: Google Chrome Have tried clearing browser cache, running in incognito window, restarting audio engine, using alternative audio inputs (both through my virtual audio engine and not)

Client side tests are incomplete or broken

@coderabbitai Test files matching the pattern /packages/client/src/**/*.spec.ts are related to the client project in this nx monorepo. Many of these test files do not pass, and all are missing appropriate test methods. Please review each test file in the path above and recommend improvements to testing coverage and functionality.

[APP-32] Browser compatibility warning

On firefox, users should encounter a warning message when the service encounters the fatal error that it cannot access the API.

Also need to verify Edge compatibility. Looks like it may not be as performant

Application affecting mic control on pc

When using the application on its webpage, it is affecting microphone levels on the PC.
It is choosing the levels that the microphone reads out without someone changing it or wanting it to be changed.

to reproduce:
Open up the zipcaptions
open up sounds on pc
open up properties of microphone
Go to levels section of microphone
once you start to have zip captions listening, it will change the volume levels

Expected behavior
Expected to capture words and produce captions but not change the volume of my microphone as it is used elsewhere.

Actual behavior
It is changing the levels of my microphone

Screenshots
before starting zipcaptionws
after starting zip captions

Desktop (please complete the following information):

  • OS: 64-bit Windows 10 Home
  • Browser Chrome
  • Version 22H2

Additional context
This was not happening just a couple weeks ago, not sure why it is now connected to change volume levels. If this is an added feature it would be nice to be removed. It is changing my microphone levels to random amounts. As a streamer I need these to stay at the same level unless I am changing them. Thank you for looking into this

tablet capability requested

I am the Media Director for a small church who is currently using Web Captioner to supply captions for one of our congregants who is deaf. Web Captioner was able to create an add-in to allow the captions to be displayed on a tablet so our member can sit anywhere in the sanctuary during service. Since WC is being sunset the end of October I started researching options and ZipCaptions seems to be the best solution for us however I am hoping you will be able to add the tablet viewing capability so we can continue to give our member the freedom to sit in the congregation without being tied to the Media Booth.

I would love to have a conversation with you about this.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.