Comments (9)
for example I have worked with people from https://shtooka.net to make recording of words so could I use them (as i can get the IPA of these recordings quite easily) to create a french model ?
from allosaurus.
Sorry i had not read the part about fine tuning , i will try to use the instruction to create a model for french
from allosaurus.
hi, thanks for your question!
There is another model called interspeech21 which I have not included in the main branch.
It is in the pull request and should already be able to work after you merge that.
You can download that model and run inference by specifying that model, it should give you better results than the current default one.
Another thing you might do is the fine-tuning as you mentioned. It will significantly boost your results when even some small datasets.
from allosaurus.
ok thanks , so you would advice to use your branch + create a fine tune model ?
I continued thinking about it today and I was wondering something about my above use case :
If I create a model trained with french words only pronounced by native speakers , wouldn't that create a bias ?
i.e if one of my Chinese friends wants to correct their accent, allosaurus using that model will not recognize some mandarin-specific phone and will try hard instead to match it to the closest french phone (which is not good in my case because I want to point out their pronunciation is bad ) ? Instead shouldn't I train a mode with both mandarin+french , so that if they pronounce a french words with a strong chinese accent I will be able to correctly transcribe it ?
from allosaurus.
Yeah, I think you can try using the new branch first and see whether it will work for not.
The new branch is trained with both Mandarin and French, so should be able to distinguish phones in both languages
If you fine-tune the model using native speakers, it might work very well for mandarin-speakers as you point out. Training with both languages might be one option.
from allosaurus.
I tried your branch but I'm running into the following issues
- torchaudio was missing as dependencies from setup.py ( adding to the setup.py seems to be enough)
allospeech is not to be found
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/asimon/git/allosaurus/allosaurus/run.py", line 1, in <module>
from allosaurus.app import read_recognizer
File "/home/asimon/git/allosaurus/allosaurus/app.py", line 4, in <module>
from allosaurus.pm.factory import read_pm
File "/home/asimon/git/allosaurus/allosaurus/pm/factory.py", line 4, in <module>
from allosaurus.utils.config import dotdict
File "/home/asimon/git/allosaurus/allosaurus/utils/config.py", line 4, in <module>
from allospeech.config import allospeech_config
ModuleNotFoundError: No module named 'allospeech'
from allosaurus.
I see. allospeech is my private library I used to develop models.
I will fix them. sorry for the inconvenience.
from allosaurus.
ok no problem :) it's already very nice of you to both opensource the library and to take time to answer my questions
from allosaurus.
yeah, thanks!
from allosaurus.
Related Issues (20)
- Prior.txt file path HOT 2
- Optimizing for Latency
- support for python 3.10 HOT 4
- Not able to transcribe simple word what in English HOT 5
- more model for recognition HOT 1
- The timestamp of model 'interspeech21' is incorrect HOT 5
- Unable to run interspeech21 model HOT 1
- Feature normalization can cause NaN to appear HOT 1
- Directory Name con not allowed on Windows HOT 1
- NumPy requirement is less than 1.22 and latest is 1.19.5
- Difference in outputs of splitted v/s unsplitted audio file HOT 2
- Wave error for given sample
- Any way to add new languages?
- UnicodeEncodeError: 'charmap' codec can't encode character '\u02d0' in position 28 when redirecting in WIndows
- Content of fine-tuning files?
- AttributeError: 'PosixPath' object has no attribute 'startswith' HOT 1
- Fix setup.py
- Phone inventory always the default one even after specifying model eng2102 and lang eng
- Is there any way of getting arpabet phonetic transcription for hindi language?
- How long does it theoretically take for "allosaurus" to recognize phonemes?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from allosaurus.