Comments (1)
bagustris
commented on August 23, 2024
Submitted PR for this issue #57.
We need to think about features from transformers. Since there are a lot of features and mostly the recent ones, it will be better to design how we input acoustic features from HF (Hugging Face/Transformers). Once we have a very good design, it will be easy to take input from HF and plug it into Nkululeko. This will make Nkululeko the most comfortable toolkit to test newest speech/audio foundation model to the newest speech dataset (first goal of Nkululeko).
Currently, I just follow the wav2vec2 models and modify them to receive different variants. My thought is just to grab the name of the speech model from HF and put it directly in the INI file.
This approach is similar to what s3prl does. An example of their HF Hubert implementation is here.
from nkululeko.
Related Issues (20)
- show validation loss HOT 1
- Make interface easier
- adding confidence interval HOT 9
- add train test dev method for early stopping HOT 1
- Using GPU as default if it is available
- Error: TypeError: ufunc 'isfinite' not supported for the input types HOT 3
- Support finetuning (with Transformers) HOT 2
- Simplify, organize, and adding error message to tests
- Create python script to automate supported dataset information HOT 1
- Cannot find audio file if audio_path is given and abolute_path is True
- MLP model didn't report the best model but last epoch
- Option to overwrite (no_reuse) experiment directory HOT 2
- Montecarlo dropout HOT 2
- plot summaries on runs
- Change development and GH action to use python3.9 HOT 2
- Activate GH discussion HOT 1
- processed_results.csv is written in directory, where Python is executed and not in the specified results folder HOT 4
- Feature request: number of jobs/workers for 'classic' modelling HOT 4
- BUG: demo module return nan for model other than wav2vec2 variants in finetuning HOT 1
- Feature request: save plots in several different formats HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nkululeko.