Comments (6)
couldn't replicate yet
from nkululeko.
but tess performs nicely as a training for emoodb
from nkululeko.
This error actually happens if we mix the filter (i.e., labels) with other filters, e.g,
check_size = 1000
min_duration_of_samples = 2
Will close this issue since no further action is required.
from nkululeko.
I am re-opensing this issue.
Simple test to reproduce,
python -m nkululeko.nkululeko --config tests/exp_emodb_audmodel_xgb.ini
Or,
python -m nkululeko.nkululeko --config tests/exp_emodb_os_knn.ini
Output
DEBUG nkululeko: running exp_emodb_audmodel from config tests/exp_emodb_audmodel_xgb.ini, nkululeko version 0.83.0
DEBUG experiment: value for type not found, using default: audformat
DEBUG dataset: emodb: loading from ./data/emodb/emodb
DEBUG dataset: emodb: loading tables: []
DEBUG dataset: value for files_tables not found, using default: ['files']
DEBUG dataset: value for label not found, using default: emotion
DEBUG dataset: value for target_tables not found, using default: ['emotion']
DEBUG dataset: emodb: loaded with 535 samples: got targets: True, got speakers: True (10), got sexes: True
DEBUG datafilter: emodb: limited samples to 50, reduced samples from 535 to 50
DEBUG experiment: target: emotion
DEBUG experiment: Target labels (from config): ['angry', 'happy', 'neutral', 'sad']
DEBUG experiment: loaded databases emodb
DEBUG dataset: splitting database emodb with strategy random
DEBUG dataset: value for test_size not found, using default: 20
DEBUG dataset: emodb: [40/10] samples in train/test
DEBUG dataset: emodb: 10 samples in test and 40 samples in train
DEBUG dataset: emodb: mapped {'anger': 'angry', 'happiness': 'happy', 'sadness': 'sad', 'neutral': 'neutral'}
DEBUG dataset: emodb: mapped {'anger': 'angry', 'happiness': 'happy', 'sadness': 'sad', 'neutral': 'neutral'}
DEBUG experiment: value for type not found, using default: dummy
DEBUG experiment: Categories test (nd.array): ['neutral' 'happy']
DEBUG experiment: Categories train (nd.array): ['neutral' 'angry' 'sad' 'happy']
DEBUG experiment: 4 speakers in test and 7 speakers in train
DEBUG nkululeko: train shape : (25, 8), test shape:(6, 8)
DEBUG featureset: extracting audmodel embeddings, this might take a while...
DEBUG featureset: value for aud.model not found, using default: ./audmodel/
DEBUG featureset: value for device not found, using default: cuda
DEBUG experiment: All features: train shape : (25, 1024), test shape:(6, 1024)
DEBUG experiment: scaler: standard
DEBUG scaler: scaling features based on training set
DEBUG runmanager: run 0
DEBUG modelrunner: run: 0 epoch: 0: result: test: 0.400 UAR
DEBUG modelrunner: plotting confusion matrix to emodb_xgb_audmodel_scale-standard_0_000_cnf
ERROR reporter: mismatch between confmatrix dim (3) and labels length (4: ['angry', 'happy', 'neutral', 'sad'])
See my comment above. Maybe it is related to limitation config in database (e.g., db.limit _samples
).
from nkululeko.
My bad,
This happens when using the same name
(output dir) for different experiments (e.g. in test files).
from nkululeko.
sure, it's because there are labels in the train that are not in the test set.
But i think you got a point, this should not be a problem.
from nkululeko.
Related Issues (20)
- show validation loss HOT 1
- Make interface easier
- adding confidence interval HOT 9
- add train test dev method for early stopping HOT 1
- Using GPU as default if it is available
- Error: TypeError: ufunc 'isfinite' not supported for the input types HOT 3
- Support finetuning (with Transformers) HOT 2
- Simplify, organize, and adding error message to tests
- Create python script to automate supported dataset information HOT 1
- Cannot find audio file if audio_path is given and abolute_path is True
- MLP model didn't report the best model but last epoch
- Option to overwrite (no_reuse) experiment directory HOT 2
- Montecarlo dropout HOT 2
- plot summaries on runs
- Change development and GH action to use python3.9 HOT 2
- Activate GH discussion HOT 1
- processed_results.csv is written in directory, where Python is executed and not in the specified results folder HOT 4
- Feature request: number of jobs/workers for 'classic' modelling HOT 4
- BUG: demo module return nan for model other than wav2vec2 variants in finetuning HOT 1
- Feature request: save plots in several different formats HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nkululeko.