Comments (3)
Thanks for the clarification.
For the issue, I searched all the cases with Table 7 for the dkt and concluded that dropout 0.5 for dkt is the best result, and that was right. :)
If you don't mind, can you share your best parameters for other models?
At least, it would be a great help if you share the values for the models : AKT, DKT, DKVMN, GKT, SAINT, SAKT
Thanks a lot.
from pykt-toolkit.
Thank you for your advice.
We will open the optimal parameters of all models for all data sets in the near future.
from pykt-toolkit.
Thank you for your attention to our work.
Neither the parameters in "configs/kt_config.json" nor "wandb/wandb_{model_name}_train.py" are the best parameters.
The best parameters of each fold for each dataset are obtained by hyperparameter search.
For example, for dataset assist2015, the best parameters are(dkt):
fold 0: {"dataset_name": "assist2015", "model_name": "dkt", "emb_type": "qid", "save_dir": "dkt_tiaocan_assist2015_rerun", "seed": 3407, "fold": 0, "dropout": 0.5, "emb_size": 200, "learning_rate": 0.001}
fold 1: {"dataset_name": "assist2015", "model_name": "dkt", "emb_type": "qid", "save_dir": "dkt_tiaocan_assist2015_rerun", "seed": 224, "fold": 1, "dropout": 0.5, "emb_size": 200, "learning_rate": 0.001}
fold 2: {"dataset_name": "assist2015", "model_name": "dkt", "emb_type": "qid", "save_dir": "dkt_tiaocan_assist2015_rerun", "seed": 42, "fold": 2, "dropout": 0.5, "emb_size": 200, "learning_rate": 0.001}
fold 3: {"dataset_name": "assist2015", "model_name": "dkt", "emb_type": "qid", "save_dir": "dkt_tiaocan_assist2015_rerun", "seed": 42, "fold": 3, "dropout": 0.5, "emb_size": 200, "learning_rate": 0.001}
fold 4: {"dataset_name": "assist2015", "model_name": "dkt", "emb_type": "qid", "save_dir": "dkt_tiaocan_assist2015_rerun", "seed": 42, "fold": 4, "dropout": 0.5, "emb_size": 200, "learning_rate": 0.001}
The best parameters above are obtained on Tesla V100.
from pykt-toolkit.
Related Issues (20)
- 关于一题多知识点的数据集 HOT 1
- 关于运行多个模型都出现‘RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! ’的报错
- 关于Hyper parameter tunning results的问题 HOT 2
- The config file is not in the direct directory of save_model, but in the newly generated file under save_model after I trained the model.
- Problem about the number of questions of Algebra2005 dataset
- iekt_ce
- 评估名称含义 HOT 1
- AKT模型中的问题 HOT 1
- sparseKT-ktop算法存在的问题
- SAINT model has incorrect defaults HOT 2
- Incredibly slow training / randomly stuck in when training wandb_saint_train.py on assist2012
- Could you please provide guidance on obtaining the correct datasets? HOT 6
- Help on setting up pykt HOT 1
- 请问后续是否考虑添加 MAN 模型,这个模型AUC和ACC非常高,而且有开源 HOT 1
- train_model.py中函数model_forward关于dkvmn的问题
- texts for questions, knowledge components, and students answers in the datasets
- AKT Information Leakage HOT 3
- emb_path预训练嵌入的问题 HOT 1
- Error about dtransfomer prediction HOT 1
- AT-DKT 运行结果比论文结果高了10% HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pykt-toolkit.