train model about kear HOT 4 OPEN

Hi WQi777,
Thanks for your interest. We just added a line to reproduce results of DeBERTa v3 to https://github.com/microsoft/KEAR/blob/main/bash/task_train.sh.
Hope that helps!

from kear.

Thanks a lot for your reply！

from kear.

but when i run the code ，got an error：

batch size: 4, total_batch_size: 20
[1528]: world_size = 2, rank = 1, backend=nccl
batch size: 4, total_batch_size: 20
restarting from checkpoint.
used_name: last2
restarting from checkpoint.
used_name: last2
loading result from dir test/last2
args.fp16 is 0
loading result from dir test/last2
args.fp16 is 0
load_vocab microsoft/deberta-v3-large
load_vocab microsoft/deberta-v3-large
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
load_data data/csqa_ret_3datasets/train_data.json
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
load_data data/csqa_ret_3datasets/train_data.json
data: 9741, world_size: 2
load_data data/csqa_ret_3datasets/dev_data.json
data: 1222, world_size: 2
get dir test/
make dataloader ...
data: 9741, world_size: 2
load_data data/csqa_ret_3datasets/dev_data.json
data: 1222, world_size: 2
get dir test/
make dataloader ...
max len: 968
95 percent len: 490
train_data 9741
total length: 1218
max len: 968
95 percent len: 490
train_data 9741
total length: 1218
max len: 851
95 percent len: 514
devlp_data 1222
init_model test/last2
set config, model_type= debertav2
deepspeed: True
resume_training: True
config_path:test/last2
model_type= debertav2
Traceback (most recent call last):
File "task.py", line 409, in
srt.init(Model)
File "task.py", line 46, in init
model = ModelClass(lm_config, opt=vars(self.config))
File "/home/aipf/work/wq/KEAR/model/model.py", line 51, in init
self.deberta = MyDebertaV2Model(config)
NameError: name 'MyDebertaV2Model' is not defined

Looking forward to your reply.

from kear.

Hi WQi777,
We have a typo in our code - can you try again?

from kear.