lonepatient / bert-sentence-similarity-pytorch Goto Github PK

What's your score of this model? Thank you!

When I run python train_bert_atec_nlp.py, I get the error:

Traceback (most recent call last): File "train_bert_atec_nlp.py", line 15, in <module> from pybert.model.nn.bert_fine import BertFine File "~/bert-sentence-similarity-pytorch/pybert/model/nn/bert_fine.py", line 3, in <module> from pytorch_pretrained_bert.modeling import PreTrainedBertModel, BertModel
ImportError: cannot import name 'PreTrainedBertModel'

Thank you very much!

跑的是atec的数据，但是loss和acc一直在0.5 和 80% 附近徘徊，loss没有下降，acc也是在[75% - 90+%]之间。
validation的时候F1就直接为0了。
用quora question pair 是数据跑也是同样的结果，loss一直不下降。