-
this repo is about leveraging the pretrained model Bert to do nmt task. It inculdes:
1.1 directly use Bert to get the embedding vector (Bert frozen)
1.2 training Bert and transformer together in NMT task to finetune Bert
1.3 use the finetuned Bert to get the embedding vector (Bert frozen)
-
the code is based on https://github.com/quanpn90/NMTGMinor.git and https://github.com/huggingface/transformers
dan-hbd / bert_transformer Goto Github PK
View Code? Open in Web Editor NEWleverage the pretrained model Bert to do nmt
License: Other