NLP Notebooks

Pretraining

• BERT Mask Language Modeling | Pretraining

Classification

• BERT Classification in Pytorch

• BERT Sentence Classification 2 in Pytorch

• Generic Class for Classification using transformers

• Large Scale Multi Label Classification

Question Answering

• Question Answering with a Fine Tuned BERT

Machine Translation

• Machine Translation using transformers

Topic Modeling

• Contextual Topic Modeling

Knowledge Distillation

• BERT Knowledge Distillation in LSTM

NLP Package Exploration

• Simpletransformers Exploration

• Fastai + Transformers Exploration