smutuvi / hgiyt Goto Github PK
View Code? Open in Web Editor NEWThis project forked from adapter-hub/hgiyt
Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
Home Page: https://arxiv.org/abs/2012.15613