English pre-trained release? about albert_zh HOT 10 CLOSED

as albert already achieved state of the art performance of main english benchmarks, i think authors of the paper will release english revision in the near future.

from albert_zh.

Yes, it is true. I haven't found any info on a release yet. Maybe, I should train one myself. Thank you very much.

from albert_zh.

thank you. where can i find english corpus that used in the papers?

from albert_zh.

If I am not mistaken, it is the same as BERT. It is BookCorpus and English Wikipedia (the pre-processing here https://github.com/attardi/wikiextractor).

Awesome work by the way to reproduce ALBERT.

from albert_zh.

great. thanks.

from albert_zh.

Hi , I am also interested in this idea, by the way do u have bookcorpus data?

from albert_zh.

were you able to find bookcorpus using jpcorb20's link above?

from albert_zh.

No, but I ‘m curious about that. Bc I try to find it. But I didn’t get sth link

from albert_zh.

You are right, sorry, the link inside is down. At the moment, the only thing I found is this library to crawl the original website: https://github.com/soskek/bookcorpus ...

from albert_zh.

ok, thanks. I just want that dataset XD

from albert_zh.