Giter VIP home page Giter VIP logo

korean-plm's Introduction

Korean-PLM (Korean Pre-trained Language Models)

공개된 한국어 사전학습 모델을 기록합니다. 크게 아래 3개의 모델 계열로 구분했으며, 모델 사이즈는 정확하지 않을 수 있습니다.

  • Encoder Model (BERT 계열)
  • Decoder Model (GPT 계열)
  • Encoder-Decoder Model (Seq2seq 계열)

Encoder Model (BERT 계열)

Model Name Size Link
LASSL BERT Small (10M) link
LASSL RoBERTa Small (10M) link
TUNiB ELECTRA (Ko) Small (10M) link
TUNiB ELECTRA (Ko-En) Small (10M) link
KoELECTRA Small (10M) link
KcELECTRA Small (10M) link
Soongsil-BERT Small (10M) link
Ko-CHAR-ELECTRA Small (10M) link
Distill-KoBERT 30M link
KoBERT Base (110M) link
KorBERT Base (110M) link
HanBERT Base (110M) link
KcBERT Base (110M) link
Soongsil-BERT Base (110M) link
KLUE-RoBERTa Base (110M) link
KoELECTRA Base (110M) link
KcELECTRA Base (110M) link
TUNiB-ELECTRA (Ko) Base (110M) link
TUNiB-ELECTRA (Ko-En) Base (110M) link
LMKor Albert Base (110M) link
LMKor Bert Base (110M) link
LMKor Funnel Base (110M) link
LMKor ELECTRA Base (110M) link
KalBERT Base (110M) link
LASSL BERT Base (110M) link
KoBigBird Base (110M) link
Ko-CHAR-BERT Base (110M) link
Ko-CHAR-ELECTRA Base (110M) link
BrainSBERT Base (110M) link
KPFBERT Base (110M) link
KcBERT Large (340M) link
KLUE-RoBERTa Large (340M) link

Decoder Model (GPT 계열)

Model Name Size Link
LASSL GPT2 Small (20M) link
LMKor KoGPT2 Base (110M) link
SKT KoGPT2 Base (110M) link
SKT KoGPT Trinity 1.2B link
KakaoBrain KoGPT 6B link
EleutherAI Polyglot-Ko 1.3B link
EleutherAI Polyglot-Ko 3.8B link
EleutherAI Polyglot-Ko 5.8B link
EleutherAI Polyglot-Ko 12.8B link
KoAlpaca (Polyglot-Ko) 5.8B link
KoAlpaca (Polyglot-Ko) 12.8B link

Encoder-Decoder Model (Seq2seq 계열)

Model Name Size Link
Cosmoquester BART Mini (13M) link
KE-T5 (Ko-En) Small (60M) link
KE-T5 (Ko) Small (60M) link
LMKor T5 Small (60M) link
Cosmoquester BART Small (40M) link
LMKor BERT Shared Base (130M) link
SKT KoBART Base (130M) link
Cosmoquester BART Base (130M) link
Kolang-T5 Base (220M) link
KcT5 Base (220M) link
KE-T5 (Ko-En) Base (220M) link
KE-T5 (Ko) Base (220M) link
Asian BART (Ko) Base (360M) link
pko-t5 (Ko) Base (250M) link
Wisenut KoT5 (Ko) Base (220M) link
mBART Large (610M) link
KE-T5 (Ko-En) Large (770M) link
KE-T5 (Ko) Large (770M) link
pko-t5 (Ko) Large (800M) link

korean-plm's People

Contributors

sooftware avatar snoop2head avatar

Stargazers

박기찬 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.