marscrazy Goto Github PK

belle

BELLE: Bloom-Enhanced Large Language model Engine（开源中文对话大模型-70亿参数）

bmtrain

Efficient Training (including pre-training and fine-tuning) for Big Models

checkpoints

chinese_chatbot_corpus

中文公开聊天语料库

chinesenlpcorpus

中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。

classical-modern

非常全的文言文（古文）-现代文平行语料

clip_benchmark

CLIP-like model evaluation

dlperf

DeepLearning Framework Performance Profiling Toolkit

douzero

[ICML 2021] DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning | 斗地主AI

flagai

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

glm

GLM (General Language Model)

glm-130b

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

imix

ICLR 2021 i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning

largescale

lightning

Build and train PyTorch models and connect them to the ML lifecycle using Lightning App templates, without handling DIY infrastructure, cost management, scaling, and other headaches.

megatron-deepspeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

megatron-lm

Ongoing research training transformer models at scale

mtdnn

Multi-scale Two-way Deep Neural Network

proposing-projects

This repo contains the LF AI & Data Project Proposal Process and Project Lifecycle. They explain the process to host new projects in LF AI & Data and provide a proposal template.

sentaugment

SentAugment is a data augmentation technique for NLP that retrieves similar sentences from a large bank of sentences. It can be used in combination with self-training and knowledge-distillation, or for retrieving paraphrases.

simcse

EMNLP'2021: SimCSE: Simple Contrastive Learning of Sentence Embeddings

sphinx_tutorial

Tutorial for documenting your Python code with Sphinx

stable-diffusion

A latent text-to-image diffusion model

stable-diffusion-webui

Stable Diffusion web UI

textdataset