ken-arf Goto Github PK

adapter-transformers

Huggingface Transformers + Adapters = ❤️

aeger

medical term extraction tools in Japanese

alignment-handbook

Robust recipes to align language models with human and AI preferences

amazon-sagemaker-gptj

belle

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

bertopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

bionlp-st-2013-cg

BioNLP Shared Task 2013 GC task corpus

blogs

Jupyter notebooks that support my graph data science blog posts at https://bratanic-tomaz.medium.com/

causallib

A Python package for modular causal inference analysis and model evaluations

chatdoctor

distant

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

ewc.pytorch

An implementation of EWC with PyTorch

example-code-2e

Example code for Fluent Python, 2nd edition (O'Reilly 2022)

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

faiss

A library for efficient similarity search and clustering of dense vectors.

finetune_llms

Repo for fine-tuning Casual LLMs

generative-ai-for-beginners

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

japanese-word-pmi

A tool to calculate PMI from Japanese corpus

ken-arf.github.io

kenlg-reading

Reading list for knowledge-enhanced text generation, with a survey

knnlm

kotoba-recipes

Support Continual pre-training & Instruction Tuning forked from llama-recipes

latent-diffusion

High-Resolution Image Synthesis with Latent Diffusion Models

llama-adapter

Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

llama-nuts-and-bolts

A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation.

llama.cpp

Port of Facebook's LLaMA model in C/C++

llm-recipes

instruction tuning & continaual pre-training LLM(dense mode)

medinput

Medical text input support tools in Japanese

moe-recipes