ken-arf Goto Github PK

adapter-transformers

Huggingface Transformers + Adapters = ❤️

aeger

medical term extraction tools in Japanese

alignment-handbook

Robust recipes to align language models with human and AI preferences

amazon-sagemaker-gptj

bertopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

bionlp-st-2013-cg

BioNLP Shared Task 2013 GC task corpus

blogs

Jupyter notebooks that support my graph data science blog posts at https://bratanic-tomaz.medium.com/

causallib

A Python package for modular causal inference analysis and model evaluations

evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

ewc.pytorch

An implementation of EWC with PyTorch

example-code-2e

Example code for Fluent Python, 2nd edition (O'Reilly 2022)

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

faiss

A library for efficient similarity search and clustering of dense vectors.

finetune_llms

Repo for fine-tuning Casual LLMs

japanese-word-pmi

A tool to calculate PMI from Japanese corpus

ken-arf.github.io

kenlg-reading

Reading list for knowledge-enhanced text generation, with a survey

knnlm

kotoba-recipes

Support Continual pre-training & Instruction Tuning forked from llama-recipes

llama-adapter

Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

llama.cpp

Port of Facebook's LLaMA model in C/C++

llm-recipes

instruction tuning & continaual pre-training LLM(dense mode)

medinput

Medical text input support tools in Japanese

moe-recipes

nonauto-nmt

PyTorch Implementation of "Non-Autoregressive Neural Machine Translation"

pascal

[ACL 2020] Code and data for our paper "Enhancing Machine Translation with Dependency-Aware Self-Attention"

pixiu

This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).

pytorch_tutorials

PyTorch tutorials.

self-instruct

Aligning pretrained language models with instruction data generated by themselves.

sentence-transformers

Sentence Embeddings with BERT & XLNet