Topic: transformers Goto Github

👇 Here are 3102 public repositories matching this topic...

0hq / webgpt
transformers,Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.
User: 0hq
Home Page: https://kmeans.org
gpt nanogpt transformers webgpu

amusi / cvpr2024-papers-with-code
transformers,CVPR 2024 论文和开源项目合集
User: amusi
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking

argosopentech / argos-translate
transformers,Open-source offline translation library written in Python
User: argosopentech
Home Page: https://www.argosopentech.com
python machine-translation transformers translation language-models linux nlp open-source

autogptq / autogptq
transformers,An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Organization: autogptq
transformers deep-learning inference large-language-models llms nlp pytorch quantization transformer

bentrevett / pytorch-sentiment-analysis
transformers,Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
User: bentrevett
pytorch sentiment-analysis tutorial rnn lstm fasttext torchtext sentiment-classification cnn cnn-text-classification lstm-sentiment-analysis pytorch-tutorial pytorch-tutorials pytorch-nlp nlp natural-language-processing recurrent-neural-networks word-embeddings transformers bert

blinkdl / rwkv-lm
transformers,RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
User: blinkdl
attention-mechanism deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn

christianversloot / machine-learning-articles
transformers,🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
User: christianversloot
machine-learning deep-learning neural-networks tensorflow pytorch scikit-learn convolutional-neural-networks gan gans transformers

cluebenchmark / clue
transformers,中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Organization: cluebenchmark
Home Page: http://www.CLUEbenchmarks.com
nlu benchmark chinese corpus dataset bert albert chineseglue glue roberta

cmhungsteve / awesome-transformer-attention
transformers,An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
User: cmhungsteve
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models

deepset-ai / haystack
transformers,:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Organization: deepset-ai
Home Page: https://haystack.deepset.ai
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers

eleutherai / gpt-neo
transformers,An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Organization: eleutherai
Home Page: https://www.eleuther.ai
language-model transformers gpt gpt-2 gpt-3

eleutherai / gpt-neox
transformers,An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
Organization: eleutherai
deepspeed-library gpt-3 transformers language-model

hiyouga / chatglm-efficient-tuning
transformers,Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
User: hiyouga
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch

hiyouga / llama-factory
transformers,Unify Efficient Fine-Tuning of 100+ LLMs
User: hiyouga
fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm

huggingface / alignment-handbook
transformers,Robust recipes to align language models with human and AI preferences
Organization: huggingface
Home Page: https://huggingface.co/HuggingFaceH4
llm rlhf transformers

huggingface / peft
transformers,🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Organization: huggingface
Home Page: https://huggingface.co/docs/peft
adapter diffusion llm parameter-efficient-learning python pytorch transformers lora

huggingface / tokenizers
transformers,💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Organization: huggingface
Home Page: https://huggingface.co/docs/tokenizers
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt

idea-ccnl / fengshenbang-lm
transformers,Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
Organization: idea-ccnl
chinese-nlp pretrained-models pytorch distributed-training transformers aigc multimodal

imoneoi / openchat
transformers,OpenChat: Advancing Open-source Language Models with Imperfect Data
User: imoneoi
Home Page: https://openchat.team
large-language-models open-source transformers

intel-analytics / ipex-llm
transformers,Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.
Organization: intel-analytics
Home Page: https://ipex-llm.readthedocs.io
spark tensorflow keras pytorch bigdl analytics-zoo distributed-deep-learning python scala llm

jessevig / bertviz
transformers,BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
User: jessevig
Home Page: https://towardsdatascience.com/deconstructing-bert-part-2-visualizing-the-inner-workings-of-attention-60a16d86b5c1
natural-language-processing machine-learning visualization neural-network pytorch nlp bert transformer gpt2 roberta

johnsnowlabs / spark-nlp
transformers,State of the Art Natural Language Processing
Organization: johnsnowlabs
Home Page: https://sparknlp.org/
nlp natural-language-processing spark pyspark named-entity-recognition sentiment-analysis lemmatizer spell-checker entity-extraction part-of-speech-tagger

kermitt2 / grobid
transformers,A machine learning software for extracting information from scholarly documents
User: kermitt2
Home Page: https://grobid.readthedocs.io
machine-learning scientific-articles pdf metadata fulltext bibliographical-references hamburger-to-cow deep-learning rnn transformers

labmlai / annotated_deep_learning_paper_implementations
transformers,🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Organization: labmlai
Home Page: https://nn.labml.ai
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning

llmware-ai / llmware
transformers,Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.
Organization: llmware-ai
Home Page: https://pypi.org/project/llmware/
ai bert embedding-vectors embeddings faiss generative-ai information-retrieval large-language-models machine-learning milvus

lucasjinreal / yolov7_d2
transformers,🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
User: lucasjinreal
yolo yolox detection detextron2 tensorrt yolov6 yolov7 face transformers detr

lucidrains / dalle-pytorch
transformers,Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal

lucidrains / deep-daze
transformers,Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
User: lucidrains
artificial-intelligence deep-learning transformers siren implicit-neural-representation text-to-image multi-modality

lucidrains / musiclm-pytorch
transformers,Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanisms deep-learning music-synthesis transformers

lucidrains / palm-rlhf-pytorch
transformers,Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
User: lucidrains
artificial-intelligence attention-mechanisms deep-learning reinforcement-learning transformers human-feedback

lucidrains / vit-pytorch
transformers,Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanism transformers computer-vision image-classification

lucidrains / x-transformers
transformers,A simple but complete full-attention transformer with a set of promising experimental features from various papers
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformers

maartengr / bertopic
transformers,Leveraging BERT and c-TF-IDF to create easily interpretable topics.
User: maartengr
Home Page: https://maartengr.github.io/BERTopic/
bert ldavis machine-learning nlp sentence-embeddings topic topic-modeling topic-modelling topic-models transformers

marqo-ai / marqo
transformers,Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
Organization: marqo-ai
Home Page: https://www.marqo.ai/
deep-learning information-retrieval machinelearning vector-search tensor-search clip multi-modal search-engine transformers vision-language

microsoft / generative-ai-for-beginners
transformers,18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
Organization: microsoft
Home Page: https://microsoft.github.io/generative-ai-for-beginners/
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering

microsoft / presidio
transformers,Context aware, pluggable and customizable data protection and de-identification SDK for text and images
Organization: microsoft
Home Page: https://microsoft.github.io/presidio
data-loss-prevention dlp python pii anonymization privacy data-protection data-anonymization presidio text-anonymization

neuml / txtai
transformers,💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
Organization: neuml
Home Page: https://neuml.github.io/txtai
python search machine-learning nlp semantic-search neural-search vector-search txtai llm vector-database

nielsrogge / transformers-tutorials
transformers,This repository contains demos I made with the Transformers library by HuggingFace.
User: nielsrogge
transformers pytorch bert vision-transformer layoutlm gpt-2

nvidia / megatron-lm
transformers,Ongoing research training transformer models at scale
Organization: nvidia
Home Page: https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
large-language-models model-para transformers

ofa-sys / chinese-clip
transformers,Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
Organization: ofa-sys
chinese computer-vision multi-modal-learning nlp pytorch vision-and-language-pre-training image-text-retrieval clip pretrained-models vision-language

openvinotoolkit / openvino
transformers,OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Organization: openvinotoolkit
Home Page: https://docs.openvino.ai
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp

paddlepaddle / paddlenlp
transformers,👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
Organization: paddlepaddle
Home Page: https://paddlenlp.readthedocs.io
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine

promptslab / promptify
transformers,Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Organization: promptslab
Home Page: https://discord.gg/m88xfYMbK6
chatgpt chatgpt-api gpt-3 gpt-3-prompts prompt-engineering prompt-toolkit prompting chatgpt-python gpt3-library openai

skalskip / courses
transformers,This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
User: skalskip
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp

speechbrain / speechbrain
transformers,A PyTorch-based Speech Toolkit
Organization: speechbrain
Home Page: http://speechbrain.github.io
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition

stas00 / ml-engineering
transformers,Machine Learning Engineering Open Book
User: stas00
Home Page: https://stasosphere.com/machine-learning/
pytorch slurm large-language-models llm machine-learning scalability transformers machine-learning-engineering mlops ai

superduperdb / superduperdb
transformers,🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Organization: superduperdb
Home Page: https://superduperdb.com
ai mlops torch transformers mongodb python pytorch ml database data

thilinarajapakse / simpletransformers
transformers,Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
User: thilinarajapakse
Home Page: https://simpletransformers.ai/
transformers text-classification named-entity-recognition question-answering conversational-ai information-retrival

trigaten / learn_prompting
transformers,Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
User: trigaten
Home Page: https://learnprompting.org
gpt-3 prompting prompt-engineering gpt3 llm chatgpt gpt-4 gpt-4-api large-language-models nlp

xenova / transformers.js
transformers,State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
User: xenova
Home Page: https://huggingface.co/docs/transformers.js
browser javascript transformers webml