Topic: transformers Goto Github

👇 Here are 3601 public repositories matching this topic...

0hq / webgpt
transformers,Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.
User: 0hq
Home Page: https://kmeans.org
gpt nanogpt transformers webgpu

amusi / cvpr2024-papers-with-code
transformers,CVPR 2024 论文和开源项目合集
User: amusi
cvpr cvpr2020 computer-vision deep-learning machine-learning object-detection image-segmentation paper image-processing visual-tracking

arc53 / docsgpt
transformers,GPT-powered chat for documentation, chat with your documents
Organization: arc53
Home Page: https://app.docsgpt.cloud/
ai python natural-language-processing react web-app chatgpt docsgpt information-retrieval language-model llm machine-learning pytorch rag semantic-search transformers

argosopentech / argos-translate
transformers,Open-source offline translation library written in Python
User: argosopentech
Home Page: https://www.argosopentech.com
python machine-translation transformers translation language-models linux nlp open-source

autogptq / autogptq
transformers,An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Organization: autogptq
deep-learning inference large-language-models llms nlp pytorch quantization transformer transformers

bentrevett / pytorch-sentiment-analysis
transformers,Tutorials on getting started with PyTorch and TorchText for sentiment analysis.
User: bentrevett
bert cnn cnn-text-classification fasttext lstm lstm-sentiment-analysis natural-language-processing nlp pytorch pytorch-nlp pytorch-tutorial pytorch-tutorials recurrent-neural-networks rnn sentiment-analysis sentiment-classification torchtext transformers tutorial word-embeddings

blinkdl / rwkv-lm
transformers,RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
User: blinkdl
attention-mechanism chatgpt deep-learning gpt gpt-2 gpt-3 language-model linear-attention lstm pytorch rnn rwkv transformer transformers

christianversloot / machine-learning-articles
transformers,🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.
User: christianversloot
machine-learning deep-learning neural-networks tensorflow pytorch scikit-learn convolutional-neural-networks gan gans transformers

cluebenchmark / clue
transformers,中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard
Organization: cluebenchmark
Home Page: http://www.CLUEbenchmarks.com
albert benchmark bert chinese chineseglue corpus dataset glue language-model nlu pretrained-models pytorch roberta tensorflow transformers

cmhungsteve / awesome-transformer-attention
transformers,An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
User: cmhungsteve
transformer attention-mechanism vision-transformer deep-learning awesome-list transformer-cv transformer-architecture transformer-awesome transformer-with-cv transformer-models

deepset-ai / haystack
transformers,:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Organization: deepset-ai
Home Page: https://haystack.deepset.ai
nlp question-answering bert language-model pytorch semantic-search squad information-retrieval summarization transformers

eleutherai / gpt-neo
transformers,An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
Organization: eleutherai
Home Page: https://www.eleuther.ai
language-model transformers gpt gpt-2 gpt-3

eleutherai / gpt-neox
transformers,An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Organization: eleutherai
Home Page: https://www.eleuther.ai/
deepspeed-library gpt-3 transformers language-model

foundationvision / var
transformers,[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
Organization: foundationvision
auto-regressive-model diffusion-models image-generation transformers autoregressive-models generative-ai generative-model gpt gpt-2 large-language-models

hiyouga / chatglm-efficient-tuning
transformers,Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
User: hiyouga
chatglm chatgpt fine-tuning lora alpaca peft huggingface language-model transformers pytorch

hiyouga / llama-factory
transformers,Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
User: hiyouga
Home Page: https://arxiv.org/abs/2403.13372
fine-tuning language-model llama llm peft transformers rlhf qlora quantization chatglm

huggingface / alignment-handbook
transformers,Robust recipes to align language models with human and AI preferences
Organization: huggingface
Home Page: https://huggingface.co/HuggingFaceH4
llm rlhf transformers

huggingface / peft
transformers,🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Organization: huggingface
Home Page: https://huggingface.co/docs/peft
adapter diffusion llm parameter-efficient-learning python pytorch transformers lora

huggingface / tokenizers
transformers,💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Organization: huggingface
Home Page: https://huggingface.co/docs/tokenizers
nlp natural-language-processing natural-language-understanding language-model transformers bert gpt

idea-ccnl / fengshenbang-lm
transformers,Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。
Organization: idea-ccnl
chinese-nlp pretrained-models pytorch distributed-training transformers aigc multimodal

imoneoi / openchat
transformers,OpenChat: Advancing Open-source Language Models with Imperfect Data
User: imoneoi
Home Page: https://openchat.team
large-language-models open-source transformers

intel-analytics / ipex-llm
transformers,Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, Phi, MiniCPM, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, GraphRAG, DeepSpeed, vLLM, FastChat, Axolotl, etc.
Organization: intel-analytics
pytorch llm transformers gpu

jessevig / bertviz
transformers,BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
User: jessevig
Home Page: https://towardsdatascience.com/deconstructing-bert-part-2-visualizing-the-inner-workings-of-attention-60a16d86b5c1
natural-language-processing machine-learning visualization neural-network pytorch nlp bert transformer gpt2 roberta transformers

johnsnowlabs / spark-nlp
transformers,State of the Art Natural Language Processing
Organization: johnsnowlabs
Home Page: https://sparknlp.org/
nlp natural-language-processing spark pyspark named-entity-recognition sentiment-analysis lemmatizer spell-checker entity-extraction part-of-speech-tagger

kermitt2 / grobid
transformers,A machine learning software for extracting information from scholarly documents
User: kermitt2
Home Page: https://grobid.readthedocs.io
bibliographical-references crf deep-learning fulltext hamburger-to-cow machine-learning metadata pdf rnn scientific-articles transformers

labmlai / annotated_deep_learning_paper_implementations
transformers,🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Organization: labmlai
Home Page: https://nn.labml.ai
deep-learning deep-learning-tutorial pytorch gan transformers reinforcement-learning optimizers neural-networks transformer machine-learning attention literate-programming

lucidrains / dalle-pytorch
transformers,Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
User: lucidrains
artificial-intelligence deep-learning attention-mechanism text-to-image transformers multi-modal

lucidrains / deep-daze
transformers,Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
User: lucidrains
artificial-intelligence deep-learning transformers siren implicit-neural-representation text-to-image multi-modality

lucidrains / palm-rlhf-pytorch
transformers,Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
User: lucidrains
artificial-intelligence attention-mechanisms deep-learning reinforcement-learning transformers human-feedback

lucidrains / vit-pytorch
transformers,Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
User: lucidrains
artificial-intelligence attention-mechanism transformers computer-vision image-classification

lucidrains / x-transformers
transformers,A simple but complete full-attention transformer with a set of promising experimental features from various papers
User: lucidrains
artificial-intelligence deep-learning attention-mechanism transformers

maartengr / bertopic
transformers,Leveraging BERT and c-TF-IDF to create easily interpretable topics.
User: maartengr
Home Page: https://maartengr.github.io/BERTopic/
bert transformers topic-modeling sentence-embeddings nlp machine-learning topic ldavis topic-modelling topic-models

marqo-ai / marqo
transformers,Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
Organization: marqo-ai
Home Page: https://www.marqo.ai/
chatgpt clip deep-learning gpt hacktoberfest hnsw information-retrieval knn large-language-models machine-learning machinelearning multi-modal natural-language-processing search-engine semantic-search tensor-search transformers vector-search vision-language visual-search

microsoft / generative-ai-for-beginners
transformers,18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/
Organization: microsoft
Home Page: https://microsoft.github.io/generative-ai-for-beginners/
ai chatgpt dall-e generativeai gpt azure generative-ai llms openai prompt-engineering

microsoft / presidio
transformers,Context aware, pluggable and customizable data protection and de-identification SDK for text and images
Organization: microsoft
Home Page: https://microsoft.github.io/presidio
anonymization anonymization-service data-anonymization data-loss-prevention data-masking data-protection data-scrubbing de-identification dlp microsoft pii pii-anonymization pii-anonymization-service pii-detection presidio privacy privacy-protection python text-anonymization transformers

neuml / txtai
transformers,💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
Organization: neuml
Home Page: https://neuml.github.io/txtai
python search machine-learning nlp semantic-search neural-search vector-search txtai llm vector-database

niedev / rtranslator
transformers,Open source real-time translation app for Android that runs locally
User: niedev
translator bluetooth-le realtime-translator android-app onnx onnxruntime sentencepiece transformers translation nllb

nielsrogge / transformers-tutorials
transformers,This repository contains demos I made with the Transformers library by HuggingFace.
User: nielsrogge
transformers pytorch bert vision-transformer layoutlm gpt-2

nvidia / megatron-lm
transformers,Ongoing research training transformer models at scale
Organization: nvidia
Home Page: https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
large-language-models model-para transformers

ofa-sys / chinese-clip
transformers,Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
Organization: ofa-sys
chinese computer-vision multi-modal-learning nlp pytorch vision-and-language-pre-training image-text-retrieval clip pretrained-models vision-language

openvinotoolkit / openvino
transformers,OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Organization: openvinotoolkit
Home Page: https://docs.openvino.ai
inference deep-learning openvino ai computer-vision diffusion-models generative-ai llm-inference natural-language-processing nlp

paddlepaddle / paddlenlp
transformers,👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
Organization: paddlepaddle
Home Page: https://paddlenlp.readthedocs.io
nlp embedding bert ernie paddlenlp pretrained-models transformers information-extraction question-answering search-engine

qubvel-org / segmentation_models.pytorch
transformers,Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.
Organization: qubvel-org
Home Page: https://smp.readthedocs.io/
segmentation image-processing pspnet unet unet-pytorch pytorch fpn models imagenet pretrained-models

skalskip / courses
transformers,This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
User: skalskip
computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp

speechbrain / speechbrain
transformers,A PyTorch-based Speech Toolkit
Organization: speechbrain
Home Page: http://speechbrain.github.io
speech-recognition speech-toolkit speaker-recognition speech-to-text speech-enhancement speech-separation audio audio-processing speech-processing speechrecognition

stas00 / ml-engineering
transformers,Machine Learning Engineering Open Book
User: stas00
Home Page: https://stasosphere.com/machine-learning/
pytorch slurm large-language-models llm machine-learning scalability transformers machine-learning-engineering mlops ai

superduper-io / superduper
transformers,Superduper: Bring AI to your database! Integrate AI models and workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting, training and vector search.
Organization: superduper-io
Home Page: https://superduper.io
ai chatbot data database distributed-ml inference llm-inference llm-serving llmops ml mlops mongodb pretrained-models python pytorch rag semantic-search torch transformers vector-search

thilinarajapakse / simpletransformers
transformers,Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
User: thilinarajapakse
Home Page: https://simpletransformers.ai/
transformers text-classification named-entity-recognition question-answering conversational-ai information-retrival

trigaten / learn_prompting
transformers,Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
User: trigaten
Home Page: https://learnprompting.org
gpt-3 prompting prompt-engineering gpt3 llm chatgpt gpt-4 gpt-4-api large-language-models nlp

xenova / transformers.js
transformers,State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
User: xenova
Home Page: https://huggingface.co/docs/transformers.js
browser javascript transformers webml