danield21 Goto Github PK

a-tour-of-pytorch-optimizers

A tour of different optimization algorithms in PyTorch.

academicpages.github.io

Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

adahessian

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

adalora

AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).

adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

adversarylosslandscape

On the Loss Landscape of Adversarial Training: Identifying Challenges and How to Overcome Them [NeurIPS 2020]

ai-notes

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

aisystem

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

analyze_ada_hessian

Analyze AdaHessian optimizer on 2D functions.

apollo

Apollo: An Adaptive Parameter-wise Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization

aqlm

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf

average_squares

awesome-causality-algorithms

An index of algorithms for learning causality with data

awesome-causality-data

A data index for learning causality.

awesome-efficient-llm

A curated list for Efficient Large Language Models

awesome-explainable-ai

A collection of research materials on explainable AI/ML

awesome-llm-compression

Awesome LLM compression research papers and tools.

awesome-llm-inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

awesome-llm-survey

An Awesome Collection for LLM Survey

awesome-mixture-of-experts

A collection of AWESOME things about mixture-of-experts

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

awsome-distributed-training

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

backrazor_neurips22

[Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huang, Xianzhi Du, Denny Zhou, Zhangyang Wang

badam

calculate-flops.pytorch

The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer(Bert、LlaMA etc Large Language Model)

causal-text-papers

Curated research at the intersection of causal inference and natural language processing.

cause

Code for the Recsys 2018 paper entitled Causal Embeddings for Recommandation.

cdcr-beyond-corpus-tailored

📄🕸️ Generalizing Cross-Document Event Coreference Resolution Across Multiple Corpora

ckd