mlabonne / lm-evaluation-harness Goto Github PK

Hi, I'm a Machine Learning Scientist, Author, Blogger, and LLM Developer.

• The LLM Course: A popular curated list of resources to get into LLMs (>29k ⭐).
• Hands-on GNNs: My book about graph neural networks published by Packt (all the code is open source).
• LLM Datasets: Curated list of high-quality datasets for LLM fine-tuning.
• LLM Tools: Automate LLM pipelines with Colab notebooks like LLM AutoEval, LazyMergekit, LazyAxolotl, and AutoQuant.

• AlphaMonarch-7B: Top performer in terms of reasoning + conversational abilities on a variety of benchmarks. [Demo]
• NeuralBeagle14-7B: The most powerful 7B model (rank 10 on the entire Open LLM Leaderboard). [Demo]
• Phixtral: Novel Mixture of Experts architecture with phi-2 models. [Demo]
• Beyonder-4x7B-v3: Mixture of Experts with four excellent fine-tuned Mistral-7b models. [Demo]
• NeuralMarcoro14: My previous best 7B model (rank 1 on the Open LLM Leaderboard 7B param). [Demo]
• NeuralHermes: A DPO fine-tuned version of OpenHermes (extremely cost-efficient). [Demo]