Season 39 of Jeopardy! has concluded with air date 2023-07-28. Final LLMs vs. Double Jeopardy results are below.

• Answers were re-written as questions, using the category when necessary
• Only Double Jeopardy $2000 questions were prompted
• Time averages shown include model loading
• Only GGML format models were used

Thank you to TheBloke for massive and timely model conversions, ggerganov and all llama.cpp developers and to everyone creating such fantastic models and tools for LLMs!

Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts

Install and run:
git clone https://github.com/aigoopy/llm-jeopardy.git
npm install
node . --help

llm-jeopardy framework uses llama.cpp for model execution and GGML models from Hugging Face. Updated with GGMLv3 models.