literal-cookbook's Introduction

Literal AI Cookbooks and Guides

Welcome to the Literal AI Cookbooks and Guides repository! This repository is dedicated to providing users with comprehensive cookbooks and guides designed to help you understand and implement AI solutions effectively.

Literal AI is an end-to-end observability, evaluation and monitoring platform for building & improving production-grade LLM applications.

For more information, find the full documentation here. Cookbooks from this repo and more guides are presented in the docs with explanations.

Cookbooks

Python

Name	Category	Description
Context Relevancy with Ragas	Evaluation	Build a RAG application and evaluate this with RAGAS based on context relevancy.
Evaluate User Satisfaction - Customer Support Conversations	Evaluation	Retrieve your Customer Support Conversations from Literal AI and evaluate user satisfaction on this conversational data.
LlamaIndex Integration	Observability	Build a Q&A application with LLamaIndex and monitor it with Literal AI.
Evaluate Agent Runs with Tools	Observability (Tools) & Evaluation	Build a simple agent which can use two tools. Monitor and evaluate the tool usage.
A/B Testing Client-Side	Evaluation	Build two prompts, randomly assign to new conversations and A/B test on a metric.

TypeScript

Name	Category	Description
Prompt Iteration with Promptfoo	Evaluation	Run a simple chat application and evaluate its results with two different prompt templates with Promptfoo.
Image Generation with Dall-E & Literal AI Attachment	Observablity	Use OpenAI Dall-E to Generate an image with a prompt and then send it to Literal AI.
Chatbot using Next.js, OpenAI and Literal AI	Observablity	Create a personalized and monitored chatbot with OpenAI, Next.js and Literal AI.
Chatbot using Vercel ai SDK and Literal AI	Observablity	Create a personalized and monitored chatbot with Vercel ai SDK and Literal AI.
Simple RAG using LanceDB, OpenAI and Literal AI	Observability	Create Simple RAG on Youtube Transcripts stored using LanceDB
Speech-to-Emoji: Next.js app to summarize audio with OpenAI Whisper, GPT-4o and Literal AI	Observability	Create a simple web app that transcribes and summarizes audio using OpenAI Whisper, GPT-4 and Literal AI.
Interactive map with a copilot chat bot	Observability	A world map with a chat bot that is context aware and react to the user position on the map

Recommend Projects