Comments (2)
Hi there, we support any OpenAI compatible endpoint, so you should be able to use it with Groq after setting your API key and updating the base URL. See https://console.groq.com/docs/openai
from routellm.
Closing this for now, let me know if you have other questions!
from routellm.
Related Issues (20)
- Support for Multiple LiteLLM Models HOT 3
- How to set threshold value? HOT 2
- how can we set parameters of model like temperature, streaming, etc? HOT 1
- OpenAIError: The api_key client option must be set HOT 5
- Can we use the matrix factorization model locally by downloading it to our local? HOT 2
- 404 Client Error. HOT 3
- BERT model working HOT 1
- Server doesn't respond to CORS preflight requests
- code not supported by numpy>=2
- unable to edit/build with pdm
- dep version not pinned
- use different embedding model HOT 1
- OpenAI Error HOT 1
- model directory naming conflict
- Does routellm support routing queries to different models in OpenAI assistant? HOT 2
- Support providing separate API keys for strong and weak models
- Why not use Sigmoid over the logit produced by the Classifier in train_matrix_factorization.py?
- Are only GPT-4 and Mistral models currently supported for routing? HOT 2
- about OpenAI api key error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from routellm.