ikraduya / nitro Goto Github PK
View Code? Open in Web Editor NEWThis project forked from janhq/cortex
A serious server implementation of LlamaCPP. OpenAI-compatible API, queue, & scaling. Embed a production level, local inference engine in your apps.
Home Page: https://nitro.jan.ai/
License: GNU Affero General Public License v3.0