Support roles like for example user, system, assistant about ollama4j HOT 3 CLOSED

Ollama wise this is possible, for example:

curl http://localhost:11434/api/chat -d '{
  "model": "llama2",
  "messages": [
    { "role": "system", "content": "You are a sailor that answers every question in a very piraty way" },
    { "role": "user", "content": "why is the sky blue?" }
  ]
}'

would override the system-prompt given in the modeldefinition of ollama.

Thus it should be possible to implement this. If @amithkoujalgi is okay with this, I'd like to give it a try to extend the RequestModel to support this.

Cheers!

from ollama4j.

@michaelwechner Thank you for the info. I'd very much like to support this from Ollama4j, but unfortunately, I'm currently occupied with a ton of work and unable to dedicate time to Ollama4j.

@AgentSchmecker I'd very much appreciate it if you could give it a try!

from ollama4j.

In addition to the /api/chat endpoint, the system prompt parameter (and other parameters that override model behaviours) can also be provided to requests at /api/generate.

Thus these should also be made available for the ollama4j API.

from ollama4j.