HuggingFaceHub fails with "Error raised by inference API: Cannot override task for LLM models" about jupyter-ai HOT 7 CLOSED

I have the same problem with different models as well (including mistralai/Mistral-7B-Instruct-v0.2 and meta-llama/Meta-Llama-3-8B)

from jupyter-ai.

Thank you all for reporting this issue! We just merged a PR to fix this. It will be included in the next release, tentatively scheduled for early next week.

Note: this PR will not be backported to 1.x as JupyterLab 3 reached end-of-maintenance yesterday. See #761.

from jupyter-ai.

Thank you for opening your first issue in this project! Engagement like this is essential for open source projects! 🤗

If you haven't done so already, check out Jupyter's Code of Conduct. Also, please try to follow the issue template as it helps other other community members to contribute more effectively.

You can meet the other Jovyans by joining our Discourse forum. There is also an intro thread there where you can stop by and say Hi! 👋

Welcome to the Jupyter community! 🎉

from jupyter-ai.

Met the same problem. And I think I'm already get access to this model through "https://huggingface.co/bigcode/starcoder"

from jupyter-ai.

I have the same problem with different models as well (including mistralai/Mistral-7B-Instruct-v0.2 and meta-llama/Meta-Llama-3-8B)

from jupyter-ai.

I can solve it by updating the libraries:langchain and huggingface-hub

from jupyter-ai.

according to https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/discussions/115, changing huggingface_hub.interface_api file on 152 line i replaced api_url as as self.api_url = f"{INFERENCE_ENDPOINT}/models/{repo_id}"
it works for me.

But it seems that the length of answer is limitted. I don't know why :(

from jupyter-ai.