Comments (10)
I think this is due to the hot module reloading not going through nginx properly.
I fixed it on main with 58cf7d0 can you pull the latest main and tell me if it's fixed ? @kells1986 @nawalnew
from serge.
I can't get to the chat page. After I click "Start a New Chat" it just hangs forever before I eventually get a 504 error. This is on my M1 machine, tried firefox and chrome
from serge.
Sorry @kells1986 , I didnt run into this issue on my mac.
But look in your dev tools what is wrong there. Maybe the same underlying websocket issue.
from serge.
I'm seeing the same issue now too:
WebSocket connection to 'ws://localhost:8008/' failed:
Direct websocket connection fallback. Check out https://vitejs.dev/config/server-options.html#server-hmr to remove the previous connection error.
More context: setupWebSocket @client.ts: 78
from serge.
Working! Thanks, this is awesome!
from serge.
I'm gonna close this now, if you still have issues let me know and I will reopen it!
from serge.
Hi,
Hopefully you don't mind me posting in a closed issue, but I'm still facing the same issue on the latest commit on main running on a M1 MacBook. I can see the request successfully reaches the API, but it's infinitely stuck on loading (and still showing the WebSocket connection failed error message).
Am I doing something wrong here? 🤔
from serge.
@dylancl No problem, if you have an issue I want to help!
Just as a last check, can you try rebuilding with docker compose build --no-cache
? if the issue persists, I'll re-open it no problem.
from serge.
I'm getting the same error too. Stuck on LOADING.
Running on Mac M2 Max 64gb RAM, 30B parameter.
This is the first run after downloading the repo, not likely cache issue.
from serge.
Hello, had the same issue.
Should use first: docker compose build --no-cache
Thank you need to lead the models somehow again. My downloaded Models werent there.
The Best way is to delete your folder and docker file. And then make all steps Again, worked then.
git clone https://github.com/nsarrazin/serge.git && cd serge
cp .env.sample .env
docker compose up -d
docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 7B
I just tried 7B model. 13B Didnt work first try
from serge.
Related Issues (20)
- 🚀 [Feature]: Add OpenVino / OpenVino Model Server HOT 1
- 🐛 [Bug]: Web interface does not render properly on mobile devices HOT 1
- 🚀 [Feature]: Add LINCE-Mistal model HOT 1
- 🐛 [Bug]: UI components are missing accessibility labels HOT 2
- 🐛 [Bug]: response text generated by a model sometimes disappears after computer/browser is woken up from a 'sleep' HOT 4
- have a separate page which displays downloaded moddles. HOT 1
- 🚀 [Feature]: Add support for Intel ARC GPUs A750 and A770 (If Possible) HOT 2
- bug: Allow loading .gguf and .bin files HOT 3
- 🚀 [Feature]: add eagle 7b HOT 3
- 🐛 [Bug]: system reachable via ICMP and via Port 8008 but screen "navy blue" with no text whatsoever HOT 14
- 🚀 [Feature]: Add Nous-Hermes-2-Mistral-7B-DPO HOT 8
- 🚀 [Feature]: Add support for uploading files during chat conversation
- 🐛 [Bug]: New install - response keeps repeating the last line HOT 7
- 🚀 [Feature]: add characters HOT 6
- 🚀 [Feature]: Please add Gorilla: Large Language Model Connected with Massive APIs HOT 3
- 🤗 [Question]: Whats the difference between the... models?
- 🚀 [Feature]: Add meta-llama/Meta-Llama-3-70B-Instruct HOT 7
- 🐛 [Bug]: Can't use pre-existing model at /weights HOT 1
- 🐛 [Bug]: DLLAMA_BLAS_VENDOR=OpenBLAS build with pip is not enabling OpenBlas HOT 3
- how to use mixtral-8x7b-v0.1🤗 [Question]: HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from serge.