Comments (9)
With another model
can you try running with conda or using pipenv once just want to find out whether issue is with docker or not
i've just tried with conda, the models are showing but the error for each one is the following (paste just one of them but is the same ) :
[ 'bin/main', '-i', '--seed', '888777', '-ins', '-t', '4', '-b', '256', '--top_k', '1000', '--top_p', '0.95', '--repeat_last_n', '64', '--repeat_penalty', '1', '--temp', '0.2', '--n_predict', '200', '-m', 'models/ggml-model-q4_0.bin', '--interactive-first' ] ERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoR [
with another model the previous error disappears but in webui it remains stuck in loading. And the log fle is the following:
[
'bin/main',
'-i',
'--seed',
'888777',
'-ins',
'-t',
'4',
'-b',
'256',
'--top_k',
'1000',
'--top_p',
'0.95',
'--repeat_last_n',
'64',
'--repeat_penalty',
'1',
'--temp',
'0.2',
'--n_predict',
'200',
'-m',
'models/ggml-model-q4_0.bin',
'--interactive-first'
]
Working... ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
That "Working" complete in 0 sec seems suspicious.
from alpaca-turbo.
what command you used to run alpaca turbo using Docker
from alpaca-turbo.
docker-compose up
from alpaca-turbo.
send me the output of
can you get inside the container using
docker-compose exec alpaca /bin/bash
and show me the output of
ls /app/models/
from alpaca-turbo.
send me the output of
can you get inside the container using
docker-compose exec alpaca /bin/bash
and show me the output of
ls /app/models/
ls /app/models/
ggml-alpaca-7b-q4.bin ggml-model-q4_0.bin ggml-model-q4_1.bin
from alpaca-turbo.
can you try running with conda or using pipenv once just want to find out whether issue is with docker or not
from alpaca-turbo.
can you try running with conda or using pipenv once just want to find out whether issue is with docker or not
i've just tried with conda, the models are showing but the error for each one is the following (paste just one of them but is the same ) :
[
'bin/main',
'-i',
'--seed',
'888777',
'-ins',
'-t',
'4',
'-b',
'256',
'--top_k',
'1000',
'--top_p',
'0.95',
'--repeat_last_n',
'64',
'--repeat_penalty',
'1',
'--temp',
'0.2',
'--n_predict',
'200',
'-m',
'models/ggml-model-q4_0.bin',
'--interactive-first'
]
ERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoRERRoR
[
from alpaca-turbo.
Same issue, the model sits inside docker container but the webui is not showing it
from alpaca-turbo.
I had the same issue.
For me the problem was I was running Docker on my server (network machine).
The way I got it working is by getting the source code and editing it and then rebuilding.
Load the ui folder into your code editor.
Go to src/app/environments/environment.prod.ts and change the https site to http://(network machine ip):5000
Then go to angular.json find and change the config as bellow:
"configurations": {
"production": {
"fileReplacements": [
{
"replace": "src/app/environments/environment.ts",
"with": "src/app/environments/environment.prod.ts"
}
],
"budgets": [
{
"type": "initial",
"maximumWarning": "500kb",
"maximumError": "1mb"
},
{
"type": "anyComponentStyle",
"maximumWarning": "2kb",
"maximumError": "4kb"
}
],
"outputHashing": "all"
},
Then
npm install
npm run build
Go into your docker folder where you have your project (alpaca-turbo folder), into templates , create a folder called whatever you like and move the contents of templates to it.
Then copy everything from /dist/angular-turbo where you built the angular ui to alpaca-turbo/templates .
Now you should see your .bin files
Edit:
Or even easier , you can do what this guy said
#39 (comment)
from alpaca-turbo.
Related Issues (20)
- Clarify Open Source License HOT 1
- Support reverse prompting (-r flag in llama.cpp) HOT 1
- Your instructions are completely wrong HOT 2
- How to load leaked LLaMA weights? HOT 1
- Can you add some more how to setup with like Portainer or in proxmox HOT 1
- alpaca_turbo.py typo on line 224 directoryh HOT 2
- Alpaca Install EXE detected as a trojan HOT 3
- Wrong port in docker-compose.yml file HOT 1
- alpaca_turbo.exe got virus when download and scan by antivirus HOT 1
- TemplateNotFound jinja2.exceptions.TemplateNotFound: index.html HOT 1
- Error Loading model HOT 3
- Copied the release Alpaca-Turbo-beta_v0.6 HOT 6
- Error using docker-compose HOT 4
- UI is weird in dark mode HOT 1
- Can't run in Hyper-V VM
- jinja2.exceptions.TemplateNotFound: index.html
- [Errno 13] Permission denied: 'bin/mac' HOT 2
- Loading models issue?
- Is this an abandoned project ?
- “mac” can’t be opened because Apple cannot check it for malicious software.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alpaca-turbo.