Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models. Supports Transformers, AWQ, GPTQ, llama.cpp (GGUF), Llama models
License: GNU General Public License v3.0
I may be misunderstanding how to use it, am I supposed to just run text gen from the root or should there be something in the workspace. I'm not really sure what's going on.
This is the runpod container log:
2023-11-12T14:33:58.120484823Z
2023-11-12T14:33:58.120650403Z ==========
2023-11-12T14:33:58.120705223Z == CUDA ==
2023-11-12T14:33:58.120841251Z ==========
2023-11-12T14:33:58.124930389Z
2023-11-12T14:33:58.124961969Z CUDA Version 12.1.1
2023-11-12T14:33:58.126921808Z
2023-11-12T14:33:58.126934818Z Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2023-11-12T14:33:58.128504057Z
2023-11-12T14:33:58.128511257Z This container image and its contents are governed by the NVIDIA Deep Learning Container License.
2023-11-12T14:33:58.128515067Z By pulling and using the container, you accept the terms and conditions of this license:
2023-11-12T14:33:58.128518887Z https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
2023-11-12T14:33:58.128522357Z
2023-11-12T14:33:58.128524967Z A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.
2023-11-12T14:33:58.141952208Z
2023-11-12T14:33:58.144042427Z Starting Nginx service...
2023-11-12T14:33:58.161578175Z * Starting nginx nginx
2023-11-12T14:33:58.172530437Z ...done.
2023-11-12T14:33:58.172997667Z Running pre-start script...
2023-11-12T14:33:58.174982735Z Container is running
2023-11-12T14:33:58.174994035Z Syncing venv to workspace, please wait...
I connected to the terminal and ran start.sh and it got stuck again, I pressed cntrl+c and then it seemed to continue, but the ports still are not used.
root@05433a96ca8b:/# ./start.sh
Starting Nginx service...
* Starting nginx nginx
Running pre-start script...
Container is running
Syncing venv to workspace, please wait...
^Crsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at rsync.c(713) [sender=3.2
rsync error: received SIGUSR1 (code 19) at main.c(1613) [generator=3.2.7]
Syncing Oobabooga Text Generation Web UI to workspace, please wait...
Fixing venv...
Starting Oobabooga Text Generation Web UI
Oobabooga Text Generation Web UI started
Log file: /workspace/logs/textgen.log
All services have been started
Pod Started
Setting up SSH...
* Starting OpenBSD Secure Shell server sshd
Starting Jupyter Lab...
Jupyter Lab started
Exporting environment variables...
Container is READY!
How do you update this RunPod template to the latest version of text-generation-webui by @oobabooga?
Running ./update_linux.sh encourages me to install conda by @conda:
/update_linux.sh: line 22: /workspace/text-generation-webui/installer_files/conda/etc/profile.d/conda.sh: No such file or directory
./update_linux.sh: line 23: conda: command not found
Conda is not installed. Exiting...
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.