llm-rp's Introduction

Upgraded project here ==> ImpAI

The project is not deprecated but i just recode all the app in a new repository !

✨ Your Custom Offline Role Play with AI on Mac and Linux (for now) 🧙‍♂️

📎 Requirement

For now, Mac & Linux:

Python >= 3.8
pip install -r requirements.txt && python3 -m spacy download en_core_web_sm
Install git lfs

🛠️ Config

You can custom global variables at the top of app/run.py as you want.

For increase performance, you can reduce the generated images size, the number of iterations etc...

🖍️ Note: the output images folder is in app/images/

👉🏻 Start

Each time you want to run the game:

python3 app/run.py

The first time you load the app you will wait a while, because the program will download, export and quantize the better llama model for your config and install stable diffusion.

Next open your browser at http://127.0.0.1:4242

Click on the 🗑️ for reset le Role Play

You can customize the prompt here: prompts/RolePlay.txt

📝 Todo

💾 Create a persistent role play (with save system)
🖼️ Adding Quantized Stable Diffusion
🛠️ Compile for GPU Linux / GPU Windows
🎤 Adding whisper.cpp
🔉 Adding Bark or an other Text-Prompted Generative Audio Model
🔥 Doing a better interface
🔒 Lock user input when model generating response

🔎 Resources

llm-rp's People

Contributors

Stargazers

Watchers

llm-rp's Issues

a few errors after trying to run the app

Hi, i'm getting a few errors while trying to get the app to work, installing openssl and pytorch didn't help, i followed the readme, what do I do? (Mac m2, Macos Sonoma beta 7)
/Users/sasia/Library/Python/3.9/lib/python/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2.0 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020 warnings.warn( Traceback (most recent call last): File "/Users/sasia/llm-rp/app/run.py", line 47, in <module> dpm = DPMSolverMultistepScheduler.from_pretrained(SD_MODEL, subfolder="scheduler") File "/Users/sasia/Library/Python/3.9/lib/python/site-packages/diffusers/utils/dummy_pt_objects.py", line 645, in from_pretrained requires_backends(cls, ["torch"]) File "/Users/sasia/Library/Python/3.9/lib/python/site-packages/diffusers/utils/import_utils.py", line 540, in requires_backends raise ImportError("".join(failed)) ImportError: DPMSolverMultistepScheduler requires the PyTorch library but it was not found in your environment. Checkout the instructions on the installation page: https://pytorch.org/get-started/locally/ and follow the ones that match your environment.

rbourgeat / llm-rp Goto Github PK