trypromptly / llmstack Goto Github PK

View Code? Open in Web Editor NEW

1.1K 18.0 176.0 102.95 MB

No-code platform to build LLM Agents, workflows and applications with your data

Home Page: https://llmstack.trypromptly.com

License: Other

Python 58.65% HTML 0.13% JavaScript 34.70% CSS 6.47% Dockerfile 0.04% Shell 0.01%

ai generative-ai llm-chain llm-framework llmops llms no-code-ai platform agents ai-agents-framework

llmstack's People

Contributors

Stargazers

Watchers

Forkers

hbcbh1999 lulzzz mwarduni ai-chef bradymck guveni balu-varanasi cgwgpt meeweston vamseekm aruncivicscience haoyitedaniu barracadigital napon id-2 jaytoday send2cloud mrtrantuan eli-dot-ai chukwuemerie-ezieke hackerup shussle123 proteusiq moep90 marchdigital jeffrey-devhkg bruscode paixai krrishdholakia octag0no nshuklads zanedeng itsmemba13 imsoumyajitbag ego shubhusion rishigith jeffara chukowski orami01 clic-ethiopia stracerxx f901107 cluna80 cynicalwilson gozikong 5and2 hyperupscale rerm06 jplopes-consultoria gfcacace bigredcoder mexicanamerican xtreme-appz flucido scriptonics muharremokutan mike-cloud kumar045 hakunamatata1997 matr1xcode jaynivaan saridsa1 luehang yigecom leonai-do bmedi holding-1-at-a-time tonywhite11 touristshaun flowengaged silasdao gennadiyvorgy1 dapper-magician rayonx m0bstarx dr-data gtbrewster asherik sm-da offsideai maxfoxik777 one-detail-at-a-time-llc chinmaybhatk sycomix vizay08 fra-madeforprove bellyfat goer tuanzi1015 yuppie4 tdhooghe lokeshjonnakuti allwavemedia fai247 terrybarker synergy-aurora johngrigoryan cygwynd alumicsoftworks

llmstack's Issues

Issue with Docker compose.

Describe the bug
The playwright and api images both crash on running the ./run-llmstack.sh. Below are the logs for both the images.

To Reproduce
Steps to reproduce the behavior:

Run ./run-llmstack.sh

Logs for Playwright Docker

2023-10-23 19:17:12 node:internal/process/promises:288
2023-10-23 19:17:12 triggerUncaughtException(err, true /* fromPromise */);
2023-10-23 19:17:12 ^
2023-10-23 19:17:12
2023-10-23 19:17:12 Error: Executable doesn't exist at /ms-playwright/chromium-1084/chrome-linux/chrome
2023-10-23 19:17:12 ╔══════════════════════════════════════════════════════════════════════╗
2023-10-23 19:17:12 ║ Looks like Playwright Test or Playwright was just updated to 1.39.0. ║
2023-10-23 19:17:12 ║ Please update docker image as well. ║
2023-10-23 19:17:12 ║ - current: mcr.microsoft.com/playwright:v1.38.1-jammy ║
2023-10-23 19:17:12 ║ - required: mcr.microsoft.com/playwright:v1.39.0-jammy ║
2023-10-23 19:17:12 ║ ║
2023-10-23 19:17:12 ║ <3 Playwright Team ║
2023-10-23 19:17:12 ╚══════════════════════════════════════════════════════════════════════╝ Failed to launch browser.
2023-10-23 19:17:12 at executablePathOrDie (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/registry/index.js:357:15)
2023-10-23 19:17:12 at Object.executablePathOrDie (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/registry/index.js:370:43)
2023-10-23 19:17:12 at Chromium._launchProcess (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:166:39)
2023-10-23 19:17:12 at async Chromium._innerLaunch (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:103:9)
2023-10-23 19:17:12 at async Chromium._innerLaunchWithRetries (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:84:14)
2023-10-23 19:17:12 at async ProgressController.run (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/progress.js:92:22)
2023-10-23 19:17:12 at async Chromium.launch (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:61:21)
2023-10-23 19:17:12 at async BrowserServerLauncherImpl.launchServer (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/browserServerImpl.js:48:21)
2023-10-23 19:17:12 at async launchBrowserServer (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/cli/driver.js:86:18)
2023-10-23 19:17:12
2023-10-23 19:17:12 Node.js v18.17.1

Logs for API

2023-10-23 19:08:29 The above exception was the direct cause of the following exception:
2023-10-23 19:08:29
2023-10-23 19:08:29 Traceback (most recent call last):
2023-10-23 19:08:29 File "/code/manage.py", line 22, in
2023-10-23 19:08:29 main()
2023-10-23 19:08:29 File "/code/manage.py", line 18, in main
2023-10-23 19:08:29 execute_from_command_line(sys.argv)
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/init.py", line 442, in execute_from_command_line
2023-10-23 19:08:29 utility.execute()
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/init.py", line 436, in execute
2023-10-23 19:08:29 self.fetch_command(subcommand).run_from_argv(self.argv)
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/base.py", line 412, in run_from_argv
2023-10-23 19:08:29 self.execute(*args, **cmd_options)
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/base.py", line 458, in execute
2023-10-23 19:08:29 output = self.handle(*args, **options)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/base.py", line 106, in wrapper
2023-10-23 19:08:29 res = handle_func(*args, **kwargs)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/core/management/commands/migrate.py", line 117, in handle
2023-10-23 19:08:29 executor = MigrationExecutor(connection, self.migration_progress_callback)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/migrations/executor.py", line 18, in init
2023-10-23 19:08:29 self.loader = MigrationLoader(self.connection)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/migrations/loader.py", line 58, in init
2023-10-23 19:08:29 self.build_graph()
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/migrations/loader.py", line 235, in build_graph
2023-10-23 19:08:29 self.applied_migrations = recorder.applied_migrations()
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/migrations/recorder.py", line 81, in applied_migrations
2023-10-23 19:08:29 if self.has_table():
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/migrations/recorder.py", line 57, in has_table
2023-10-23 19:08:29 with self.connection.cursor() as cursor:
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/utils/asyncio.py", line 26, in inner
2023-10-23 19:08:29 return func(*args, **kwargs)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/base/base.py", line 330, in cursor
2023-10-23 19:08:29 return self._cursor()
2023-10-23 19:08:29 ^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/base/base.py", line 306, in _cursor
2023-10-23 19:08:29 self.ensure_connection()
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/utils/asyncio.py", line 26, in inner
2023-10-23 19:08:29 return func(*args, **kwargs)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/base/base.py", line 288, in ensure_connection
2023-10-23 19:08:29 with self.wrap_database_errors:
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/utils.py", line 91, in exit
2023-10-23 19:08:29 raise dj_exc_value.with_traceback(traceback) from exc_value
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/base/base.py", line 289, in ensure_connection
2023-10-23 19:08:29 self.connect()
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/utils/asyncio.py", line 26, in inner
2023-10-23 19:08:29 return func(*args, **kwargs)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/base/base.py", line 270, in connect
2023-10-23 19:08:29 self.connection = self.get_new_connection(conn_params)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/utils/asyncio.py", line 26, in inner
2023-10-23 19:08:29 return func(*args, **kwargs)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/django/db/backends/postgresql/base.py", line 275, in get_new_connection
2023-10-23 19:08:29 connection = self.Database.connect(**conn_params)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 File "/usr/local/lib/python3.11/site-packages/psycopg2/init.py", line 122, in connect
2023-10-23 19:08:29 conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
2023-10-23 19:08:29 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-10-23 19:08:29 django.db.utils.OperationalError: fe_sendauth: no password supplied

Version
Version of LLMStack this issue is seen in v0.0.17

Environment

macOS

Screenshots

Bind to 0.0.0.0:{port} - Spams terminal

Describe the bug
When binding LLMstack to 0.0.0.0:3000 there is an issue where whenever you run the server it keeps saying, "Waiting for LLMStack server to be up...". Even when it is up, and I can access it from another machine on the same network.

System check identified no issues (0 silenced).
November 02, 2023 - 18:47:39
Django version 4.2.1, using settings 'llmstack.server.settings'
Starting ASGI/Daphne version 4.0.0 development server at http://0:3000/
Quit the server with CONTROL-C.
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...

Expected result.
System check identified no issues (0 silenced).
November 02, 2023 - 18:47:39
Django version 4.2.1, using settings 'llmstack.server.settings'
Starting ASGI/Daphne version 4.0.0 development server at http://0:3000/
Quit the server with CONTROL-C.

To Reproduce
Steps to reproduce the behavior:
Edit the config file located at ~/.llmstack/config and change port = 3000 -> port = "0:3000"

And run:
┌─[user@fedora]─[~]
└──╼ $ llmstack

Expected behavior
The server starts up and does not continue outputting "Waiting for LLMStack server to be up...". This begins to fill up the screen.

Version
0.0.17?

Environment
Linux fedora 6.5.8-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Oct 20 2023 x86_64 GNU/Linux
pip 22.3.1 from /usr/lib/python3.11/site-packages/pip (python 3.11)

Screenshots

issue building docker compose image

Hi, I am facing issue in building the docker-compose command -
Also the docker-compose command is wrong on the documentation site - it should be
docker-compose -f docker-compose.dev.yml --env-file .env.dev up --build -d

Attaching the relevant error log here -

#0 32.23 Preparing to unpack .../00-systemd-sysv_252.12-1~deb12u1_amd64.deb ...
#0 32.24 Unpacking systemd-sysv (252.12-1~deb12u1) ...
#0 32.30 Selecting previously unselected package libdbus-1-3:amd64.
#0 32.30 Preparing to unpack .../01-libdbus-1-3_1.14.8-2~deb12u1_amd64.deb ...
#0 32.31 Unpacking libdbus-1-3:amd64 (1.14.8-2~deb12u1) ...
#0 32.37 Selecting previously unselected package dbus-bin.
#0 32.37 Preparing to unpack .../02-dbus-bin_1.14.8-2~deb12u1_amd64.deb ...
#0 32.38 Unpacking dbus-bin (1.14.8-2~deb12u1) ...
#0 32.43 Selecting previously unselected package dbus-session-bus-common.
#0 32.43 Preparing to unpack .../03-dbus-session-bus-common_1.14.8-2~deb12u1_all.deb ...
#0 32.44 Unpacking dbus-session-bus-common (1.14.8-2~deb12u1) ...
#0 32.50 Selecting previously unselected package dbus-daemon.
#0 32.50 Preparing to unpack .../04-dbus-daemon_1.14.8-2~deb12u1_amd64.deb ...
#0 32.50 Unpacking dbus-daemon (1.14.8-2~deb12u1) ...
#0 32.58 Selecting previously unselected package dbus-system-bus-common.
#0 32.58 Preparing to unpack .../05-dbus-system-bus-common_1.14.8-2~deb12u1_all.deb ...
#0 32.59 Unpacking dbus-system-bus-common (1.14.8-2~deb12u1) ...
#0 32.68 Selecting previously unselected package dbus.
#0 32.68 Preparing to unpack .../06-dbus_1.14.8-2~deb12u1_amd64.deb ...
#0 32.68 Unpacking dbus (1.14.8-2~deb12u1) ...
#0 32.75 Selecting previously unselected package perl-modules-5.36.
#0 32.75 Preparing to unpack .../07-perl-modules-5.36_5.36.0-7_all.deb ...
#0 32.76 Unpacking perl-modules-5.36 (5.36.0-7) ...
#0 33.13 Selecting previously unselected package libgdbm-compat4:amd64.
#0 33.14 Preparing to unpack .../08-libgdbm-compat4_1.23-3_amd64.deb ...
#0 33.14 Unpacking libgdbm-compat4:amd64 (1.23-3) ...
#0 33.20 Selecting previously unselected package libperl5.36:amd64.
#0 33.20 Preparing to unpack .../09-libperl5.36_5.36.0-7_amd64.deb ...
#0 33.21 Unpacking libperl5.36:amd64 (5.36.0-7) ...
#0 33.63 Selecting previously unselected package perl.
#0 33.63 Preparing to unpack .../10-perl_5.36.0-7_amd64.deb ...
#0 33.65 Unpacking perl (5.36.0-7) ...
#0 33.72 Selecting previously unselected package libpython3.11-minimal:amd64.
#0 33.73 Preparing to unpack .../11-libpython3.11-minimal_3.11.2-6_amd64.deb ...
#0 33.73 Unpacking libpython3.11-minimal:amd64 (3.11.2-6) ...
#0 33.88 Selecting previously unselected package python3.11-minimal.
#0 33.88 Preparing to unpack .../12-python3.11-minimal_3.11.2-6_amd64.deb ...
#0 33.89 Unpacking python3.11-minimal (3.11.2-6) ...
#0 34.11 Setting up libpython3.11-minimal:amd64 (3.11.2-6) ...
#0 34.14 Setting up python3.11-minimal (3.11.2-6) ...
#0 34.28 [Errno 13] Permission denied: '/usr/lib/python3.11/__pycache__/__future__.cpython-311.pyc.139634352830512'dpkg: error processing package python3.11-minimal (--configure):
#0 34.28  installed python3.11-minimal package post-installation script subprocess returned error exit status 1
#0 34.30 Errors were encountered while processing:
#0 34.30  python3.11-minimal
#0 34.35 E: Sub-process /usr/bin/dpkg returned an error code (1)
------
failed to solve: executor failed running [/bin/sh -c apt-get update && apt-get install -y libpcre3     mime-support     ffmpeg     postgresql-client     gstreamer1.0-libav     libnss3-tools     libatk-bridge2.0-0     libcups2     libxkbcommon-x11-0     libxcomposite1     libxdamage1 && rm -rf /var/lib/apt/lists/*]: exit code: 100```

Add MySQL as an external datasource

We currently support SingleStore and a few others as external datasources. This issue is to support MySQL as a valid external datasource so users can connect, query and use data from MySQL.

https://docs.trypromptly.com/llmstack/add-external-datasource is related documentation to add a new external datasource.

LocalAI available models

Describe the bug
LLMStack always list one model, ggml-gpt4all-j, instead of allowing to choose from available models

To Reproduce

Go to Playground
Select LocalAI, Chat Completions
look models in Config Form section

Expected behavior
LLMStack should ask LocalAI for available models, using entrypoint /models/available

Version
v0.0.17

Environment
Ubuntu 22.04
pip install llmstack
LocalAI on another debian box with several models available (but not ggml-gpt4all-j)

[v0.0.7] LocalAI without TLD is not acessible

Describe the bug
Unable to add localAI to docker-compose and testing it since URL requires TLD

To Reproduce

Start the stack
Create example Website chatbot
Preview function and ask something

Expected behavior
LLMstack should be able to communicate with local local-ai like http://local-ai:8080

Version
v0.0.7

Environment
DISTRIB_DESCRIPTION="Linux Mint 21.2 Victoria"
Docker version 24.0.5, build ced0996
Docker Compose version v2.20.3

Screenshots

Additional context

lmstack-007-rqworker-1    |     return self.__get_result()
llmstack-007-rqworker-1    |            ^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
llmstack-007-rqworker-1    |     raise self._exception
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/asgiref/sync.py", line 306, in main_wrap
llmstack-007-rqworker-1    |     result = await self.awaitable(*args, **kwargs)
llmstack-007-rqworker-1    |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/code/common/utils/crawlers.py", line 75, in run_playwright
llmstack-007-rqworker-1    |     html_content = await page.content()
llmstack-007-rqworker-1    |                    ^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/async_api/_generated.py", line 9142, in content
llmstack-007-rqworker-1    |     return mapping.from_maybe_impl(await self._impl_obj.content())
llmstack-007-rqworker-1    |                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_page.py", line 462, in content
llmstack-007-rqworker-1    |     return await self._main_frame.content()
llmstack-007-rqworker-1    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_frame.py", line 415, in content
llmstack-007-rqworker-1    |     return await self._channel.send("content")
llmstack-007-rqworker-1    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 61, in send
llmstack-007-rqworker-1    |     return await self._connection.wrap_api_call(
llmstack-007-rqworker-1    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 482, in wrap_api_call
llmstack-007-rqworker-1    |     return await cb()
llmstack-007-rqworker-1    |            ^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/playwright/_impl/_connection.py", line 97, in inner_send
llmstack-007-rqworker-1    |     result = next(iter(done)).result()
llmstack-007-rqworker-1    |              ^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    | playwright._impl._api_types.Error: Unable to retrieve content because the page is navigating and changing the content.

Send program_name=promptly_datasource in connection attrs to singlestore

When connecting to Singlestore, we need to send program_name=promptly_datasource in the connection attributes for tracking purposes.

'openai' has no attribute 'ChatCompletion'

It is openai-1.1.1
Hello, help please
The installation went well, it's not the first time I've done it
I create a bot, the key is added openai
I check the dialog,
but the error during dialog in bot : 'openai' has no attribute 'ChatCompletion'

This is in the terminal :

ERROR
2023-11-16 09:54:11,626 actor Encountered <class 'AttributeError'> in
<class
'llmstack.play.actors.agent.Agent.AgentActor'>(urn:uuid:5e921f4f-e607-4e64-a148-ddd7baa962d6):
module 'openai' has no attribute 'ChatCompletion'

When testing Web bot and another

Thank you in advance

P.S. I do it in your web version and everything is fine.
I do the same on local version - error

Update documentation for processors

Documentation is served from https://github.com/trypromptly/LLMStack/tree/main/web/docs and we use Docusaurus. To run documentation locally, you can use npm start.

As part of this task, we want to document the input, config and output schemas for all the processors. Look at the existing documentation for processors from Promptly at https://github.com/trypromptly/LLMStack/blob/main/web/docs/processors/promptly.md

Following the example above, we want to update documentation for all the other processors in https://github.com/trypromptly/LLMStack/tree/main/web/docs/processors.

[v0.0.15] LLMstack NoneType error in Chatbot

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

CreateWebsite Chatbot from Template
Add Datasource of Company website
Check "use local ai if available"
Change using Model to gpt-3.5-turbo
Enter preview mode
Ask What is the VAT of Company? AI responds with

I'm sorry, but I don't have access to the current VAT rates of Company. However, you can check the official website or contact their customer support for more information.

Ask What is the VAT Number of Company? multiple times
see error llmstack.processors.providers.promptly.text_chat.TextChatOutput() argument after ** must be a mapping, not NoneType

Expected behavior
I expect LLMstack to scrape the website for a VAT Number and return it back

Version
V0.0.15

Environment
DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"
Docker version 24.0.5, build ced0996
Docker Compose version v2.20.3

Screenshots

Additional context

Local-AI: I use the .env option:
PRELOAD_MODELS=[{"url": "github:go-skynet/model-gallery/gpt4all-j.yaml", "name": "gpt-3.5-turbo"}, { "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}]

age=0.000 s; distance=16 kB, estimate=16 kB
local-ai.example.com        | [127.0.0.1]:38564  200  -  GET      /readyz
local-ai.example.com        | [127.0.0.1]:44518  200  -  GET      /readyz
llmstack-0015-api-1         | INFO 2023-09-26 05:37:13,575 coordinator Spawned actor InputActor (urn:uuid:c14a0071-7373-4e57-900b-bc847e0f3977) for coordinator urn:uuid:c9288903-25c1-4998-a08f-62832159e5e9
llmstack-0015-api-1         | INFO 2023-09-26 05:37:13,575 coordinator Spawned actor OutputActor (urn:uuid:9227f669-8f57-4fca-8702-f038c7454268) for coordinator urn:uuid:c9288903-25c1-4998-a08f-62832159e5e9
llmstack-0015-api-1         | INFO 2023-09-26 05:37:13,576 coordinator Spawned actor TextChat (urn:uuid:cc6c9de3-878e-419b-9bd7-a4eafaf68268) for coordinator urn:uuid:c9288903-25c1-4998-a08f-62832159e5e9
llmstack-0015-api-1         | INFO 2023-09-26 05:37:13,576 coordinator Spawned actor BookKeepingActor (urn:uuid:b2f016da-e10b-483b-87ce-1ded941669d6) for coordinator urn:uuid:c9288903-25c1-4998-a08f-62832159e5e9
local-ai.example.com        | 5:37AM DBG Request received: 
local-ai.example.com        | 5:37AM DBG Configuration read: &{PredictionOptions:{Model:ggml-gpt4all-j.bin Language: N:0 TopP:0.7 TopK:80 Temperature:0.7 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-3.5-turbo F16:false Threads:10 Debug:true Roles:map[] Embeddings:false Backend:gpt4all-j TemplateConfig:{Chat:gpt4all-chat ChatMessage: Completion:gpt4all-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 MMap:false MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:1024 NUMA:false LoraAdapter: LoraBase: NoMulMatQ:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
local-ai.example.com        | 5:37AM DBG Parameters: &{PredictionOptions:{Model:ggml-gpt4all-j.bin Language: N:0 TopP:0.7 TopK:80 Temperature:0.7 Maxtokens:0 Echo:false Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 TypicalP:0 Seed:0 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:gpt-3.5-turbo F16:false Threads:10 Debug:true Roles:map[] Embeddings:false Backend:gpt4all-j TemplateConfig:{Chat:gpt4all-chat ChatMessage: Completion:gpt4all-completion Edit: Functions:} PromptStrings:[] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false NoActionFunctionName: NoActionDescriptionName:} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 MMap:false MMlock:false LowVRAM:false Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:1024 NUMA:false LoraAdapter: LoraBase: NoMulMatQ:false} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{PipelineType: SchedulerType: CUDA:false EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0}}
local-ai.example.com        | 5:37AM DBG Prompt (before templating): You are a helpful chat assistant
local-ai.example.com        | You are a chatbot that uses the provided context to answer the user's question.
local-ai.example.com        | If you cannot answer the question based on the provided context, say you don't know the answer.
local-ai.example.com        | No answer should go out of the provided input. If the provided input is empty, return saying you don't know the answer.
local-ai.example.com        | Keep the answers terse.
local-ai.example.com        | ----
local-ai.example.com        | context: 
local-ai.example.com        | What is the VAT of Company? 
local-ai.example.com        | I'm sorry, but I don't have access to the current VAT rates of Company. However, you can check the official website or contact their customer support for more information.
local-ai.example.com        | [172.23.0.8]:59670  200  -  POST     /chat/completions
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | 5:37AM DBG Stream request received
local-ai.example.com        | 5:37AM DBG Template found, input modified to: The prompt below is a question to answer, a task to complete, or a conversation to respond to; decide which and write an appropriate response.
local-ai.example.com        | ### Prompt:
local-ai.example.com        | You are a helpful chat assistant
local-ai.example.com        | You are a chatbot that uses the provided context to answer the user's question.
local-ai.example.com        | If you cannot answer the question based on the provided context, say you don't know the answer.
local-ai.example.com        | No answer should go out of the provided input. If the provided input is empty, return saying you don't know the answer.
local-ai.example.com        | Keep the answers terse.
local-ai.example.com        | ----
local-ai.example.com        | context: 
local-ai.example.com        | What is the VAT of Company? 
local-ai.example.com        | I'm sorry, but I don't have access to the current VAT rates of Company. However, you can check the official website or contact their customer support for more information.
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | ### Response:
local-ai.example.com        | 5:37AM DBG Prompt (after templating): The prompt below is a question to answer, a task to complete, or a conversation to respond to; decide which and write an appropriate response.
local-ai.example.com        | ### Prompt:
local-ai.example.com        | You are a helpful chat assistant
local-ai.example.com        | You are a chatbot that uses the provided context to answer the user's question.
local-ai.example.com        | If you cannot answer the question based on the provided context, say you don't know the answer.
local-ai.example.com        | No answer should go out of the provided input. If the provided input is empty, return saying you don't know the answer.
local-ai.example.com        | Keep the answers terse.
local-ai.example.com        | ----
local-ai.example.com        | context: 
local-ai.example.com        | What is the VAT of Company? 
local-ai.example.com        | I'm sorry, but I don't have access to the current VAT rates of Company. However, you can check the official website or contact their customer support for more information.
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | What is the VAT Number of Company? 
local-ai.example.com        | ### Response:
local-ai.example.com        | 5:37AM DBG Loading model gpt4all-j from ggml-gpt4all-j.bin
local-ai.example.com        | 5:37AM DBG Sending chunk: {"object":"chat.completion.chunk","model":"gpt-3.5-turbo","choices":[{"index":0,"delta":{"role":"assistant","content":""}}],"usage":{"prompt_tokens":0,"completion_tokens":0,"total_tokens":0}}
local-ai.example.com        | 5:37AM DBG Model already loaded in memory: ggml-gpt4all-j.bin
local-ai.example.com        | [127.0.0.1]:57536  200  -  GET      /readyz
llmstack-0015-api-1         | INFO 2023-09-26 05:37:42,059 output Error in output actor: {'_inputs1': 'llmstack.processors.providers.promptly.text_chat.TextChatOutput() argument after ** must be a mapping, not NoneType'}
llmstack-0015-api-1         | INFO 2023-09-26 05:37:42,067 coordinator Coordinator urn:uuid:c9288903-25c1-4998-a08f-62832159e5e9 stopping
llmstack-0015-api-1         | INFO 2023-09-26 05:37:42,069 bookkeeping Stopping BookKeepingActor
llmstack-0015-api-1         | sys:1: ResourceWarning: unclosed <socket.socket fd=29, family=2, type=1, proto=6, laddr=('172.23.0.8', 59670), raddr=('172.23.0.2', 8080)>
llmstack-0015-api-1         | ResourceWarning: Enable tracemalloc to get the object allocation traceback

Docker Compose

version: "3.8"

services:
  api:
    image: ${REGISTRY:-ghcr.io/trypromptly/}llmstack-api:latest
    build:
      context: .
      cache_from:
        - llmstack-api:latest
    command: apiserver
    links:
      - postgres:postgres
    expose:
      - 9000
    env_file:
      - .env
    cap_add:
      - SYS_PTRACE
    security_opt:
      - seccomp:unconfined
  rqworker:
    image: ${REGISTRY:-ghcr.io/trypromptly/}llmstack-api:latest
    build:
      context: .
      cache_from:
        - llmstack-rqworker:latest
    command: rqworker
    depends_on:
      - redis
      - postgres
    links:
      - redis:redis
      - postgres:postgres
    env_file:
      - .env
    security_opt:
      - seccomp:unconfined
  nginx:
    image: ${REGISTRY:-ghcr.io/trypromptly/}llmstack-nginx:latest
    build:
      context: nginx
      dockerfile: Dockerfile
      cache_from:
        - llmstack-nginx:latest
      args:
        - REGISTRY=${REGISTRY:-ghcr.io/trypromptly/}
    ports:
      - ${LLMSTACK_PORT:-3000}:80
    env_file:
      - .env
    depends_on:
      - api
  playwright:
    image: ${REGISTRY:-ghcr.io/trypromptly/}llmstack-playwright:latest
    build:
      context: playwright
      dockerfile: Dockerfile
      cache_from:
        - llmstack-playwright:latest
    command: npx --yes playwright launch-server --browser chromium --config /config.json
    expose:
      - 30000
    ipc: host
    user: pwuser
    security_opt:
      - seccomp:playwright/seccomp_profile.json
  redis:
    image: redis:alpine
    command: redis-server
    restart: unless-stopped
    volumes:
      - ${REDIS_VOLUME}:/data
    env_file:
      - .env
  postgres:
    image: postgres:15.1-alpine
    command: "postgres -c fsync=off -c full_page_writes=off -c synchronous_commit=OFF"
    restart: unless-stopped
    volumes:
      - ${POSTGRES_VOLUME}:/var/lib/postgresql/data/pgdata
    environment:
      POSTGRES_HOST_AUTH_METHOD: "password"
      PGDATA: /var/lib/postgresql/data/pgdata
      POSTGRES_USER: ${DATABASE_USERNAME:-llmstack}
      POSTGRES_PASSWORD: ${DATABASE_PASSWORD:-llmstack}
    env_file:
      - .env
  weaviate:
    image: semitechnologies/weaviate:1.20.5
    volumes:
      - ${WEAVIATE_VOLUME}:/var/lib/weaviate
    environment:
      QUERY_DEFAULTS_LIMIT: 20
      AUTHENTICATION_ANONYMOUS_ACCESS_ENABLED: "true"
      PERSISTENCE_DATA_PATH: "/var/lib/weaviate"
      DEFAULT_VECTORIZER_MODULE: text2vec-openai
      ENABLE_MODULES: text2vec-openai
      CLUSTER_HOSTNAME: "weaviate-node"
    env_file:
      - .env
  local-api:
    image: quay.io/go-skynet/local-ai:v1.25.0
    container_name: local-ai.example.com
    ports:
      - 8080
    env_file:
      - .env
    environment:
      - DEBUG=true
      - MODELS_PATH=/models
      - THREADS=10
      - CONTEXT_SIZE=1024
    volumes:
      - ./models:/models:cached
    command: ["/usr/bin/local-ai"]

.env file

# Change the secrets below before running LLMStack
SECRET_KEY='3!4^11rgx0-53)!n#18(1_^)&pj-3n^Afpc#mbm(+!fj4r$rp7ea!s'
CIPHER_KEY_SALT=salt
DATABASE_PASSWORD=llmstack

# Update the location of the persistent volumes to non-temporary locations
POSTGRES_VOLUME=./data/postgres_llmstack
REDIS_VOLUME=./data/redis_llmstack
WEAVIATE_VOLUME=./data/weaviate_llmstack

# LLMStack port
LLMSTACK_PORT=3000

# Platform default keys (optional)
DEFAULT_OPENAI_API_KEY=
DEFAULT_DREAMSTUDIO_API_KEY=
DEFAULT_AZURE_OPENAI_API_KEY=
DEFAULT_COHERE_API_KEY=
DEFAULT_FOREFRONTAI_API_KEY=
DEFAULT_ELEVENLABS_APiI_KEY=

OPENBLAS_NUM_THREADS=39
ALLOWED_HOSTS="127.0.0.1,localhost,x.x.x.x"
CSRF_TRUSTED_ORIGINS="http://x.x.x.x:3000"
LOG_LEVEL=INFO

PRELOAD_MODELS=[{"url": "github:go-skynet/model-gallery/gpt4all-j.yaml", "name": "gpt-3.5-turbo"}, { "url": "github:go-skynet/model-gallery/bert-embeddings.yaml", "name": "text-embedding-ada-002"}

[v0.0.7] LocalAI - Please add Datasource ability

Is your feature request related to a problem? Please describe.
The "Applet" text-chat processor of promtly has the ability to use a Datasource (website, files etc.). However the LocalAI Processor does not. Is this currently possible or does this need to be implemented?
If last, please update the localAI Processor documentation.

Describe the solution you'd like
I'd like to have equal behavior between all backends. With LocalAI my company is able to run everything localy (besides websites we want to scrape).

API Example page in broken for new applications

Describe the bug
A clear and concise description of what the bug is.
API code snippet does not add new fields or updated fields. Looks like a possible regression.

Expected behavior
API code snippet should show input and input examples.

Version
Latest main

Add base url to chatgpt configuration

For people who are using OpenAI compatible APIs for local LLMs, being able to change the baseurl and add custom model names for the ChatGpt integration opens up a lot of flexibility.

The big issue right now is that Agent's don't allow "local llm" options.

I would love to use this tool, but it's lacking some key features right now.

Proper Docker compose file needed for selfhosting :-))

Dev Please provide docker compose file with necessary comments and instructions and maybe short video guide which can help in selfhosting without errors and issues. It will reduce your workload too as containerized things are bound to run perfect if build with proper packages and testings :-))
Thankyou

Postgres is unavailable

Can’t start always get Postgres no response then sleeping the unavailable.

Bug on launch

I get huge error trying to launch llmstack on Windows 10 22H2 WSL2 Ubuntu 22.04 I thnik bug was introduced in 0.0.18 because after
pip install llmstack==0.0.17 app works OK

dima@DimaPc:~$ llmstack ERROR 2023-11-11 13:15:52,992 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/openai/audio_transcription.py", line 10, in <module> from llmstack.common.utils.utils import validate_parse_data_uri File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:52,993 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/openai/audio_translations.py", line 9, in <module> from llmstack.common.utils.utils import validate_parse_data_uri File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,005 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/openai/images_edit.py", line 11, in <module> from llmstack.common.utils.utils import get_key_or_raise, validate_parse_data_uri File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,007 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/openai/images_variations.py", line 11, in <module> from llmstack.common.utils.utils import get_key_or_raise, validate_parse_data_uri File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,041 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/promptly/data_uri_text_extract.py", line 13, in <module> from llmstack.common.utils.text_extract import extract_text_from_b64_json, ExtraParams File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/text_extract.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,044 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/promptly/datasource_search.py", line 13, in <module> from llmstack.datasources.types import DataSourceTypeFactory File "/home/dima/.local/lib/python3.10/site-packages/llmstack/datasources/types.py", line 4, in <module> from .handlers.datasource_processor import DataSourceProcessor File "/home/dima/.local/lib/python3.10/site-packages/llmstack/datasources/handlers/datasource_processor.py", line 15, in <module> from llmstack.common.blocks.embeddings.openai_embedding import EmbeddingAPIProvider File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/blocks/embeddings/openai_embedding.py", line 22, in <module> from llmstack.common.utils.utils import retrier File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,050 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/promptly/http_uri_text_extract.py", line 11, in <module> from llmstack.common.utils.text_extract import extract_text_from_url, ExtraParams File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/text_extract.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,052 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/promptly/text_chat.py", line 15, in <module> from llmstack.datasources.types import DataSourceTypeFactory File "/home/dima/.local/lib/python3.10/site-packages/llmstack/datasources/types.py", line 4, in <module> from .handlers.datasource_processor import DataSourceProcessor File "/home/dima/.local/lib/python3.10/site-packages/llmstack/datasources/handlers/datasource_processor.py", line 15, in <module> from llmstack.common.blocks.embeddings.openai_embedding import EmbeddingAPIProvider File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/blocks/embeddings/openai_embedding.py", line 22, in <module> from llmstack.common.utils.utils import retrier File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,077 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/stabilityai/image_to_image.py", line 14, in <module> from llmstack.common.utils.utils import get_key_or_raise File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:15:53,078 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/processors/providers/stabilityai/text_to_image.py", line 17, in <module> from llmstack.common.utils.utils import get_key_or_raise File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' /home/dima/.local/lib/python3.10/site-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.__call__' was never awaited sync_to_async(add_missing_app_types)() RuntimeWarning: Enable tracemalloc to get the object allocation traceback Traceback (most recent call last): File "/home/dima/.local/bin/llmstack", line 8, in <module> sys.exit(main()) File "/home/dima/.local/lib/python3.10/site-packages/llmstack/cli.py", line 211, in main run_django_command(['manage.py', 'migrate', '--noinput']) File "/home/dima/.local/lib/python3.10/site-packages/llmstack/cli.py", line 16, in run_django_command execute_from_command_line(command) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line utility.execute() File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/__init__.py", line 436, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/base.py", line 412, in run_from_argv self.execute(*args, **cmd_options) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/base.py", line 458, in execute output = self.handle(*args, **options) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/base.py", line 106, in wrapper res = handle_func(*args, **kwargs) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/commands/migrate.py", line 100, in handle self.check(databases=[database]) File "/home/dima/.local/lib/python3.10/site-packages/django/core/management/base.py", line 485, in check all_issues = checks.run_checks( File "/home/dima/.local/lib/python3.10/site-packages/django/core/checks/registry.py", line 88, in run_checks new_errors = check(app_configs=app_configs, databases=databases) File "/home/dima/.local/lib/python3.10/site-packages/django/core/checks/urls.py", line 14, in check_url_config return check_resolver(resolver) File "/home/dima/.local/lib/python3.10/site-packages/django/core/checks/urls.py", line 24, in check_resolver return check_method() File "/home/dima/.local/lib/python3.10/site-packages/django/urls/resolvers.py", line 494, in check for pattern in self.url_patterns: File "/home/dima/.local/lib/python3.10/site-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/home/dima/.local/lib/python3.10/site-packages/django/urls/resolvers.py", line 715, in url_patterns patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module) File "/home/dima/.local/lib/python3.10/site-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/home/dima/.local/lib/python3.10/site-packages/django/urls/resolvers.py", line 708, in urlconf_module return import_module(self.urlconf_name) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/server/urls.py", line 8, in <module> path('', include('llmstack.apps.urls')), File "/home/dima/.local/lib/python3.10/site-packages/django/urls/conf.py", line 38, in include urlconf_module = import_module(urlconf_module) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/urls.py", line 3, in <module> from . import apis File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/apis.py", line 32, in <module> from .serializers import AppDataSerializer, AppHubSerializer File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/serializers.py", line 14, in <module> from llmstack.apps.app_templates import AppTemplateFactory File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/app_templates.py", line 3, in <module> from .templates.ai_augmented_search import AIAugmentedSearchTemplate File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/templates/ai_augmented_search.py", line 6, in <module> from .app_template_interface import AppTemplateInterface File "/home/dima/.local/lib/python3.10/site-packages/llmstack/apps/templates/app_template_interface.py", line 4, in <module> from llmstack.common.utils.utils import get_ui_schema_from_jsonschema File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/home/dima/.local/lib/python3.10/site-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/home/dima/.local/lib/python3.10/site-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' dima@DimaPc:~$ sudo llmstack ERROR 2023-11-11 13:16:03,028 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/openai/audio_transcription.py", line 10, in <module> from llmstack.common.utils.utils import validate_parse_data_uri File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,029 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/openai/audio_translations.py", line 9, in <module> from llmstack.common.utils.utils import validate_parse_data_uri File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,041 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/openai/images_edit.py", line 11, in <module> from llmstack.common.utils.utils import get_key_or_raise, validate_parse_data_uri File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,044 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/openai/images_variations.py", line 11, in <module> from llmstack.common.utils.utils import get_key_or_raise, validate_parse_data_uri File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,073 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/promptly/data_uri_text_extract.py", line 13, in <module> from llmstack.common.utils.text_extract import extract_text_from_b64_json, ExtraParams File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/text_extract.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,074 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/promptly/datasource_search.py", line 13, in <module> from llmstack.datasources.types import DataSourceTypeFactory File "/usr/local/lib/python3.10/dist-packages/llmstack/datasources/types.py", line 4, in <module> from .handlers.datasource_processor import DataSourceProcessor File "/usr/local/lib/python3.10/dist-packages/llmstack/datasources/handlers/datasource_processor.py", line 15, in <module> from llmstack.common.blocks.embeddings.openai_embedding import EmbeddingAPIProvider File "/usr/local/lib/python3.10/dist-packages/llmstack/common/blocks/embeddings/openai_embedding.py", line 22, in <module> from llmstack.common.utils.utils import retrier File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,080 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/promptly/http_uri_text_extract.py", line 11, in <module> from llmstack.common.utils.text_extract import extract_text_from_url, ExtraParams File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/text_extract.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,081 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/promptly/text_chat.py", line 15, in <module> from llmstack.datasources.types import DataSourceTypeFactory File "/usr/local/lib/python3.10/dist-packages/llmstack/datasources/types.py", line 4, in <module> from .handlers.datasource_processor import DataSourceProcessor File "/usr/local/lib/python3.10/dist-packages/llmstack/datasources/handlers/datasource_processor.py", line 15, in <module> from llmstack.common.blocks.embeddings.openai_embedding import EmbeddingAPIProvider File "/usr/local/lib/python3.10/dist-packages/llmstack/common/blocks/embeddings/openai_embedding.py", line 22, in <module> from llmstack.common.utils.utils import retrier File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,100 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/stabilityai/image_to_image.py", line 14, in <module> from llmstack.common.utils.utils import get_key_or_raise File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' ERROR 2023-11-11 13:16:03,101 module_loader No module named 'docx.text.hyperlink' Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/module_loader.py", line 23, in get_all_sub_classes class_module = importlib.import_module( File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/processors/providers/stabilityai/text_to_image.py", line 17, in <module> from llmstack.common.utils.utils import get_key_or_raise File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink' /usr/local/lib/python3.10/dist-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.__call__' was never awaited sync_to_async(add_missing_app_types)() RuntimeWarning: Enable tracemalloc to get the object allocation traceback Traceback (most recent call last): File "/usr/local/bin/llmstack", line 8, in <module> sys.exit(main()) File "/usr/local/lib/python3.10/dist-packages/llmstack/cli.py", line 211, in main run_django_command(['manage.py', 'migrate', '--noinput']) File "/usr/local/lib/python3.10/dist-packages/llmstack/cli.py", line 16, in run_django_command execute_from_command_line(command) File "/usr/local/lib/python3.10/dist-packages/django/core/management/__init__.py", line 442, in execute_from_command_line utility.execute() File "/usr/local/lib/python3.10/dist-packages/django/core/management/__init__.py", line 436, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/local/lib/python3.10/dist-packages/django/core/management/base.py", line 412, in run_from_argv self.execute(*args, **cmd_options) File "/usr/local/lib/python3.10/dist-packages/django/core/management/base.py", line 458, in execute output = self.handle(*args, **options) File "/usr/local/lib/python3.10/dist-packages/django/core/management/base.py", line 106, in wrapper res = handle_func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/django/core/management/commands/migrate.py", line 100, in handle self.check(databases=[database]) File "/usr/local/lib/python3.10/dist-packages/django/core/management/base.py", line 485, in check all_issues = checks.run_checks( File "/usr/local/lib/python3.10/dist-packages/django/core/checks/registry.py", line 88, in run_checks new_errors = check(app_configs=app_configs, databases=databases) File "/usr/local/lib/python3.10/dist-packages/django/core/checks/urls.py", line 14, in check_url_config return check_resolver(resolver) File "/usr/local/lib/python3.10/dist-packages/django/core/checks/urls.py", line 24, in check_resolver return check_method() File "/usr/local/lib/python3.10/dist-packages/django/urls/resolvers.py", line 494, in check for pattern in self.url_patterns: File "/usr/local/lib/python3.10/dist-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/local/lib/python3.10/dist-packages/django/urls/resolvers.py", line 715, in url_patterns patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module) File "/usr/local/lib/python3.10/dist-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/local/lib/python3.10/dist-packages/django/urls/resolvers.py", line 708, in urlconf_module return import_module(self.urlconf_name) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/server/urls.py", line 8, in <module> path('', include('llmstack.apps.urls')), File "/usr/local/lib/python3.10/dist-packages/django/urls/conf.py", line 38, in include urlconf_module = import_module(urlconf_module) File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/urls.py", line 3, in <module> from . import apis File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/apis.py", line 32, in <module> from .serializers import AppDataSerializer, AppHubSerializer File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/serializers.py", line 14, in <module> from llmstack.apps.app_templates import AppTemplateFactory File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/app_templates.py", line 3, in <module> from .templates.ai_augmented_search import AIAugmentedSearchTemplate File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/templates/ai_augmented_search.py", line 6, in <module> from .app_template_interface import AppTemplateInterface File "/usr/local/lib/python3.10/dist-packages/llmstack/apps/templates/app_template_interface.py", line 4, in <module> from llmstack.common.utils.utils import get_ui_schema_from_jsonschema File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/utils.py", line 16, in <module> from llmstack.common.utils.crawlers import run_sitemap_spider_in_process, run_url_spider_in_process File "/usr/local/lib/python3.10/dist-packages/llmstack/common/utils/crawlers.py", line 13, in <module> from unstructured.partition.auto import partition_html File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/auto.py", line 37, in <module> from unstructured.partition.doc import partition_doc File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/doc.py", line 14, in <module> from unstructured.partition.docx import partition_docx File "/usr/local/lib/python3.10/dist-packages/unstructured/partition/docx.py", line 32, in <module> from docx.text.hyperlink import Hyperlink ModuleNotFoundError: No module named 'docx.text.hyperlink'

Docker builds of rqworker seem to be broken - "/code/client/build/index.html": not found

 => CACHED [stage-1  5/25] COPY --from=builder /code/base /code/base                                                                                      0.0s
 => ERROR [stage-1  6/25] COPY --from=builder /code/client/build/index.html /code/client/build/index.html                                                 0.0s
 => ERROR [stage-1  7/25] COPY --from=builder /code/client/build/static /code/client/build/static                                                         0.0s
------
 > [stage-1  6/25] COPY --from=builder /code/client/build/index.html /code/client/build/index.html:
------
------
 > [stage-1  7/25] COPY --from=builder /code/client/build/static /code/client/build/static:
------
Dockerfile:44
--------------------
  42 |     COPY --from=builder /code/apps /code/apps
  43 |     COPY --from=builder /code/base /code/base
  44 | >>> COPY --from=builder /code/client/build/index.html /code/client/build/index.html
  45 |     COPY --from=builder /code/client/build/static /code/client/build/static
  46 |     COPY --from=builder /code/common /code/common
--------------------
ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref 33801faa-b994-4824-b268-31d19f79fcba::v47uk74k2gxiekr8yk2ky0whl: "/code/client/build/index.html": not found
ERROR: Service 'llmstack-rqworker' failed to build : Build failed

huge Error

          When running llmstack command it opens to http://localhost:3000/. i log in but when i click anything in the IU it makes me log in again.

I Also get this error and some errors when running llmstack

(llmstack) grandview@andrewbees:~/Documents/LLMstack/LLMStack$ llmstack
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
Operations to perform:
Apply all migrations: account, admin, apiabstractor, apps, auth, authtoken, base, contenttypes, datasources, django_rq, flags, jobs, organizations, sessions, sites, socialaccount
Running migrations:
No migrations to apply.
Your models in app(s): 'organizations', 'socialaccount' have changes that are not yet reflected in a migration, and so won't be applied.
Run 'manage.py makemigrations' to make new migrations, and then re-run 'manage.py migrate' to apply them.
Installed 38 object(s) from 1 fixture(s)
Cache cleared successfully.
[llmstack-runner] Starting LLMStack Runner
Starting LLMStack rqworker
Exception in thread Thread-1 (start_runner):
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connectionpool.py", line 703, in urlopen
Waiting for LLMStack server to be up...
httplib_response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connectionpool.py", line 398, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connection.py", line 239, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1286, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1332, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1281, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1041, in _send_output
self.send(msg)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 979, in send
self.connect()
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
PermissionError: [Errno 13] Permission denied

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connectionpool.py", line 787, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/util/retry.py", line 550, in increment
raise six.reraise(type(error), error, _stacktrace)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/packages/six.py", line 769, in reraise
raise value.with_traceback(tb)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connectionpool.py", line 703, in urlopen
httplib_response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connectionpool.py", line 398, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/urllib3/connection.py", line 239, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1286, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1332, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1281, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 1041, in _send_output
self.send(msg)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/http/client.py", line 979, in send
self.connect()
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/api/client.py", line 214, in _retrieve_server_version
return self.version(api_version=False)["ApiVersion"]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/api/daemon.py", line 181, in version
return self._result(self._get(url), json=True)
^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/api/client.py", line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/requests/adapters.py", line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/cli.py", line 113, in start_runner
client = docker.from_env()
^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/client.py", line 96, in from_env
return cls(
^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/client.py", line 45, in init
self.api = APIClient(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/api/client.py", line 197, in init
self._version = self._retrieve_server_version()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/docker/api/client.py", line 221, in _retrieve_server_version
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', PermissionError(13, 'Permission denied'))
Starting LLMStack
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
:774: ResourceWarning: unclosed <socket.socket fd=9, family=1, type=1, proto=0>
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
Waiting for LLMStack server to be up...
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
Starting LLMStack
Error 111 connecting to localhost:50379. Connection refused.
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work
warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning)
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apps.py:44: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
Performing system checks...

Waiting for LLMStack server to be up...
System check identified no issues (0 silenced).
December 19, 2023 - 20:49:34
Django version 4.2.1, using settings 'llmstack.server.settings'
Starting ASGI/Daphne version 4.0.0 development server at http://127.0.0.1:3000/
Quit the server with CONTROL-C.
/home/grandview/anaconda3/envs/llmstack/lib/python3.11/subprocess.py:1127: ResourceWarning: subprocess 82499 is still running
_warn("subprocess %s is still running" % self.pid,
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Opening in existing browser session.
ERROR 2023-12-19 20:49:35,678 apis DefaultProfile matching query does not exist.
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/base/apis.py", line 39, in get_flags
flag_values[flag_name] = flag.check_state(request=request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/flags/sources.py", line 53, in check_state
checked_conditions = [(c, c.check(**kwargs)) for c in self.conditions]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/flags/sources.py", line 53, in
checked_conditions = [(c, c.check(**kwargs)) for c in self.conditions]
^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/flags/sources.py", line 27, in check
return self.fn(self.value, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/base/flags.py", line 68, in is_pro_subscriber
profile = Profile.objects.get(user=request.user)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/query.py", line 637, in get
raise self.model.DoesNotExist(
llmstack.base.models.DefaultProfile.DoesNotExist: DefaultProfile matching query does not exist.
ERROR 2023-12-19 20:49:35,756 log Internal Server Error: /api/profiles/me
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 448, in call
ret = await asyncio.wait_for(future, timeout=None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/asyncio/tasks.py", line 442, in wait_for
return await fut
^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/current_thread_executor.py", line 22, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 490, in thread_handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
return view_func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/base/apis.py", line 25, in get
queryset = Profile.objects.get(user=request.user)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/query.py", line 637, in get
raise self.model.DoesNotExist(
llmstack.base.models.DefaultProfile.DoesNotExist: DefaultProfile matching query does not exist.
ERROR 2023-12-19 20:49:35,756 log Internal Server Error: /api/profiles/me
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 448, in call
ret = await asyncio.wait_for(future, timeout=None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/asyncio/tasks.py", line 442, in wait_for
return await fut
^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/current_thread_executor.py", line 22, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 490, in thread_handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
return view_func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/base/apis.py", line 25, in get
queryset = Profile.objects.get(user=request.user)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/query.py", line 637, in get
raise self.model.DoesNotExist(
llmstack.base.models.DefaultProfile.DoesNotExist: DefaultProfile matching query does not exist.
ERROR 2023-12-19 20:49:35,760 runserver HTTP GET /api/profiles/me 500 [0.07, 127.0.0.1:59518]
ERROR 2023-12-19 20:49:35,760 runserver HTTP GET /api/profiles/me 500 [0.07, 127.0.0.1:59518]
ERROR 2023-12-19 21:45:17,229 log Internal Server Error: /api/apps
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 448, in call
ret = await asyncio.wait_for(future, timeout=None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/asyncio/tasks.py", line 442, in wait_for
return await fut
^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/current_thread_executor.py", line 22, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 490, in thread_handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
return view_func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apis.py", line 520, in post
return DRFResponse(AppSerializer(instance=app).data, status=201)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 555, in data
ret = super().data
^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 253, in data
self._data = self.to_representation(self.instance)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 522, in to_representation
ret[field.field_name] = field.to_representation(attribute)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/fields.py", line 1838, in to_representation
return method(value)
^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/serializers.py", line 119, in get_logo
profile = Profile.objects.get(user=obj.owner)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/query.py", line 637, in get
raise self.model.DoesNotExist(
llmstack.base.models.DefaultProfile.DoesNotExist: DefaultProfile matching query does not exist.
ERROR 2023-12-19 21:45:17,229 log Internal Server Error: /api/apps
Traceback (most recent call last):
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 486, in thread_handler
raise exc_info[1]
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 448, in call
ret = await asyncio.wait_for(future, timeout=None)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/asyncio/tasks.py", line 442, in wait_for
return await fut
^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/current_thread_executor.py", line 22, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/asgiref/sync.py", line 490, in thread_handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
return view_func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/apis.py", line 520, in post
return DRFResponse(AppSerializer(instance=app).data, status=201)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 555, in data
ret = super().data
^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 253, in data
self._data = self.to_representation(self.instance)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/serializers.py", line 522, in to_representation
ret[field.field_name] = field.to_representation(attribute)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/rest_framework/fields.py", line 1838, in to_representation
return method(value)
^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/llmstack/apps/serializers.py", line 119, in get_logo
profile = Profile.objects.get(user=obj.owner)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/manager.py", line 87, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/grandview/anaconda3/envs/llmstack/lib/python3.11/site-packages/django/db/models/query.py", line 637, in get
raise self.model.DoesNotExist(
llmstack.base.models.DefaultProfile.DoesNotExist: DefaultProfile matching query does not exist.
ERROR 2023-12-19 21:45:17,233 runserver HTTP POST /api/apps 500 [0.32, 127.0.0.1:40276]
ERROR 2023-12-19 21:45:17,233 runserver HTTP POST /api/apps 500 [0.32, 127.0.0.1:40276]

Originally posted by @Andy1996247 in #71 (comment)

Allow providing --host and --port from cli when running llmstack

Right now llmstack uses host and port number from ~/.llmstack/config. We would like to override these values by providing --host and --port from cli when running llmstack.

llmstack options are all managed in a single file at cli.py and can use some refactoring as well.

When --host is provided, llmstack should start django server on the provided host.

Not able to install using pip

Describe the bug
After having tried for the past 24h... I give up. I'm not able to do a clean install of llmstack on neither Ubuntu, Debian or MacOS. Every time is try to start llmstack I get tons of errors.

To Reproduce

Spin up a new DO or Vultr instance of Ubuntu, Debian or a new fresh install of MacOS.
Log in as root (cause I got lazy from having tried so many times)
Run "apt update && apt upgrade -y"
Make sure python3, pip3, docker and "python-is-python3" are installed.
Run "mv /usr/lib/python3.xx/EXTERNALLY-MANAGED /usr/lib/python3.xx/EXTERNALLY-MANAGED.old"
Run "pip install llmstack"
Everything breaks.

Expected behavior
Llmstack installs using pip and takes care of dependencies as well as the setup of docker and runner-llmstack.

Version
Latest.

Environment
Ubuntu (20.04, 22.04 and 23.10), Debian (10x, 11x and 12x) and MacOS Sonona latest.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
root@vultr:~# llmstack
/usr/local/lib/python3.11/dist-packages/llmstack/apps/apps.py:47: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py:98: RuntimeWarning: Accessing the database during app initialization is discouraged. To fix this warning, avoid executing queries in AppConfig.ready() or when your app modules are imported.
warnings.warn(self.APPS_NOT_READY_WARNING_MSG, category=RuntimeWarning)
Operations to perform:
Apply all migrations: account, admin, apiabstractor, apps, auth, authtoken, base, contenttypes, datasources, django_rq, flags, jobs, organizations, sessions, sites, socialaccount
Running migrations:
No migrations to apply.
Your models in app(s): 'organizations', 'socialaccount' have changes that are not yet reflected in a migration, and so won't be applied.
Run 'manage.py makemigrations' to make new migrations, and then re-run 'manage.py migrate' to apply them.
Installed 39 object(s) from 1 fixture(s)
Cache cleared successfully.
[llmstack-runner] Starting LLMStack Runner
Starting LLMStack rqworker
Exception in thread Thread-1 (start_runner):
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/urllib3/connectionpool.py", line 715, in urlopen
httplib_response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
conn.request(method, url, **httplib_request_kw)
Waiting for LLMStack server to be up...
File "/usr/local/lib/python3.11/dist-packages/urllib3/connection.py", line 244, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/usr/lib/python3.11/http/client.py", line 1282, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1328, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1277, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1037, in _send_output
self.send(msg)
File "/usr/lib/python3.11/http/client.py", line 975, in send
self.connect()
File "/usr/local/lib/python3.11/dist-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
FileNotFoundError: [Errno 2] No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/urllib3/connectionpool.py", line 799, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/urllib3/util/retry.py", line 550, in increment
raise six.reraise(type(error), error, _stacktrace)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/urllib3/packages/six.py", line 769, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.11/dist-packages/urllib3/connectionpool.py", line 715, in urlopen
httplib_response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/local/lib/python3.11/dist-packages/urllib3/connection.py", line 244, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/usr/lib/python3.11/http/client.py", line 1282, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1328, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1277, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.11/http/client.py", line 1037, in _send_output
self.send(msg)
File "/usr/lib/python3.11/http/client.py", line 975, in send
self.connect()
File "/usr/local/lib/python3.11/dist-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/docker/api/client.py", line 214, in _retrieve_server_version
return self.version(api_version=False)["ApiVersion"]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/api/daemon.py", line 181, in version
return self._result(self._get(url), json=True)
^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/api/client.py", line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/requests/adapters.py", line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.11/dist-packages/llmstack/cli.py", line 153, in start_runner
client = docker.from_env()
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/client.py", line 96, in from_env
return cls(
^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/client.py", line 45, in init
self.api = APIClient(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/api/client.py", line 197, in init
self._version = self._retrieve_server_version()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/docker/api/client.py", line 221, in _retrieve_server_version
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
usage: llmstack [-h] [--host HOST] [--port PORT] {runserver,manage.py} ...
llmstack: error: unrecognized arguments: rqworker default --verbosity=0 --with-scheduler
Starting LLMStack
Waiting for LLMStack server to be up...
/usr/local/lib/python3.11/dist-packages/requests/structures.py:58: ResourceWarning: unclosed <socket.socket fd=11, family=1, type=1, proto=0>
return (casedkey for casedkey, mappedvalue in self._store.values())
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/usr/local/lib/python3.11/dist-packages/llmstack/apps/apps.py:47: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py:98: RuntimeWarning: Accessing the database during app initialization is discouraged. To fix this warning, avoid executing queries in AppConfig.ready() or when your app modules are imported.
warnings.warn(self.APPS_NOT_READY_WARNING_MSG, category=RuntimeWarning)
Starting LLMStack
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/usr/local/lib/python3.11/dist-packages/llmstack/apps/apps.py:47: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py:98: RuntimeWarning: Accessing the database during app initialization is discouraged. To fix this warning, avoid executing queries in AppConfig.ready() or when your app modules are imported.
warnings.warn(self.APPS_NOT_READY_WARNING_MSG, category=RuntimeWarning)
Performing system checks...

Waiting for LLMStack server to be up...
System check identified no issues (0 silenced).
March 04, 2024 - 15:53:46
Django version 5.0, using settings 'llmstack.server.settings'
Starting ASGI/Daphne version 4.1.0 development server at http://127.0.0.1:3010/
Quit the server with CONTROL-C.

CSRF error

I see CSRF error.

Where I can write CSRF_TRUSTED_ORIGINS ?

in network browser console on any request:

"CSRF Failed: Origin checking failed - https://gpt.************.site does not match any trusted origins.

Add support for Knowledge Graph

It seems like LLMStack is currently only support one type of stores: VectorStoreInterface.

Will you consider adding Knowledge Graph as another store type?

[v0.0.15] Unable to create app

Describe the bug
Since (I assume v0.0.13) I'm unable to create an app either from scratch nor from a quickstart template.

To Reproduce
Steps to reproduce the behavior:

unzip v0.0.13
docker-compse pull
docker-compose up -d
docker-compose logs -f
login admin and promptly
click on Website Chatbot or any other (only tested a few)
redirect to the login page
remove /login from url and are able to start with 6 again

Expected behavior
Ability to create a Website chatbot or else...

Version
V0.0.13 - v0.0.15

Environment
DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"
Docker version 24.0.5, build ced0996
Docker Compose version v2.20.3

Screenshots

Additional context

Tested with latest Chrome and Firefox (client)
cleared all cookies and site data
tried in incognito window

llmstack-0015-nginx-1       | x.x.x.x - - [25/Sep/2023:06:38:39 +0000] "GET /api/apps/templates/website-chatbot HTTP/1.1" 200 7072 "http://172.16.78.12:3000/apps/templates/website-chatbot" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36" "-"
llmstack-0015-nginx-1       | x.x.x.x - - [25/Sep/2023:06:38:40 +0000] "POST /api/apps HTTP/1.1" 403 111 "http://172.16.78.12:3000/apps/templates/website-chatbot" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36" "-"
llmstack-0015-nginx-1       | x.x.x.x - - [25/Sep/2023:06:38:41 +0000] "GET /login HTTP/1.1" 200 1811 "http://172.16.78.12:3000/apps/templates/website-chatbot" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36" "-"

As curl

$ curl 'http://x.x.x.x:3000/api/login' \
  -H 'Accept: */*' \
  -H 'Accept-Language: en,de;q=0.9,en-GB;q=0.8,en-GB-oxendict;q=0.7' \
  -H 'Connection: keep-alive' \
  -H 'Content-Type: application/json' \
  -H 'Cookie: csrftoken=NUDAse24YXkiiW8gQ23ZUaUwccIjyi80; sessionid=vz3oz6myx3ku4opntowuvenigoru42pc' \
  -H 'DNT: 1' \
  -H 'Origin: http://x.x.x.x:3000' \
  -H 'Referer: http://x.x.x.x:3000/login' \
  -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36' \
  -H 'X-CSRFToken: NUDAse24YXkiiW8gQ23ZUaUwccIjyi80' \
  --data-raw '{"username":"admin","password":"promptly"}' \
  --compressed \
  --insecure
{"detail":"Method \"GET\" not allowed."}

CSS for Website Chatbot

We have create Website Chatbot and want to change the background color. We have built from source and we are in development mode.

Thanks

Waiting for LLMStack to be ready...

Describe the bug
Following the instructions in the README, after executing run-llmstack.sh I see only:

Waiting for LLMStack to be ready...
Waiting for LLMStack to be ready...
Waiting for LLMStack to be ready...

I tried going to http://localhost:3000 but it shows "502 Bad Gateway". I've confirmed that no other processes are using port 3000.

To Reproduce
Steps to reproduce the behavior:

Go to 'https://github.com/trypromptly/LLMStack'
Under 'Getting Started', run ./run-llmstack.sh
Wait for it to pull containers and run them
See error

Expected behavior
To be able to access the application at http://localhost:3000

Version
Latest

Environment
macOS Ventura 13.4.1 (c) (22F770820d) on a MacBook Pro, 16-inch, 2021, 32Mb, M1 processor.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here. Consider including relevant log messages from docker compose logs

Just wanted to know how different this foss solution is from flowise and in what ways it is superior to that project

if possible highlight your foss solution main different features in comparison to flowise and other foss solution so that others can understand easily and can use for both or just one for specific cases
Thanks for the work Dev :-)

[v0.0.7] Unable to get started

Describe the bug
I encounterer several errors when starting the v.0.0.7 initially without changing anything besides the paths of my docker-compose volumes.

NOTE
I assume this might cause the issue. I ran this on a server VM which may or may not have all devices required for this tool to run.

To Reproduce

wget https://github.com/trypromptly/LLMStack/archive/refs/tags/v0.0.7.zip
unzip v0.0.7.zip
cd LLMStack-0.0.7/
cp .env.prod .env
./run-llmstack.sh

.env file

# Change the secrets below before running LLMStack
SECRET_KEY='3!4^11rgx0-53)!n#18(1_^)&pj-3n^Afpc#mbm(+!fj4r$rp7ea!s'
CIPHER_KEY_SALT=salt
DATABASE_PASSWORD=llmstack

# Update the location of the persistent volumes to non-temporary locations
POSTGRES_VOLUME=./data/postgres_llmstack
REDIS_VOLUME=./data/redis_llmstack
WEAVIATE_VOLUME=./data/weaviate_llmstack

# LLMStack port
LLMSTACK_PORT=3000

# Platform default keys (optional)
DEFAULT_OPENAI_API_KEY=
DEFAULT_DREAMSTUDIO_API_KEY=
DEFAULT_AZURE_OPENAI_API_KEY=
DEFAULT_COHERE_API_KEY=
DEFAULT_FOREFRONTAI_API_KEY=
DEFAULT_ELEVENLABS_APiI_KEY=

Expected behavior
LLM Stack should start without having errors.

Version
v0.0.7

Environment
PRETTY_NAME="Ubuntu 22.04.3 LTS"
Docker version 20.10.7, build f0df350
Docker Compose version v2.20.3

Screenshots

Additional context
I used ./data so I could easiely reset my setup with rm -rf ./data

I had to add OPENBLAS_NUM_THREADS=1 as I encountered

llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 1 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 2 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 3 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 4 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 5 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 6 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 7 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 8 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 9 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 10 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 11 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 12 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 13 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 14 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 15 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 16 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 17 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 18 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 19 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 20 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 21 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 22 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 23 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 24 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 25 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 26 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 27 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 28 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 29 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 30 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 31 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 32 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 33 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 34 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 35 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 36 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 37 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 38 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: pthread_create failed for thread 39 of 40: Operation not permitted
llmstack-007-rqworker-1    | OpenBLAS blas_thread_init: RLIMIT_NPROC -1 current, -1 max
llmstack-007-rqworker-1    | Traceback (most recent call last):
llmstack-007-rqworker-1    |   File "/code/manage.py", line 22, in <module>
llmstack-007-rqworker-1    |     main()
llmstack-007-rqworker-1    |   File "/code/manage.py", line 18, in main
llmstack-007-rqworker-1    |     execute_from_command_line(sys.argv)
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
llmstack-007-rqworker-1    |     utility.execute()
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/django/core/management/__init__.py", line 416, in execute
llmstack-007-rqworker-1    |     django.setup()
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/django/__init__.py", line 24, in setup
llmstack-007-rqworker-1    |     apps.populate(settings.INSTALLED_APPS)
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/django/apps/registry.py", line 91, in populate
llmstack-007-rqworker-1    |     app_config = AppConfig.create(entry)
llmstack-007-rqworker-1    |                  ^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/django/apps/config.py", line 111, in create
llmstack-007-rqworker-1    |     app_module = import_module(entry)
llmstack-007-rqworker-1    |                  ^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/importlib/__init__.py", line 126, in import_module
llmstack-007-rqworker-1    |     return _bootstrap._gcd_import(name[level:], package, level)
llmstack-007-rqworker-1    |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1126, in _find_and_load_unlocked
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap_external>", line 940, in exec_module
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
llmstack-007-rqworker-1    |   File "/code/processors/apps.py", line 7, in <module>
llmstack-007-rqworker-1    |     from .providers.api_processor_interface import ApiProcessorInterface
llmstack-007-rqworker-1    |   File "/code/processors/providers/api_processor_interface.py", line 11, in <module>
llmstack-007-rqworker-1    |     from common.utils.utils import hydrate_input
llmstack-007-rqworker-1    |   File "/code/common/utils/utils.py", line 16, in <module>
llmstack-007-rqworker-1    |     from common.utils.crawlers import run_sitemap_spider_in_process
llmstack-007-rqworker-1    |   File "/code/common/utils/crawlers.py", line 13, in <module>
llmstack-007-rqworker-1    |     from unstructured.partition.auto import partition_html
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/partition/auto.py", line 16, in <module>
llmstack-007-rqworker-1    |     from unstructured.partition.email import partition_email
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/partition/email.py", line 54, in <module>
llmstack-007-rqworker-1    |     from unstructured.partition.html import partition_html
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/partition/html.py", line 6, in <module>
llmstack-007-rqworker-1    |     from unstructured.documents.html import HTMLDocument
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/documents/html.py", line 24, in <module>
llmstack-007-rqworker-1    |     from unstructured.documents.xml import VALID_PARSERS, XMLDocument
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/documents/xml.py", line 8, in <module>
llmstack-007-rqworker-1    |     from unstructured.partition.text import (
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/partition/text.py", line 20, in <module>
llmstack-007-rqworker-1    |     from unstructured.nlp.tokenize import sent_tokenize
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/unstructured/nlp/tokenize.py", line 10, in <module>
llmstack-007-rqworker-1    |     import nltk
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/nltk/__init__.py", line 133, in <module>
llmstack-007-rqworker-1    |     from nltk.collocations import *
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/nltk/collocations.py", line 36, in <module>
llmstack-007-rqworker-1    |     from nltk.metrics import (
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/nltk/metrics/__init__.py", line 17, in <module>
llmstack-007-rqworker-1    |     from nltk.metrics.aline import align
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/nltk/metrics/aline.py", line 41, in <module>
llmstack-007-rqworker-1    |     import numpy as np
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/numpy/__init__.py", line 139, in <module>
llmstack-007-rqworker-1    |     from . import core
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/numpy/core/__init__.py", line 23, in <module>
llmstack-007-rqworker-1    |     from . import multiarray
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/numpy/core/multiarray.py", line 10, in <module>
llmstack-007-rqworker-1    |     from . import overrides
llmstack-007-rqworker-1    |   File "/usr/local/lib/python3.11/site-packages/numpy/core/overrides.py", line 8, in <module>
llmstack-007-rqworker-1    |     from numpy.core._multiarray_umath import (
llmstack-007-rqworker-1    |   File "<frozen importlib._bootstrap>", line 216, in _lock_unlock_module
llmstack-007-rqworker-1    | KeyboardInterrupt

After that, it seams to get further but dies at:

llmstack-007-api-1         | [2023-09-05 05:58:06 +0000] [29] [ERROR] Exception in ASGI application
llmstack-007-api-1         | Traceback (most recent call last):
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 436, in run_asgi
llmstack-007-api-1         |     result = await app(  # type: ignore[func-returns-value]
llmstack-007-api-1         |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
llmstack-007-api-1         |     return await self.app(scope, receive, send)
llmstack-007-api-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/channels/routing.py", line 62, in __call__
llmstack-007-api-1         |     return await application(scope, receive, send)
llmstack-007-api-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/django/core/handlers/asgi.py", line 160, in __call__
llmstack-007-api-1         |     await self.handle(scope, receive, send)
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/django/core/handlers/asgi.py", line 173, in handle
llmstack-007-api-1         |     await sync_to_async(signals.request_started.send, thread_sensitive=True)(
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/site-packages/asgiref/sync.py", line 436, in __call__
llmstack-007-api-1         |     future = loop.run_in_executor(
llmstack-007-api-1         |              ^^^^^^^^^^^^^^^^^^^^^
llmstack-007-api-1         |   File "uvloop/loop.pyx", line 2729, in uvloop.loop.Loop.run_in_executor
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 176, in submit
llmstack-007-api-1         |     self._adjust_thread_count()
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 199, in _adjust_thread_count
llmstack-007-api-1         |     t.start()
llmstack-007-api-1         |   File "/usr/local/lib/python3.11/threading.py", line 957, in start
llmstack-007-api-1         |     _start_new_thread(self._bootstrap, ())
llmstack-007-api-1         | RuntimeError: can't start new thread

uvloop does not support windows at the moment

          i am getting error while downloading the package: for pip install llmstack, i am getting error message, uvloop does not support windows at the moment.

Originally posted by @ashunaveed in #18 (comment)

Feature Request: Override the OpenAI Base URL

It would be great if we could override the OpenAI Base URL at least with an environment variable or via the UI so we could use tools like LocalAI with this.

Cloudflare to protect against online attacks

the problem is also on the website.
https://trypromptly.com/
There is also a problem in the chatbot of the site, during interaction: Connection Error.

respectfully.

Bug Report

llmstack-main-api-1 | ERROR 2023-09-26 20:32:15,472 consumers no close frame received or sent
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 968, in transfer_data
llmstack-main-api-1 | message = await self.read_message()
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1038, in read_message
llmstack-main-api-1 | frame = await self.read_data_frame(max_size=self.max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1113, in read_data_frame
llmstack-main-api-1 | frame = await self.read_frame(max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1170, in read_frame
llmstack-main-api-1 | frame = await Frame.read(
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/framing.py", line 69, in read
llmstack-main-api-1 | data = await reader(2)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/asyncio/streams.py", line 731, in readexactly
llmstack-main-api-1 | raise exceptions.IncompleteReadError(incomplete, n)
llmstack-main-api-1 | asyncio.exceptions.IncompleteReadError: 0 bytes read on a total of 2 expected bytes
llmstack-main-api-1 |
llmstack-main-api-1 | The above exception was the direct cause of the following exception:
llmstack-main-api-1 |
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/code/llmstack/server/consumers.py", line 71, in _respond_to_event
llmstack-main-api-1 | await self.send(text_data=json.dumps({'output': output}))
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/generic/websocket.py", line 209, in send
llmstack-main-api-1 | await super().send({"type": "websocket.send", "text": text_data})
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/consumer.py", line 81, in send
llmstack-main-api-1 | await self.base_send(message)
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/sessions.py", line 226, in send
llmstack-main-api-1 | return await self.real_send(message)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 327, in asgi_send
llmstack-main-api-1 | await self.send(data) # type: ignore[arg-type]
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 635, in send
llmstack-main-api-1 | await self.ensure_open()
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 944, in ensure_open
llmstack-main-api-1 | raise self.connection_closed_exc()
llmstack-main-api-1 | websockets.exceptions.ConnectionClosedError: no close frame received or sent
llmstack-main-api-1 | ERROR 2023-09-26 20:32:15,476 runners Task exception was never retrieved
llmstack-main-api-1 | future: <Task finished name='Task-302' coro=<AppConsumer._respond_to_event() done, defined at /code/llmstack/server/consumers.py:54> exception=ConnectionClosedError(None, None, None)>
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 968, in transfer_data
llmstack-main-api-1 | message = await self.read_message()
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1038, in read_message
llmstack-main-api-1 | frame = await self.read_data_frame(max_size=self.max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1113, in read_data_frame
llmstack-main-api-1 | frame = await self.read_frame(max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1170, in read_frame
llmstack-main-api-1 | frame = await Frame.read(
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/framing.py", line 69, in read
llmstack-main-api-1 | data = await reader(2)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/asyncio/streams.py", line 731, in readexactly
llmstack-main-api-1 | raise exceptions.IncompleteReadError(incomplete, n)
llmstack-main-api-1 | asyncio.exceptions.IncompleteReadError: 0 bytes read on a total of 2 expected bytes
llmstack-main-api-1 |
llmstack-main-api-1 | The above exception was the direct cause of the following exception:
llmstack-main-api-1 |
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/code/llmstack/server/consumers.py", line 76, in _respond_to_event
llmstack-main-api-1 | await self.send(text_data=json.dumps({'errors': [str(e)]}))
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/generic/websocket.py", line 209, in send
llmstack-main-api-1 | await super().send({"type": "websocket.send", "text": text_data})
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/consumer.py", line 81, in send
llmstack-main-api-1 | await self.base_send(message)
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/sessions.py", line 226, in send
llmstack-main-api-1 | return await self.real_send(message)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 327, in asgi_send
llmstack-main-api-1 | await self.send(data) # type: ignore[arg-type]
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 635, in send
llmstack-main-api-1 | await self.ensure_open()
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 944, in ensure_open
llmstack-main-api-1 | raise self.connection_closed_exc()
llmstack-main-api-1 | websockets.exceptions.ConnectionClosedError: no close frame received or sent
llmstack-main-api-1 | ERROR 2023-09-26 20:32:15,476 consumers no close frame received or sent
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 968, in transfer_data
llmstack-main-api-1 | message = await self.read_message()
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1038, in read_message
llmstack-main-api-1 | frame = await self.read_data_frame(max_size=self.max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1113, in read_data_frame
llmstack-main-api-1 | frame = await self.read_frame(max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1170, in read_frame
llmstack-main-api-1 | frame = await Frame.read(
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/framing.py", line 69, in read
llmstack-main-api-1 | data = await reader(2)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/asyncio/streams.py", line 731, in readexactly
llmstack-main-api-1 | raise exceptions.IncompleteReadError(incomplete, n)
llmstack-main-api-1 | asyncio.exceptions.IncompleteReadError: 0 bytes read on a total of 2 expected bytes
llmstack-main-api-1 |
llmstack-main-api-1 | The above exception was the direct cause of the following exception:
llmstack-main-api-1 |
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/code/llmstack/server/consumers.py", line 71, in _respond_to_event
llmstack-main-api-1 | await self.send(text_data=json.dumps({'output': output}))
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/generic/websocket.py", line 209, in send
llmstack-main-api-1 | await super().send({"type": "websocket.send", "text": text_data})
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/consumer.py", line 81, in send
llmstack-main-api-1 | await self.base_send(message)
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/sessions.py", line 226, in send
llmstack-main-api-1 | return await self.real_send(message)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 327, in asgi_send
llmstack-main-api-1 | await self.send(data) # type: ignore[arg-type]
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 635, in send
llmstack-main-api-1 | await self.ensure_open()
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 944, in ensure_open
llmstack-main-api-1 | raise self.connection_closed_exc()
llmstack-main-api-1 | websockets.exceptions.ConnectionClosedError: no close frame received or sent
llmstack-main-api-1 | ERROR 2023-09-26 20:32:15,477 runners Task exception was never retrieved
llmstack-main-api-1 | future: <Task finished name='Task-232' coro=<AppConsumer._respond_to_event() done, defined at /code/llmstack/server/consumers.py:54> exception=ConnectionClosedError(None, None, None)>
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 968, in transfer_data
llmstack-main-api-1 | message = await self.read_message()
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1038, in read_message
llmstack-main-api-1 | frame = await self.read_data_frame(max_size=self.max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1113, in read_data_frame
llmstack-main-api-1 | frame = await self.read_frame(max_size)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1170, in read_frame
llmstack-main-api-1 | frame = await Frame.read(
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/framing.py", line 69, in read
llmstack-main-api-1 | data = await reader(2)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/asyncio/streams.py", line 731, in readexactly
llmstack-main-api-1 | raise exceptions.IncompleteReadError(incomplete, n)
llmstack-main-api-1 | asyncio.exceptions.IncompleteReadError: 0 bytes read on a total of 2 expected bytes
llmstack-main-api-1 |
llmstack-main-api-1 | The above exception was the direct cause of the following exception:
llmstack-main-api-1 |
llmstack-main-api-1 | Traceback (most recent call last):
llmstack-main-api-1 | File "/code/llmstack/server/consumers.py", line 76, in _respond_to_event
llmstack-main-api-1 | await self.send(text_data=json.dumps({'errors': [str(e)]}))
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/generic/websocket.py", line 209, in send
llmstack-main-api-1 | await super().send({"type": "websocket.send", "text": text_data})
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/consumer.py", line 81, in send
llmstack-main-api-1 | await self.base_send(message)
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/channels/sessions.py", line 226, in send
llmstack-main-api-1 | return await self.real_send(message)
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 327, in asgi_send
llmstack-main-api-1 | await self.send(data) # type: ignore[arg-type]
llmstack-main-api-1 | ^^^^^^^^^^^^^^^^^^^^^
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 635, in send
llmstack-main-api-1 | await self.ensure_open()
llmstack-main-api-1 | File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 944, in ensure_open
llmstack-main-api-1 | raise self.connection_closed_exc()
llmstack-main-api-1 | websockets.exceptions.ConnectionClosedError: no close frame received or sent
llmstack-main-api-1 | [2023-09-26 20:32:15 +0000] [154] [INFO] connection closed
llmstack-main-api-1 | sys:1: ResourceWarning: unclosed <ssl.SSLSocket fd=26, family=2, type=1, proto=6, laddr=('172.19.0.6', 43544), raddr=('104.18.6.192', 443)>
llmstack-main-api-1 | ResourceWarning: Enable tracemalloc to get the object allocation traceback
llmstack-main-api-1 | sys:1: ResourceWarning: unclosed <ssl.SSLSocket fd=39, family=2, type=1, proto=6, laddr=('172.19.0.6', 34310), raddr=('104.18.6.192', 443)>
llmstack-main-api-1 | ResourceWarning: Enable tracemalloc to get the object allocation traceback
llmstack-main-api-1 | [2023-09-26 20:32:18 +0000] [154] [INFO] ('172.19.0.8', 54618) - "WebSocket /ws/apps/0396bed1-a938-4910-8208-10dcf1690528" [accepted]
llmstack-main-api-1 | [2023-09-26 20:32:18 +0000] [154] [INFO] connection open
llmstack-main-api-1 | sys:1: ResourceWarning: unclosed <ssl.SSLSocket fd=26, family=2, type=1, proto=6, laddr=('172.19.0.6', 34312), raddr=('104.18.6.192', 443)>
llmstack-main-api-1 | ResourceWarning: Enable tracemalloc to get the object allocation traceback
llmstack-main-api-1 | sys:1: ResourceWarning: unclosed <ssl.SSLSocket fd=26, family=2, type=1, proto=6, laddr=('172.19.0.6', 54102), raddr=('104.18.6.192', 443)>
llmstack-main-api-1 | ResourceWarning: Enable tracemalloc to get the object allocation traceback

[0.0.13] Playwright doesnt start

Describe the bug

Unable to add localAI to docker-compose and testing it since URL requires TLD

To Reproduce

Start the stack

unzip v0.0.13
docker-compse pull
docker-compose up -d
docker-compose logs -f

Version

v0.0.13

Environment

DISTRIB_DESCRIPTION="Ubuntu 22.04.3 LTS"
Docker version 24.0.5, build ced0996
Docker Compose version v2.20.3

Screenshots

Additional context

llmstack-0013-playwright-1  | node:internal/process/promises:288
llmstack-0013-playwright-1  |             triggerUncaughtException(err, true /* fromPromise */);
llmstack-0013-playwright-1  |             ^
llmstack-0013-playwright-1  | Error: Executable doesn't exist at /ms-playwright/chromium-1080/chrome-linux/chrome
llmstack-0013-playwright-1  | ╔══════════════════════════════════════════════════════════════════════╗
llmstack-0013-playwright-1  | ║ Looks like Playwright Test or Playwright was just updated to 1.38.1. ║
llmstack-0013-playwright-1  | ║ Please update docker image as well.                                  ║
llmstack-0013-playwright-1  | ║ -  current: mcr.microsoft.com/playwright:v1.37.0-jammy               ║
llmstack-0013-playwright-1  | ║ - required: mcr.microsoft.com/playwright:v1.38.1-jammy               ║
llmstack-0013-playwright-1  | ║                                                                      ║
llmstack-0013-playwright-1  | ║ <3 Playwright Team                                                   ║
llmstack-0013-playwright-1  | ╚══════════════════════════════════════════════════════════════════════╝ Failed to launch browser.
llmstack-0013-playwright-1  |     at executablePathOrDie (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/registry/index.js:357:15)
llmstack-0013-playwright-1  |     at Object.executablePathOrDie (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/registry/index.js:370:43)
llmstack-0013-playwright-1  |     at Chromium._launchProcess (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:166:39)
llmstack-0013-playwright-1  |     at async Chromium._innerLaunch (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:103:9)
llmstack-0013-playwright-1  |     at async Chromium._innerLaunchWithRetries (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:84:14)
llmstack-0013-playwright-1  |     at async ProgressController.run (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/progress.js:92:22)
llmstack-0013-playwright-1  |     at async Chromium.launch (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/server/browserType.js:61:21)
llmstack-0013-playwright-1  |     at async BrowserServerLauncherImpl.launchServer (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/browserServerImpl.js:48:21)
llmstack-0013-playwright-1  |     at async launchBrowserServer (/home/pwuser/.npm/_npx/e41f203b7505f1fb/node_modules/playwright-core/lib/cli/driver.js:86:18)
llmstack-0013-playwright-1  | Node.js v18.17.1
llmstack-0013-playwright-1 exited with code 1

Installation Issue on Ubuntu 20.04

Describe the bug
No matching distro for llmstack using pip install method

To Reproduce
Steps to reproduce the behavior:

Git clone repo
Navigated to git folder
pip install llmstack

Expected behavior
Installation of llmstack

Version
Most recent

Environment
Running as root on Ubuntu 20.04

Screenshots
NA

Additional context
pip install llmstack
ERROR: Could not find a version that satisfies the requirement llmstack (from versions: none)
ERROR: No matching distribution found for llmstack

I am facing the issues in adding datasource.

          @ajhai Hello Ajay. I am facing the issues in adding datasource.Your models in app(s): 'organizations', 'socialaccount' have changes that are not yet reflected in a migration, and so won't be applied.

Run 'manage.py makemigrations' to make new migrations, and then re-run 'manage.py migrate' to apply them.
Installed 39 object(s) from 1 fixture(s)
Cache cleared successfully.
[llmstack-runner] Starting LLMStack Runner
Starting LLMStack rqworker
Exception in thread Thread-1 (start_runner):
Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connectionpool.py", line 715, in urlopen
httplib_response = self._make_request(
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connectionpool.py", line 416, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connection.py", line 244, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1283, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1329, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1278, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1038, in _send_output
self.send(msg)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 976, in send
Waiting for LLMStack server to be up...
self.connect()
File "/opt/homebrew/lib/python3.10/site-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
FileNotFoundError: [Errno 2] No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connectionpool.py", line 799, in urlopen
retries = retries.increment(
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/util/retry.py", line 550, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/packages/six.py", line 769, in reraise
raise value.with_traceback(tb)
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connectionpool.py", line 715, in urlopen
httplib_response = self._make_request(
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connectionpool.py", line 416, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/opt/homebrew/lib/python3.10/site-packages/urllib3/connection.py", line 244, in request
super(HTTPConnection, self).request(method, url, body=body, headers=headers)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1283, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1329, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1278, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 1038, in _send_output
self.send(msg)
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/http/client.py", line 976, in send
self.connect()
File "/opt/homebrew/lib/python3.10/site-packages/docker/transport/unixconn.py", line 27, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/docker/api/client.py", line 214, in _retrieve_server_version
return self.version(api_version=False)["ApiVersion"]
File "/opt/homebrew/lib/python3.10/site-packages/docker/api/daemon.py", line 181, in version
return self._result(self._get(url), json=True)
File "/opt/homebrew/lib/python3.10/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/docker/api/client.py", line 237, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/opt/homebrew/lib/python3.10/site-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/requests/adapters.py", line 501, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/opt/homebrew/Cellar/[email protected]/3.10.13_2/Frameworks/Python.framework/Versions/3.10/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/llmstack/cli.py", line 153, in start_runner
client = docker.from_env()
File "/opt/homebrew/lib/python3.10/site-packages/docker/client.py", line 96, in from_env
return cls(
File "/opt/homebrew/lib/python3.10/site-packages/docker/client.py", line 45, in init
self.api = APIClient(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/docker/api/client.py", line 197, in init
self._version = self._retrieve_server_version()
File "/opt/homebrew/lib/python3.10/site-packages/docker/api/client.py", line 221, in _retrieve_server_version
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
Starting LLMStack
usage: llmstack [-h] [--host HOST] [--port PORT] {runserver,manage.py} ...
llmstack: error: unrecognized arguments: rqworker default --verbosity=0 --with-scheduler
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/opt/homebrew/lib/python3.10/site-packages/requests/utils.py:366: ResourceWarning: unclosed <socket.socket fd=18, family=AddressFamily.AF_UNIX, type=SocketKind.SOCK_STREAM, proto=0>
return list(value)
ResourceWarning: Enable tracemalloc to get the object allocation traceback
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/opt/homebrew/lib/python3.10/site-packages/llmstack/apps/apps.py:47: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/opt/homebrew/lib/python3.10/site-packages/django/db/backends/utils.py:98: RuntimeWarning: Accessing the database during app initialization is discouraged. To fix this warning, avoid executing queries in AppConfig.ready() or when your app modules are imported.
warnings.warn(self.APPS_NOT_READY_WARNING_MSG, category=RuntimeWarning)
Starting LLMStack
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
Waiting for LLMStack server to be up...
/opt/homebrew/lib/python3.10/site-packages/llmstack/apps/apps.py:47: RuntimeWarning: coroutine 'SyncToAsync.call' was never awaited
sync_to_async(add_missing_app_types)()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
/opt/homebrew/lib/python3.10/site-packages/django/db/backends/utils.py:98: RuntimeWarning: Accessing the database during app initialization is discouraged. To fix this warning, avoid executing queries in AppConfig.ready() or when your app modules are imported.
warnings.warn(self.APPS_NOT_READY_WARNING_MSG, category=RuntimeWarning)
Performing system checks...

System check identified no issues (0 silenced).
February 28, 2024 - 06:08:28
Django version 5.0, using settings 'llmstack.server.settings'
Starting ASGI/Daphne version 4.1.0 development server at http://127.0.0.1:3000/
Quit the server with CONTROL-C.
ERROR 2024-02-28 06:08:56,097 log Internal Server Error: /api/datasources/e4d176c1-d4fb-4977-b6a6-2e139b10af93/add_entry_async
Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 707, in connect
sock = self.retry.call_with_retry(
File "/opt/homebrew/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
return do()
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 708, in
lambda: self._connect(), lambda error: self.disconnect(error)
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 1006, in _connect
raise err
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 994, in _connect
sock.connect(socket_address)
ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 534, in thread_handler
raise exc_info[1]
File "/opt/homebrew/lib/python3.10/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
File "/opt/homebrew/lib/python3.10/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 479, in call
ret: _R = await loop.run_in_executor(
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/current_thread_executor.py", line 40, in run
result = self.fn(*self.args, **self.kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 538, in thread_handler
return func(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/django/views/decorators/csrf.py", line 65, in _view_wrapper
return view_func(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/llmstack/datasources/apis.py", line 416, in add_entry_async
adhoc_job.save(
File "/opt/homebrew/lib/python3.10/site-packages/llmstack/jobs/models.py", line 770, in save
job = self.rqueue.enqueue(
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 977, in enqueue
return self.enqueue_call(
File "/opt/homebrew/lib/python3.10/site-packages/django_rq/queues.py", line 68, in enqueue_call
return self.original_enqueue_call(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/django_rq/queues.py", line 64, in original_enqueue_call
return super(DjangoRQ, self).enqueue_call(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 725, in enqueue_call
return self.enqueue_job(job, pipeline=pipeline, at_front=at_front)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 1100, in enqueue_job
return self._enqueue_job(job, pipeline=pipeline, at_front=at_front)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 1120, in _enqueue_job
job.redis_server_version = self.get_redis_server_version()
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 219, in get_redis_server_version
self.redis_server_version = get_version(self.connection)
File "/opt/homebrew/lib/python3.10/site-packages/rq/utils.py", line 293, in get_version
tuple(int(i) for i in str(connection.info("server")["redis_version"]).split('.')[:3]),
File "/opt/homebrew/lib/python3.10/site-packages/redis/commands/core.py", line 993, in info
return self.execute_command("INFO", section, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/redis/client.py", line 1266, in execute_command
conn = self.connection or pool.get_connection(command_name, **options)
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 1461, in get_connection
connection.connect()
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 713, in connect
raise ConnectionError(self._error_message(e))
redis.exceptions.ConnectionError: Error 61 connecting to localhost:50379. Connection refused.
ERROR 2024-02-28 06:08:56,097 log Internal Server Error: /api/datasources/e4d176c1-d4fb-4977-b6a6-2e139b10af93/add_entry_async
Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 707, in connect
sock = self.retry.call_with_retry(
File "/opt/homebrew/lib/python3.10/site-packages/redis/retry.py", line 46, in call_with_retry
return do()
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 708, in
lambda: self._connect(), lambda error: self.disconnect(error)
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 1006, in _connect
raise err
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 994, in _connect
sock.connect(socket_address)
ConnectionRefusedError: [Errno 61] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 534, in thread_handler
raise exc_info[1]
File "/opt/homebrew/lib/python3.10/site-packages/django/core/handlers/exception.py", line 42, in inner
response = await get_response(request)
File "/opt/homebrew/lib/python3.10/site-packages/django/core/handlers/base.py", line 253, in _get_response_async
response = await wrapped_callback(
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 479, in call
ret: _R = await loop.run_in_executor(
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/current_thread_executor.py", line 40, in run
result = self.fn(*self.args, **self.kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/asgiref/sync.py", line 538, in thread_handler
return func(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/django/views/decorators/csrf.py", line 65, in _view_wrapper
return view_func(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/viewsets.py", line 125, in view
return self.dispatch(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 509, in dispatch
response = self.handle_exception(exc)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/opt/homebrew/lib/python3.10/site-packages/rest_framework/views.py", line 506, in dispatch
response = handler(request, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/llmstack/datasources/apis.py", line 416, in add_entry_async
adhoc_job.save(
File "/opt/homebrew/lib/python3.10/site-packages/llmstack/jobs/models.py", line 770, in save
job = self.rqueue.enqueue(
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 977, in enqueue
return self.enqueue_call(
File "/opt/homebrew/lib/python3.10/site-packages/django_rq/queues.py", line 68, in enqueue_call
return self.original_enqueue_call(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/django_rq/queues.py", line 64, in original_enqueue_call
return super(DjangoRQ, self).enqueue_call(*args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 725, in enqueue_call
return self.enqueue_job(job, pipeline=pipeline, at_front=at_front)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 1100, in enqueue_job
return self._enqueue_job(job, pipeline=pipeline, at_front=at_front)
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 1120, in _enqueue_job
job.redis_server_version = self.get_redis_server_version()
File "/opt/homebrew/lib/python3.10/site-packages/rq/queue.py", line 219, in get_redis_server_version
self.redis_server_version = get_version(self.connection)
File "/opt/homebrew/lib/python3.10/site-packages/rq/utils.py", line 293, in get_version
tuple(int(i) for i in str(connection.info("server")["redis_version"]).split('.')[:3]),
File "/opt/homebrew/lib/python3.10/site-packages/redis/commands/core.py", line 993, in info
return self.execute_command("INFO", section, *args, **kwargs)
File "/opt/homebrew/lib/python3.10/site-packages/redis/client.py", line 1266, in execute_command
conn = self.connection or pool.get_connection(command_name, **options)
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 1461, in get_connection
connection.connect()
File "/opt/homebrew/lib/python3.10/site-packages/redis/connection.py", line 713, in connect
raise ConnectionError(self._error_message(e))
redis.exceptions.ConnectionError: Error 61 connecting to localhost:50379. Connection refused.
ERROR 2024-02-28 06:08:56,103 runserver HTTP POST /api/datasources/e4d176c1-d4fb-4977-b6a6-2e139b10af93/add_entry_async 500 [0.11, 127.0.0.1:55053]
ERROR 2024-02-28 06:08:56,103 runserver HTTP POST /api/datasources/e4d176c1-d4fb-4977-b6a6-2e139b10af93/add_entry_async 500 [0.11, 127.0.0.1:55053]

Originally posted by @kspremkumar7 in #75 (comment)

[v.0.0.7] /admin "Not Found"

Describe the bug
The Admin console is not accessible as described in docs.

To Reproduce
Steps to reproduce the behavior:

Start LLM Stack and wait until its available
Try access http://<ip>:3000/admin

Expected behavior
The admin console should be accessible but shows only Not Found

Version
v.0.0.7

Environment
DISTRIB_DESCRIPTION="Linux Mint 21.2 Victoria"
Docker version 24.0.5, build ced0996
Docker Compose version v2.20.3

Screenshots

Additional context

llmstack-007-nginx-1       | 172.21.0.1 - - [05/Sep/2023:06:10:45 +0000] "GET /admin HTTP/1.1" 200 1811 "-" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36" "-"

Pip version - Bind 0.0.0.0

In the pip version of llmstack, when you run the commands.
llmstack -h OR llmstack --help

There is no helpful output, and instead starts up the server. One thing not documented real well was the way to switch between production and the development server, or if its even possible with the pip packaged version. And how to bind the server to port 0.0.0.0:3000 so anyone is able to access it. And I think these will all be very useful features as it is applicable when you want to share your apps on llmstack with other people not on the same system.

Describe the solution you'd like
I would like a feature that when you do llmstack -h it outputs something like.
Usage llmstack [flags]
--listen [binds server to 0.0.0.0]
--prod [Runs production server]
--dev [Runs development server]
...
...
...

Describe alternatives you've considered
Alternatively I was able to bind the server to 0.0.0.0:3000 by editing the file "~/.llmstack/config" and changing llmstack_port = 3000 -> llmstack_port = "0:3000" and add the line allowed_hosts = "0.0.0.0,localhost,192.168.0.X". Where 192.168.0.x = your local ip. And you can now access it from other machines on the network. It has however caused a bug, that I recently reported has occurred due to this change.

LocalAI Image generation

Describe the bug
LLMStack returns 'b64_json' instead of the generated image

To Reproduce
Steps to reproduce the behavior:

Go to Playground
Click on 'LocalAI', 'Image Generations
put a description
put LocalAI address in the "Base Url" field, despite the fact it is already set in settings?
Click "Run" and See error

LocalAI successfully generated image:

12:46PM DBG Response: {"created":1698842780,"id":"1d01c64f-45c5-4253-bcb8-a9879ea818ae","data":[{"embedding":null,"index":0,"url":"http://ai.example.com:8080/generated-images/b64762071389.png"}],"usage":{"prompt_tokens":0,"completion_tokens":0,"total_tokens":0}}

Expected behavior
Display generated image

Version
v0.0.17

Environment
Ubuntu 22.04
pip install llmstack
LocalAI on another debian box with several models available

trypromptly / llmstack Goto Github PK

llmstack's People

Contributors

Stargazers

Watchers

Forkers

llmstack's Issues

Docker Compose

.env file

Describe the bug

To Reproduce

Start the stack

Version

Environment

Screenshots

Additional context

Recommend Projects

Recommend Topics

Recommend Org