streamlit / llm-examples Goto Github PK
View Code? Open in Web Editor NEWStreamlit LLM app examples for getting started
Home Page: https://streamlit.io/generative-ai
License: Apache License 2.0
Streamlit LLM app examples for getting started
Home Page: https://streamlit.io/generative-ai
License: Apache License 2.0
Hi,
I'm trying to implement a streaming response using
from streamlit_chat import message
Like in this blog post
https://medium.com/@avra42/how-to-stream-output-in-chatgpt-style-while-using-openai-completion-method-b90331c15e85
But I don't know if its possible.
In Gradio Chatbot you need to keep updating the same message.
https://gradio.app/creating-a-chatbot/#add-streaming-to-your-chatbot
I got this error while testing the bots https://llm-examples.streamlit.app/:
openai.error.AuthenticationError: This app has encountered an error. The original error message is redacted to prevent data leaks. Full error details have been recorded in the logs (if you're on Streamlit Cloud, click on 'Manage app' in the lower right of your app).
Traceback:
File "/home/appuser/venv/lib/python3.9/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 552, in _run_script
exec(code, module.dict)
File "/app/llm-examples/Chatbot.py", line 24, in
response = openai.ChatCompletion.create(model="gpt-3.5-turbo", messages=st.session_state.messages)
File "/home/appuser/venv/lib/python3.9/site-packages/openai/api_resources/chat_completion.py", line 25, in create
return super().create(*args, **kwargs)
File "/home/appuser/venv/lib/python3.9/site-packages/openai/api_resources/abstract/engine_api_resource.py", line 153, in create
response, _, api_key = requestor.request(
File "/home/appuser/venv/lib/python3.9/site-packages/openai/api_requestor.py", line 298, in request
resp, got_stream = self._interpret_response(result, stream)
File "/home/appuser/venv/lib/python3.9/site-packages/openai/api_requestor.py", line 700, in _interpret_response
self._interpret_response_line(
File "/home/appuser/venv/lib/python3.9/site-packages/openai/api_requestor.py", line 763, in _interpret_response_line
raise self.handle_error_response(
This app has encountered an error. The original error message is redacted to prevent data leaks. Full error details have been recorded in the logs (if you're on Streamlit Cloud, click on 'Manage app' in the lower right of your app).
It is kinda edge case, need to show as warning instead of entire app crash
Can you please include instructions on how to run the whole app locally with multiple pages and the side bar ?
Hello,
Can code 1_File_Q&A.py work with Replicate instead of Anthropic?
I am unable to generate my key for Anthropic.
DuplicateWidgetID: There are multiple widgets with the same key='chatbot_api_key'.
Tried it in the web demo and failed.
Tried again in my local project and also failed.
There seems to be a problem.
Hi,
On the main website (https://streamlit.io/generative-ai), when click on the "Try example code", it goes to a page that says "Error running app. If this keeps happening, please contact support."
Thanks
Anthropic changed their python sdk - making this code line outdated.
llm-examples/pages/1_File_Q&A.py
Line 25 in 7e97a0e
Would love to know if this might help - https://github.com/BerriAI/litellm
~100 lines of code, that standardizes all the llm api calls to the OpenAI call
from litellm import completion
## set ENV variables
# ENV variables can be set in .env file, too. Example in .env.example
os.environ["OPENAI_API_KEY"] = "openai key"
os.environ["ANTHROPIC_API_KEY"] = "anthropic key"
messages = [{ "content": "Hello, how are you?","role": "user"}]
# openai call
response = completion(model="gpt-3.5-turbo", messages=messages)
# anthropic call
response = completion("claude-v-2", messages)
OpenAI V 1.6 required logprobs=None
in the Choice constructor, but 1.7 removed that requirement and app_test,py then works unchanged.
Setting openai>=1.7
in requirements.txt
fixes the issue.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.