Comments (1)
1.上下文对话数量和限流没关系
2.限流的时间就是一段时间,比如 1800 秒,就是针对 30 分钟内的请求进行限流,目前限流采用的是滑动窗口算法。次数指的是 30 分钟内能发多少次,比如次数是 60。表示 30 分钟内只能发送 60 条消息。openai 接口本身也有作限流处理。这块限流功能如果是容器部署的话,限流记录重启会丢失。
全局限流就是针对所有用户的,ip 限流就是针对某个 ip。任意一个限流条件被触发就会被限制发送消息。
3.上下文对话数量表示与之前对话的关联关系,是否是连续的。3 表示在同一个上下文内最多只能连续提问三次,会记忆上次的对话内容。这个数量越大消耗的 tokens 会越多。
from ai-beehive.
Related Issues (20)
- docker中的日志文件在哪呀 没找到 HOT 1
- 请问下大家yml中api_reverse_proxy参数如何配置 HOT 1
- MJ V 操作后无法再次 UV
- v1.1.0 AccessToken 模式报错
- 打包为dist并部署到nginx后,前端无法显示实时聊天内容 HOT 2
- 为什么要限制对话的消息的总长度呢? HOT 6
- 增加对百度文心千帆大模型的支持
- NewBing 无法使用修复
- NewBing 待修复
- 发出后的信息没有换行了,出现平台和百度文心一言后台返回结果不一样。
- 前端每次读取内容,会偶尔出现 读取一半的json数据 HOT 1
- 增加 ChatGLM2-6B 开源模型
- Hardcoded Vulnerabilities HOT 2
- 代理地址的端口号怎么填写 HOT 3
- Midjourney参数配置都正确了,但是请求发到Discord的时候连接关闭 HOT 1
- 2.0.0 版本 chat_room,chat_message,/rate_limit 等接口404 HOT 1
- 将配置文件以JSON形式存入数据库的目的是什么? HOT 1
- token 验证目前存在bug 各种路径未生效 HOT 1
- 后端只有客户端接口,没有管理端接口吗 HOT 1
- 体验版发送消息报错 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai-beehive.