Comments (3)
we do not fine-tune llm for each expert because it is too costly😰 in the future we may support dozens of expert types
thanks for the reply. it makes sense to setting up knowledge database instead of training many experts. great work!!
from db-gpt.
Thank you for your attention. Currently, we just fine-tuned the same llm (e.g., llama2) for all the experts. From our recent evaluation, multi-expert llm works much better than single-expert llm, especially when more than one alert occurs at the same time (probably due to the finer-grained role assignment and more thorough discussion). Besides, gpt-4 is not as good as we expected in following the matched knowledge (e.g., may still give very general solutions). We will release a detailed technical report soon :)
from db-gpt.
we do not fine-tune llm for each expert because it is too costly😰 in the future we may support dozens of expert types
from db-gpt.
Related Issues (20)
- support other online models? HOT 1
- API通信遇到错误:peer closed connection without sending complete message body HOT 1
- [bug] 启动后无法对话 HOT 2
- pip install jq fails on windows HOT 1
- Questions About Experience Handling and Search in the Knowledge Base HOT 2
- /bin/sh: 1: mvn: not found HOT 7
- 需要安装 protobuf 包 HOT 1
- running batch_main.py error HOT 1
- RuntimeError: main thread is not in main loop HOT 1
- 得到了一个空的前端页面信息 HOT 2
- How is workload_sqls obtained in main.py HOT 2
- Can i setup without prometheus? HOT 4
- running with baichung2 asks for openai error HOT 12
- Video walkthrough for setup with baichung model HOT 1
- support for mysql database
- support config for private openai proxy HOT 1
- python 3.8装不了scipy==1.11.1 SentenceTransformer默认初始化选cuda导致算相似度的时候由于设备不同弹错
- readme里写的是pg12或更高版本,但pg15 pg_stat_statements表里没有total_time ; 改成total_exec_time了吧? HOT 1
- TypeError When Using Diagnosis function. HOT 3
- Clarification on UCT(v) Implementation in Tree Search Algorithm HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from db-gpt.