Comments (3)
谢谢提醒,晚上试试,无限重复的问题,貌似和模型有关,我测试了14B,7B,3B各个模型,最终发现,只有14B不会无限重复,其它两个都会重复,但这个可能也跟索引重复有关?
from wenda.
对于s模式,按照目前gen_data_s.py的逻辑,确实是你每训练一次,哪怕txt目录内容完全相同,也会额外保存一份新的索引。然后在你提问时,zhishiku_s.py会查询sy目录下所有的索引,如果执行了三次run_data_processing,大概就会看到”三个一样的文件“。解决方法是把sy目录整个删掉,然后重建索引,就只有一份了
你截图的文件路径是txt_out下,那就是x模式,同理把xw目录下的索引文件全删了(但是不要删xw目录)重建索引试试?
from wenda.
top_p调到0.8可以有效改进
from wenda.
Related Issues (20)
- 在两张GPU卡上加载Chatglm3-6b 出错,请问如何解决? HOT 1
- 多人访问一段时间后,服务器本机无法访问网络
- 报错 Too many open files HOT 1
- 构建知识库报错python plugins/gen_data_st.py时候ModuleNotFoundError: No module named 'exceptions' HOT 1
- mac intel 芯片运行报错 RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'
- 闻达未匹配知识库 HOT 13
- 请教一下 SD调用设置问题
- 对于无显卡的笔记本电脑,我们如何更新我们的知识库?
- 请问可以增加对【零一万物】的支持吗 HOT 2
- langchain最新版本无法执行 HOT 6
- sh文件请求
- 知识库模式查找不到知识库的内容 HOT 2
- 错误name 'model' is not defined HOT 1
- 求问该如何调用openai呢
- 模型与在线搜索引擎结合
- 建议增加对于Ollama的支持,这样本地化更简单 HOT 1
- 请问wenda平台支持在昇腾NPU芯片上运行吗? HOT 1
- 请问llm_type为llama时,模型权重文件必须为model/stable-vicuna-13B.ggml.q4_2.bin吗?权重文件是否可以为llama2?以及策略是否支持fp16?
- 求问,知识库匹配方案,find接口返回的score,用的是欧氏距离还是余弦相似度呢?
- expect scalar type half but fund float
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wenda.