Comments (5)
错的应该是这句话。vectorstore = FAISS.load_local('xw', embeddings=embeddings)
在这里面我读取了xw这个文件夹。这个文件夹在项目里是没有的,它是数据生成gendata.py里面。生成的你所需要查找的文档的向量。因为我的数据是从互联网上爬去的新闻可能会有一些问题。我没有承认了,你可以把自己的txt格式的文件放在名为txt的文件夹里。然后运行这个叫做数据预处理的批处理。是我的说明没有写清楚,今天晚上的时候我给他加上。
from wenda.
transformers应该用哪个版本合适?我这儿报错
ModuleNotFoundError: No module named 'transformers_modules.model/chatglm-6b-int4'
from wenda.
改了绝对路径之后跑通了。
另外,我想问一下,gcc编译器是必须安装的吗,是不是程序没有调用GPU,而是用的CPU跑的? 请大佬不吝赐教。@l15y
from wenda.
根据观察,在预处理过程中使用的是CPU,使用过程中调用GPU。另外想请教一下大佬,预处理能否调用GPU,CPU处理起来速度极慢。
from wenda.
gcc不用装
预处理,转化句向量的模型默认gpu计算,想用cpu需要改langchain源码
from wenda.
Related Issues (20)
- 执行pip install -r requirements/requirements.txt报错 HOT 2
- Exception has occurred: IndexError HOT 4
- 'HuggingFaceEmbeddings' object is not callable HOT 8
- 千问int4量化模型输出最后报错 HOT 1
- 用官方源码部署 baichuan2-13B-chat的效果和 wenda部署 baichuan2-13B-chat的效果差距很大 HOT 1
- 接入chatglm3-6b需求 HOT 1
- 正在爬取索引的搜索支持
- 夸克下载的懒人包启动的时候报错:OSError : [WinError 193] %1不是有效的Win32应用程序。模型加载完成 HOT 1
- 闻达如何使用微调后的模型
- 闻达怎么支持chatglm-6b微调后的模型
- 配置了模型之后,点击了运行服务GLM6B,页面闪退,怎么解决
- 在两张GPU卡上加载Chatglm3-6b 出错,请问如何解决? HOT 1
- 多人访问一段时间后,服务器本机无法访问网络
- 报错 Too many open files HOT 1
- 构建知识库报错python plugins/gen_data_st.py时候ModuleNotFoundError: No module named 'exceptions' HOT 1
- mac intel 芯片运行报错 RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'
- 闻达未匹配知识库 HOT 13
- 请教一下 SD调用设置问题
- 对于无显卡的笔记本电脑,我们如何更新我们的知识库?
- 请问可以增加对【零一万物】的支持吗 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wenda.