Comments (4)
这个错误可能原因很多,请确认使用的是合适的pytorch版本,例如1.13.1。其他的pytorch程序可以正常运行吗?
from visualglm-6b.
尝试了Pytorch多种安装,包括在conda、python 环境下,一直提示同样的错误
方式1:
conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidi
方式2:
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117
from visualglm-6b.
补充:使用 torch==2.0.0 和 readme 中 transformers 的调用方法,在首次运行时正常,但结束程序后再次运行就出现了该错误,原因不太确定。
from visualglm-6b.
补充:使用 torch==2.0.0 和 readme 中 transformers 的调用方法,在首次运行时正常,但结束程序后再次运行就出现了该错误,原因不太确定。
以上情况的原因:
在原本能够运行的环境中(未安装 TensorRT)执行推理,会有一行警告并忽略 TensorRT:
2023-05-21 16:42:41.921443: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
而安装了 TensorRT 后则会产生报错 cuDNN error: CUDNN_STATUS_NOT_INITIALIZED
推测是存在不兼容?但 transformers 为啥会去调用 tensorflow(环境中确实额外装了 tensorflow),不太明白
from visualglm-6b.
Related Issues (20)
- 微调问题,微调后模型遗忘
- 烦请帮忙看看,微调后运行cli_demo.py出现维度不一致问题; RuntimeError: The size of tensor a (12288) must match the size of tensor b (25165824) at non-singleton dimension 0 HOT 2
- 全代码开源会有吗
- 运行finetune代码时,报错没有model_config.json
- 报错cannot import name 'builder' from 'google.protobuf.internal'
- visualglm进行QLoRA微调时报错,RuntimeError: mat1 and mat2 shapes cannot be multiplied (320x4096 and 1x25165824) [2024-03-07 07:26:17,037] [INFO] [launch.py:316:sigkill_handler] Killing subprocess 13210 HOT 5
- 请问怎么把finetune后的模型转成onnx格式呢?
- 微调之后加载web_demo时的报错 HOT 2
- 请问在阿里云上部署,连接不上huggingface网站的问题怎么解决呀? HOT 6
- 关于只用文本数据集微调
- Lora微调报错,fp16 is not supported HOT 1
- 请问可以实现用qlora+model parallel 吗 HOT 1
- qlora merge lora weights error
- 多图推理
- python web_demo.py报错 HOT 1
- 运行web_demo_hf.py报错
- finetune的时候出现模型加载失败
- finetune的时候加载模型失败
- 'Chatbot' object has no attribute 'style'
- 关于纯文本微调
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from visualglm-6b.