Comments (1)
Qwen-1_8B-Chat 同样export 失败,是我环境问题吗?
python transformers/llm/export/llm_export.py --path /swtest/LLM/Qwen-1_8B-Chat/ --embed_bin --embed_bf16 --export_embed --export_token --export --skip_slim --type Qwen-1_8B-Chat
TypeError: QWenBlock.forward() got an unexpected keyword argument 'rotary_pos_emb'
pip list:
accelerate 0.30.1
certifi 2024.2.2
charset-normalizer 3.3.2
coloredlogs 15.0.1
einops 0.8.0
filelock 3.14.0
flatbuffers 24.3.25
fsspec 2024.5.0
huggingface-hub 0.23.0
humanfriendly 10.0
idna 3.7
Jinja2 3.1.4
loguru 0.7.2
MarkupSafe 2.1.5
mpmath 1.3.0
networkx 3.3
numpy 1.26.4
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu12 8.9.2.26
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu12 12.1.0.106
nvidia-nccl-cu12 2.20.5
nvidia-nvjitlink-cu12 12.4.127
nvidia-nvtx-cu12 12.1.105
onnx 1.16.0
onnxruntime 1.18.0
onnxslim 0.1.26
packaging 24.0
peft 0.11.1
pip 24.0
protobuf 5.26.1
psutil 5.9.8
PyYAML 6.0.1
regex 2024.5.15
requests 2.31.0
safetensors 0.4.3
sentencepiece 0.2.0
setuptools 69.5.1
sympy 1.12
tiktoken 0.7.0
tokenizers 0.19.1
torch 2.3.0
tqdm 4.66.4
transformers 4.41.0
transformers-stream-generator 0.0.5
triton 2.3.0
typing_extensions 4.11.0
urllib3 2.2.1
wheel 0.43.0
from mnn.
Related Issues (20)
- 英伟达T4上运行OpencCL报错 HOT 3
- 文档网页无法访问
- 如何将MNN的numpy对象转换为numpy对象?
- Android跑两个模型,OpenCL只能在一个上面生效。 HOT 5
- 目前MNN支持解析qat模型吗? HOT 1
- doc多处链接失效
- vulkan crashed on android 9 with Qualcomm Technologies, Inc SDM660 HOT 3
- opencl matmul运行crash HOT 8
- 自定义神经网络
- Error is between /model.23/TopK and /model.23/Unsqueeze HOT 1
- 在linux上进行编译时出现错误 HOT 2
- Performance degradation from `2.8.1` to `2.9.2` HOT 4
- 缺少 Convolution2DTransposeBias 算子, TFLite 模型转MNN后运行崩溃 HOT 2
- efficientvit模型fp16精度不对 HOT 4
- Android上使用simpleperf输出调用栈的时候无法得到函数名
- 鸿蒙Next单框架编译Mnn时,MNN_OPENGL打开编译不过
- Qwen2-7b使用cuda运行输出结果不正常 HOT 2
- 请问如何将 safetensors 模型文件转化成 mnn 模型? HOT 1
- cuda A6000输入超过2000时,推理错误,CPU推理正常 HOT 1
- onnx模型转mnn后,onnx推理正常,mnn输出异常 HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mnn.