Related Issues (20)
- ValueError: Failed to convert pandas DataFrame to Arrow Table from file
- 在使用LoRA微调大模型的时候出现了显存爆炸的问题
- gemma2推理报错 HOT 2
- 使用 AutoGPTQ 量化qwen-72b微调的模型会报错
- 请教下,用lora微调好模型之后,要怎么用python进行chat单条预测(llama-factory是0.8.2版本的)
- Question about `cutoff_len`: how to handle longer sequence HOT 1
- qwen2 72b 910b lora后merge生成的权重 推理失败
- PRO算法会支持吗
- 微调Qwen2-7B-Instruct-GPTQ-Int8 官方回复说量化版不支持导出,那微调好的适配器,如何与原始基座模型合并呢? HOT 1
- 在使用 Qwen2-72B-Instruct-GPTQ-Int4 LoRA 微调后,使用未量化 Instruct 模型 merge 时报错 HOT 1
- lora微调chatglm3-6b后,可视化界面运行evaluate功能,past_key_value报错 HOT 2
- 910A推理qwen1.5chat模式可行,api模式报错aicpu exception HOT 2
- multi-gpu training Unsloth HOT 1
- 如何从之前训练的地方开始? HOT 4
- vllm推理部署的最大上下文怎么设置 HOT 1
- Running server loops and gives connection error HOT 2
- 合并 72B 模型 LoRA 时的显存/内存占用需求,以及是否能够 offload CPU 或降低占用 HOT 1
- 最新的代码中,在API推理的时候在yaml文件中的参数不起作用 HOT 5
- 为什么我全参微调llama3-8b,权重文件变大了?第一张图是微调之后的,第二张图是最开始的权重文件 HOT 2
- 合并 LoRA 适配器与模型量化,使用 AutoGPTQ 量化模型得到后的模型推理报错如下ValueError: torch.bfloat16 is not supported for quantization method gptq. Supported dtypes: [torch.float16] HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.