Comments (1)
nevermind
from llama-factory.
Related Issues (20)
- 910b 280t 8机64卡 跑qwen2 7b cutoff_len: 8192 一直OOM HOT 1
- WARNING - llamafactory.model.model_utils.quantization - quantization_bit will not affect on the PTQ-quantized models HOT 1
- 请问training eval loss能否指定一个单独的数据集?
- 请问是否支持模型的awq量化? HOT 1
- 为什么predict阶段没法支持数据&模型并行呢? HOT 1
- 运行webui.py训练出错 HOT 2
- Raise error when using pissa method with deepspeed
- 如何指定某个数据集作为eval数据集?
- 训练数据未被shuffle? HOT 1
- predict 能否自定义添加output字段 HOT 1
- 72b模型单机多卡训练,llamafctory对单卡的显存有要求么? HOT 1
- llamafactory 支持 deepspeed zero3么? HOT 1
- PISSA模式下进行qLORA训练,指定了lora_rank=8,但是训练出来的adaptor_config中是lora_rank=16 HOT 1
- 有离线安装方案嘛
- 模型没有加载完,gpu利用率已经是100%了 HOT 1
- 执行命令 报错 flash_attn未安装, 安装后报错ImportError. 使用docker compose ,docker同样的问题 HOT 6
- [bug] unsloth坏了 HOT 1
- npu支持GPTQ量化导出吗 HOT 1
- 全参pt微调Qwen2-7B-Instruct模型,中断后继续训练,修改了lr但没生效 HOT 1
- 请问支持模型并行吗?如果我想要在48GB*8显卡上全量微调llama3-8b,怎么设置呢? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama-factory.