fsdp-qlora yi-34B-chat throw error " ValueError: Cannot flatten integer dtype tensors" about llama-factory HOT 6 CLOSED

@hiyouga sorry，my answer is so late this case, using newest llama_factory code, it work currently right now

from llama-factory.

have seen exist issue written in March,but i cannot get any useful info to find out why this error came，hoping your suggestion

from llama-factory.

please provide your version of accelerate and bitsandbytes

from llama-factory.

@hiyouga accelerate==0.28.0 bitsandbytes==0.43.0 ,Do these versions have any problems?hoping your suggestion

from llama-factory.

did you use the latest code?

from llama-factory.

While I am trying to train https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-70b I am getting the same error "ValueError: Cannot flatten integer dtype tensors".
The error seems to be resolved when I reinstalled LLaMA-Factory again. These are the versions:

accelerate 0.29.3
bitsandbytes 0.43.1

from llama-factory.