how to run the lora finetuned model? about geochat HOT 5 OPEN

now i know it. look at the llava project. you would find the two-stage weight-loading methods. if anyone still don't know, contact me

from geochat.

Thanks, @dongwhfdyer , I already figured it out.

from geochat.

now i know it. look at the llava project. you would find the two-stage weight-loading methods. if anyone still don't know, contact me

hi there , i am trying out this model and the demo worked but when i used the lora.sh script for training it displays OSError: Error no file named pytorch_ Model. bin, tf_ Model. h5, model. ckpt. index or flex_ Model. msgpack found in directory/home/LaVA/lava v1.5-13b lora . can you guide me how can i train this model ?

from geochat.

@dongwhfdyer hi, In the finetune_lora.sh --pretrain_mm_mlp_adapter path/to/llava-v1.5-mlp2x-336px-pretrain-vicuna-7b-v1.5/mm_projector.bin, l have a issue. Is the mm_projector.bin file using weights from llava-v1.5-7b? I couldn't find mm_projector.bin in Geochat-7B.

from geochat.

hi @dongwhfdyer ,

It seems you already successfully reproduced this project.

I am still confused about the training procedure.

• Do we only need to run the fintune_lora.sh and then merge the weight?
• Or, we also need to do pretrain with pretrain.sh

It would be super nice to get some response from you.

Best and have a nice day,

from geochat.