loading checkpoint about geochat HOT 2 CLOSED

@happisky-lyt
Hi, sorry to bother you, but I had the same problem.
Have you solved it?

from geochat.

I first ran the demo on my own pc, and I set line 103 of geochat.model.builder.py as followed:

model = GeoChatLlamaForCausalLM.from_pretrained(model_path, offload_folder="offload", low_cpu_mem_usage=True, **kwargs)

But when doing inference there is an OOM error, so I uploaded the code to the server and I got the error I mentioned before.
i believe the error was caused by setting offload_folder="offload", so I directly download the repository in my server and done inference successfully.

hope this helps you.

from geochat.