launching demo about geochat HOT 12 OPEN

I believe the error should be fixed with the latest code update. Please ensure that the download model path is set to geochat.

from geochat.

i just noticed that is is the same bug encountered in #10

from geochat.

i change builder.py line 128 ：if 'geochat-7b' in model_name.lower():and geochat_arch.py lines 33 self.vision_tower = build_vision_tower(config, delay_load=False),it doesnt work, error like this
RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasLtMatmulAlgoGetHeuristic( ltHandle, computeDesc.descriptor(), Adesc.descriptor(), Bdesc.descriptor(), Cdesc.descriptor(), Cdesc.descriptor(), preference.descriptor(), 1, &heuristicResult, &returnedResult) . just like yours, adding 2 lines of code, demo worked.

from geochat.

could you be more specific about"i found a workaround by renaming the model downloaded from HF "llava" (instead of geochat-7B) "?

from geochat.

could you be more specific about"i found a workaround by renaming the model downloaded from HF "llava" (instead of geochat-7B) "?

the authors are using the llava repository, so there are harcoded strings into the code that require your weights to be named "llava-XXX". when following the demo installation steps, you are downloading weights from HuggingFace named "geochat-7B". thus, renaming these weights is a straightforward solution.

from geochat.

could you be more specific about"i found a workaround by renaming the model downloaded from HF "llava" (instead of geochat-7B) "?

the authors are using the llava repository, so there are harcoded strings into the code that require your weights to be named "llava-XXX". when following the demo installation steps, you are downloading weights from HuggingFace named "geochat-7B". thus, renaming these weights is a straightforward solution.

Could you please specify the location of that code?

from geochat.

could you be more specific about"i found a workaround by renaming the model downloaded from HF "llava" (instead of geochat-7B) "?

the authors are using the llava repository, so there are harcoded strings into the code that require your weights to be named "llava-XXX". when following the demo installation steps, you are downloading weights from HuggingFace named "geochat-7B". thus, renaming these weights is a straightforward solution.

Could you please specify the location of that code?

https://github.com/mbzuai-oryx/GeoChat?tab=readme-ov-file#geochat-weights-and-demo

from geochat.

could you be more specific about"i found a workaround by renaming the model downloaded from HF "llava" (instead of geochat-7B) "?

the authors are using the llava repository, so there are harcoded strings into the code that require your weights to be named "llava-XXX". when following the demo installation steps, you are downloading weights from HuggingFace named "geochat-7B". thus, renaming these weights is a straightforward solution.

Could you please specify the location of that code?

https://github.com/mbzuai-oryx/GeoChat?tab=readme-ov-file#geochat-weights-and-demo

i download those models from https://huggingface.co/MBZUAI/geochat-7B/tree/mainand in my "models_geo" directory, which files from the image do I need to rename?

from geochat.

from geochat.

Hi @Murkyy, thank you for looking out.
I have updated the code. It should work now without changing the model name. Let me know if you face any other issues.

from geochat.

the output is all ,why?

from geochat.

I still have this error: RuntimeError: Internal: could not parse ModelProto from llava/tokenizer.model after following the workarounds mentioned above. Anyone could kindly advise how to resolve this? thanks!

from geochat.