You need a GLM_API_KEY to run this code. Store it in a .env file in the root directory of the project, or set them as environment variables.

Since glm4v can't read local images, they need to be uploaded to a server first. Here, I've configured Tencent Cloud COS.

If you are running the code on Apple Silicon, run the following command:

$ brew install portaudio
$ brew install miniconda

Create a virtual environment, update pip, and install the required packages:

$ git clone https://github.com/gan/glm4v-assistant.git
$ cd glm4v-assistant
$ git clone https://github.com/2noise/ChatTTS.git

$ conda create -n glm-asnt python=3.10
$ conda activate glm-asnt

$ conda install -c conda-forge pynini=2.1.5 && pip install WeTextProcessing
$ pip install -U pip
$ pip install -r requirements.txt

Run the assistant:

$ python3 glm4-assistant.py