This project translates English sentences into American Sign Language (ASL) glosses and generates corresponding GIFs of the ASL signs.
Before running this project, ensure you have followed the instructions of Gloss-Based Pipeline for Spoken to Signed Language Translation. Some of the commands from the pipeline can now be automated using the provided scripts.
The text_to_gloss.py
script utilizes the GPT-3.5 Turbo model to translate English sentences into ASL glosses.
To run the script, use the following command:
python text_to_gloss.py "put your english sentence here"
The pose_gif.py
script automates the generation of GIFs from English sentences.
We use the WLASL dataset, which contains the 2000 most common sign words, as specified in selected.json
. For more information on the sign videos, please refer to the WLASL Dataset on Kaggle.