Inquiries and Enhancements for Spoken to Signed Pipeline, HumanGAN, and Vietnamese Language Support about translate HOT 1 CLOSED

Happy to help. Please note the repository's license.

1. Since we don't currently have a model for SignWriting to Pose (https://github.com/rotem-shalev/Ham2Pose is the closest project we did), at the moment, the interface uses the left, dashed pathway - text -> glosses -> pose sequence which is a very simple implementation that can be found in https://github.com/sign-language-processing/spoken-to-signed-translation
2. If you want to use the dictionary from SignPuddle for translating to SignWriting - that is already in the SignBank+ dataset. If you have your own data with SignWriting, great, please extend the dataset here https://github.com/sign-language-processing/signbank-plus - But if you only have dictionary data with videos and words, please use https://github.com/sign-language-processing/spoken-to-signed-translation which does not require SignWriting. Ideally, when we release new models (training code here) then Vietnamese should be better supported given that we cleaned the data, but not so much right now.
3. We have very bad and very fast GANs, but also quite good and very slow diffusion models (https://github.com/sign-language-processing/pose-to-video) - feel free to use/improve any of them :) If you were to have a better GAN that is as fast but better (for example, Pix2Pix w/ StyleGAN3 architecture), I'm happy to integrate it directly in the app.

Let me know if you have further questions

from translate.