Comments (7)
Thank you for opening this issue.
To support Vietnamese sign language in the current approach of text->gloss->pose, please see https://github.com/sign-language-processing/spoken-to-signed-translation
It will allow you to load a dictionary (in a specific format) such that vietnamese is supported.
Then you will have two options:
- Expose this tool using an API, and call it from a local version of
sign/translate
- Share the dictionary with me, and I will make it work in https://sign.mt alongside other languages.
from translate.
There seems to be a dictionary available for Vietnamese - https://tudienngonngukyhieu.com/tu-ngu-theo-bang-chu-cai
Your steps should be as follows:
- Add support for this dictionary in sign-language-processing/datasets (Make a PR)
- Run pose estimation on the data (
video-to-pose -i video.mp4 -o video.pose
) - Edit
download_lexicon
to support this dataset from the datasets library
Then, you will have a local demo running with this dictionary, and you will be able to apply some modifications if you want.
from translate.
Hi @AmitMY ,
Could you please provide an update on the status of this issue? Timely feedback would be greatly appreciated, thanks
from translate.
Hi @AmitMY ,
I have run the repository using the download_lexicon.py file, and as I understand, the output folder will be the dictionary that I can share with you. However, I encountered an issue as the dataset used in the demo repo is signsuisse, which only supports Swiss, French, German, and Italian languages. I have also searched for datasets supporting Vietnamese at sign-language-processing/datasets, but they do not exist.
What should be my next steps to proceed with adding Vietnamese language support?
Your timely feedback would be greatly appreciated as this is quite urgent.
Thank you very much!
from translate.
Hi @AmitMY,
I created PR at #pull/73
Please review to see if I did the job correctly, thank you very much
from translate.
Hi @AmitMY
I also reviewed possible flows in sign-language-processing/spoken-to-signed-translation such as: text_to_gloss_to_pose , text_to_gloss , pose_to_video but did not see any flows related to video_to_pose as you mentioned. I also reviewed sign-language-processing and saw a lot of work repo/work being created here. Does this project have any other project documentations besides the wiki and project board or am I missing something?
Right now I don't know where to start next for the betterment of Vietnamese. I think next I will improve the human liver while waiting for instructions. Thank you very much
from translate.
For sign-language-processing/spoken-to-signed-translation you need to extract poses - similar to the dummy lexicon - https://github.com/sign-language-processing/spoken-to-signed-translation/tree/main/assets/dummy_lexicon
the video_to_pose
command exists in the https://github.com/sign-language-processing/pose package (pip install pose-format
)
from translate.
Related Issues (20)
- [Bug] Signed-to-Spoken translation doesn't work, stuck "Loading Pose Estimation" HOT 1
- Support Vietnamese HOT 1
- [BUG] Can't access features promoted in README.md HOT 3
- [BUG] Failed to start - `Can't resolve './node_modules/leaflet/dist/leaflet.css'` HOT 12
- [Feature] Donate a sign
- [Feature] Implement Web Check Recommendations
- [BUG] Webcam Signing not providing output HOT 1
- [Feature] Sentence Segmentation
- [BUG] GDPR Compliance - Google Analytics
- [BUG] asl to english HOT 1
- Inquiries and Enhancements for Spoken to Signed Pipeline, HumanGAN, and Vietnamese Language Support HOT 1
- Android App Running on Device HOT 5
- [Q] I need to know the place of the model to see how data is going in and out to it , if you give me the place of it in files.. HOT 1
- Question about core of the project HOT 1
- Training dataset HOT 3
- [BUG] <Project Execution on Mac and Windows: Heap Memory Error> HOT 1
- [Feature] Refresh the code to latest standards
- Building Source for iOS Development and Vietnamese Language Support HOT 1
- get_API
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from translate.