Comments (15)
I've submitted the preprocessor-fix PR to mediapipe (google-ai-edge/mediapipe#5392) and once it's in we could update to a commit, or wait for v0.10.14 which would probably be about a month out considering the average time between releases.
from gdmp.
Mediapipe currently don't have their official C++ API for Holistic Landmarker. A PR (google-ai-edge/mediapipe#5063) has been started, although it does appear to have stalled for some number of months.
The release notes for 0.10.13 state "Make Holistic C++ graph public until we have a C++ API", so possibly we can implement the GDExtension classes as if the C++ API were present - inferring from the Holistic Landmarker PR and the APIs published for other languages (Java, Python, etc.). The implementation would hide the fact that it's using the C++ graph for now, and hopefully we can seamlessly switch over to the real API once it's published.
from gdmp.
@j20001970 Is there a need to coordinate upgrading to v0.10.11
Will that break existing version?
As the issue you linked, currently there are problem in using preprocessor directives within function-like macro on Windows, bumping to mediapipe v0.10.11 will fail to build Windows library without a proper fix. Since the issue has already been opened on upstream mediapipe repo, I think there is no need to take actions further, let's wait for next release tag hopefully fix the issue.
In the meantime, try not to urging people too hard on fixing certain things, different projects have different goals and priorities in mind.
from gdmp.
GDMP is now finally updated to the latest Mediapipe v0.10.13 and built successfully
https://github.com/Malcolmnixon/GDMP/tree/test-mediapipe
Great Job Malcolm
from gdmp.
How would you like others to help and coordinate?
My plan (hopefully this weekend) is to familiarize myself with how GDMP maps the existing mediapipe APIs to GDExtension; and then take the unfinished Holistic Landmarker C++ API PR and apply the same mapping patterns to produce a proposed GDMP GDExtension API for the holistic landmarker with the same architectural/design choices as the existing tasks.
If that looks good then I'll try to implement that proposed GDExtension API, but using the unfinished Holistic Landmarker C++ API PR as a guide to for how to map the calls to the underlying graph API.
It would be simpler to just wait for mediapipe to release their C++ API; however that PR has stalled with no changes for 4 months, so I don't see any alternative but to work around the problem. To misquote Voltaire "Don't make great the enemy of good"!
from gdmp.
The latest is v 0.10.11
The ongoing discussion
from gdmp.
@j20001970
Is there a need to coordinate upgrading to v0.10.11
Will that break existing version?
from gdmp.
https://github.com/google/mediapipe/releases/tag/v0.10.13
Attempting v0.10.11 here.
https://github.com/Malcolmnixon/GDMP/actions
The feedback to mediapipe community
google-ai-edge/mediapipe#5366
from gdmp.
from gdmp.
Mediapipe
https://github.com/google/mediapipe/tree/master/mediapipe/tasks/cc/vision/holistic_landmarker
GDMP
holistic_landmarker.h
holistic_landmarker.cc
Documentation
MediaPipeHolisticLandmarker
MediaPipe Holistic requires coordination between up to 8 models per frame —
- 1 pose detector,
- 1 pose landmark model,
- 3 re-crop models and
- 3 keypoint models for hands and face.
https://chuoling.github.io/mediapipe/solutions/holistic.html
https://github.com/google/mediapipe/blob/master/docs/solutions/holistic.md
https://developers.google.com/mediapipe/api/solutions/js/tasks-vision.holisticlandmarker
References
from gdmp.
@Malcolmnixon
Please help me here. Do we need to wait to have a working v0.10.13 dependent GDMP with the MediaPipeHolisticLandmarker ?
from gdmp.
Do we need to wait to have a working v0.10.13 dependent GDMP with the MediaPipeHolisticLandmarker
I'm not sure exactly what you're asking - GDMP is currently based on mediapipe v0.10.13 (with the necessary patches applied in the build process) and appears to work fine in my testing.
I'm suggesting the next step is to design the GDMP MediaPipeHolisticLandmarker and MediaPipeHolisticLandmarkerResult objects and their associated methods in such a way that they can be implemented using the v0.10.13 Holistic C++ graph API, but also with the intent of switching to the proper Holistic C++ API once mediapipe releases it. That way anyone writing code based on the Godot API will hopefully not experience API breakage going forwards.
from gdmp.
I'm suggesting the next step is to design the GDMP MediaPipeHolisticLandmarker and MediaPipeHolisticLandmarkerResult objects and their associated methods in such a way that they can be implemented using the v0.10.13 Holistic C++ graph API, but also with the intent of switching to the proper Holistic C++ API once mediapipe releases it. That way anyone writing code based on the Godot API will hopefully not experience API breakage going forwards.
I am not C++
Are the c++ examples of v0.10.9 helpful to achieve the design and implementation for MediaPipeHolisticLandmarker and MediaPipeHolisticLandmarkerResult?
How would you like others to help and coordinate?
from gdmp.
Don't make great the enemy of good"!
We shall discuss further on this :-)
KIV
https://github.com/google-ai-edge/mediapipe/releases/tag/v0.10.14
Is there something needed to be there but not yet?
from gdmp.
Related Issues (17)
- Windows support HOT 17
- Building to web and Mac? HOT 2
- Support the new Face blendshapes graph HOT 6
- Update to the latest Godot-cpp to keep up with the latest GDExtension? HOT 1
- Errors in setup.py HOT 3
- GDExtension C# bindings made possible by Godot 4.2 Beta 1 HOT 3
- error on build script: " Repository '@hedron_compile_commands_pip' is not defined" HOT 3
- Unable to build from source HOT 11
- Camera Helper not working on iOS HOT 4
- Segmentation fault when loading the library if certain module of the editor is system-provided
- Problems with getting the examples running HOT 3
- v0.5 Roadmap HOT 4
- Problem with building on Linux HOT 3
- Build GDMP AAR HOT 2
- Deleting a graph will mess with Godot rendering HOT 1
- Tutorial request HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gdmp.