Support the new Face blendshapes graph about gdmp HOT 6 CLOSED

Hi, what would your usage of face blendshapes graph look like? If I understand it correctly the graph would be applied on top of existing face mesh graph by connecting predicted landmarks to it as input. If that is the case we will need additional functionality that will add new calculator nodes to initialized graph config on the plugin side.

from gdmp.

@j20001970
This is the use case: ARKit 52 blendshapes

This is missing in Godot, the ability to take the webcam and perform face motion capture and drive an avatar e.g. created using industry standards based on 52 blendshapes

This will allow Godot users to be the game engine that supports users e.g. using Android or Web to drive avatars.

Currently, only iPhone with a depth camera can drive the industry standards avatar with 52 blendshapes

FYI: another use case

from gdmp.

@j20001970

Thx for updating the mediapipe :-)

from gdmp.

@j20001970

Thx for updating the mediapipe :-)

No problem :)

from gdmp.

@ j20001970
@you-win
[Feature Request] face_blendshapes.tflite

from gdmp.

@j20001970
@you-win
See the mediapipe blendshapes in action

from gdmp.