https://github.com/jieguann/XRI-Agent-Avatar-Design-Prototype-ACELab
This prototype demenstrate how to detecte a cup close to the nose of the user through detection of object (Cup) and the position of nose through PoseNet, plus the depth map from Lidar with IOS from ARFoundation.
- Change resolution to 1920 x 1080 at the left botton.
- Set iphone to auto rotate in the setting, and turn it to landscape mode.
Send all the name and positino of objects and PoseNet point through MQTT.
PoseNet Key point https://github.com/tensorflow/tfjs-models/tree/master/pose-detection