I understand you need your face in the videos for the demos. But, want to mention that you should make sure your system works with your hands in your lap. As shown, the user is going to experience "gorilla arm" fatigue very quickly.
Good points, maybe a second camera (phone?) pointed downwards at the tabletop would be good for that. Then the user can rest their hands in a "normal" position.
Amazing! Maybe use specific finger positions/gestures to trigger a rotation and scale functions (index finger up and within a bounding box of the model perhaps for rotation, similar for pinch to fingers to scale).
Slightly on topic - anyone remember LeapMotion and is anyone aware of any current support for that? Found an original one in a drawer when I was having a clearout the other day
That video did help. I think I was thrown off by two things:
1) I was expecting 3D controls with more direct mapping (e.g. rotating my hand rotates the model). This is more like gesture mouse controls.
2) Some of the controls were too subtle. The scaling between my gesture size and effect on screen was smaller than I expected.
Great area to develop though. There's so much untapped potential in applying Mediapipe.
Thank you for the feedback!
I'm working on a couple other body movement concepts and hope to share soon :)
It uses a bit simpler approach, only detecting movement, but it works good enough for such games.
Does this video demo help?
https://x.com/measure_plan/status/1929900748235550912
If it makes it clearer, I'll upload it to the github repo directly
Great area to develop though. There's so much untapped potential in applying Mediapipe.
thank you!