Hands-In-The-Web

This is great, well done, and thanks for open sourcing it. I started to build something like this early last year, but got too busy with another pet project and having a baby.…

I am constantly impressed by what your team shares and the practical application of XR concepts. I find myself pointing people to your demos frequently and hope to see one or two…

This is a really great project, thanks, will definitely have a play with this and it might enable some project prototyping for me that are too small for a proper mocap setup.

With an expensive Quest Pro you could capture your facial expressions using the headset's eye and face-tracking features. Any more on this? As for hands - is it able to track…

This is a really great project, thanks, will definitely have a play with this and it might enable some project prototyping for me that are too small for a proper mocap setup.

This could be great for people doing work with various sign languages.

This is extremely cool! I haven't much of a clue on motion capture. But, the capture I want to do requires feet, hands, face, shoulders, arms, knees, fingers, AND the ability to…

That's great! I assume the hand capture (+ head position) doesn't give you enough to apply inverse kinematics reliably (i.e. better than VRchat), is that correct? It's a naive…

What about arms? Or would it have to rely on some realtime IK solution to sort them out?

Wow that's super cool! That's definitely the biggest challenge - how to keep the size of the mocap data small. Our library is not the best at that, since it simply records…

This is extremely cool! I haven't much of a clue on motion capture. But, the capture I want to do requires feet, hands, face, shoulders, arms, knees, fingers, AND the ability to…

With an expensive Quest Pro you could capture your facial expressions using the headset's eye and face-tracking features. Any more on this? As for hands - is it able to track…

Thanks for this! I have been working on something similar for an upcoming education app, record a course and play in the same app with a compact file format (1MB per minute,…

Thanks for the kind words! Yes, file size for live action or shipping directly in an app is always an issue. I may actually contribute some code, my file format is no rocket…

For a body, with bones, since they can't stretch. All you need is rotation at each joint. You can get away with 10/11 bits per axis. So for a full body you should be able to…

With an expensive Quest Pro you could capture your facial expressions using the headset's eye and face-tracking features. Any more on this? As for hands - is it able to track…

How well does it do with occlusion? Holding, or manipulating an object, and capturing those interactions.

That's great! I assume the hand capture (+ head position) doesn't give you enough to apply inverse kinematics reliably (i.e. better than VRchat), is that correct? It's a naive…

https://www.theverge.com/2022/11/30/23485732/sony-mocopi-motion-capture-metaverse-vr-avatar-announcement-price Not open source but pretty cheap and does 80% of what you want,…

Well consider this sample from the Meta Movement SDK that allows you to control the facial expressions of a character with the face tracking of the Quest Pro:…

For the arms you could use Meta's new Movement SDK: https://developer.oculus.com/documentation/unity/move-overview/ Although in my opinion the arms still look a bit janky. You…

Curling up in a ball and rolling around on the floor seems like a worst case for a lot of motion tracking setups. Systems based on wearable sensors won't work because you can't…

Take a look at the MCAP file format (https://mcap.dev), we invented it for the robotics industry but it’s a generic write-optimized container format for time series data. Since…