Full Body Attachment Skeleton guide for deformations
hi everyone, I was looking for a way to virtualize characters in AR using body tracking and I discovered that using Snapchat's new full body tracking features we could eventually create a filter that allow me to do what I imagined.
So, I started with the included "Full Body Attachments" template, read the documentation about it, and after that noticed that it also comes with a 2nd example on the same template, but this time using bones and a Rig to deform a mesh, instead of 3D floating elements parented to body parts as the main example of the aforementioned Template:
And this was exactly what I was looking for, not floating parts but actual bone deformation.
But, when I started to figure it out, discovered that the Spirals_mesh file that was being deformed was not a file that could be opened in any way, not to look inside of it, or use it as a reference to emulate the 15 joints rig that is inside of it, and that allows to control it with the armature of the Skinned Mesh example, and that's because it is a .mesh Snapchat's proprietary file:
This caused me to start to guess how to build the rig, with no success at all, I could eventually move bones using proper naming conventions on my FBX file, but no further success on the placement of the bones, and that also prevented from briefing an animator to make a rig for this because I do not know more than just the possible names of each joint/bone based on the armature structure of the example.
Is there any way that I can have access to a guide that tells me how to build that rig in order to create my own bone deformed assets to create filters like the one we want to test?, or a 3D file like Spirals_mesh that we can open and look at it to use it as a reference?
Hope that a snapchat team member read this.
-
Comment actions -
Hi Jonathan Solichin, I reviewed the FBX and well, thank you for that, but is not quite what I was looking for. I'll explain:
- The spiral_mesh on the right of my image is the skinnned/rigged mesh that comes as a secondary example of the full body attachments template.On that one I can see a bone structure that needs to be made based on the hierarchy of the armature.
But, i’m lost there because the rig for that seems a bit odd (i.e. hip-->neck-->nose???)do you have a template rig for that case?
- The fbx sent by you is actually quite useful for the purpose of the main example of the template.
But I can clearly see that do not correspond with the spiral_mesh rig, and because of that it may not work with the Skinned Mesh [TRY ME] secondary example of the template,is my assessment correct?
Question there is any full 3D Body tracking feature coming this year?
The examples I've seen around with new lenses tracking people (on twitter, linkedin, etc) are giving me the impression that is something better than 2D full body tracking out there, especially when I see rotation of characters in space: I do not think that can be easily achieved with the current 2D full body tracking.
Thank you for the fbx file :)Comment actions -
Hi Luis!
Thank you for the feedback and the detailed insight!
I'm not sure if you've gotten the chance to check it out yet, but Lens Studio 3.4 is now available with 3D Body tracking! In addition to tracking the body in 3D, you're also able to track multiple bodies simultaneously.
In case it's helpful, here are two more FBXs that will hopefully help. One for the 2D body attachments, and the other for 3D body tracking.
For 2D body attachments, you should be able to skin your model to this FBX, import it into studio, then swap the skin on the Skin Mesh example in Spirals_mesh object to have your skin animate to the body.
For the 3D body example, you should be able to import the mesh, bring it under the 3D Body Tracking object, and use the Match Hierarchy button to connect the fbx to the 3d body tracking.
Let me know if I can clarify more!
Thank you,
JonathanComment actions -
Thank you so much for the answer Jonathan Solichin, in deed, I immediately downloaded the 3.4 version last week and I'm already doing experiments with it.
I will download the FBX files that you sent to us and will share them with the rest of our lens team.
Thank you again for following our issue and for the opportune release & files :)Comment actions
Please sign in to leave a comment.
Have a comment?