Assistance required with 3D model bust tracking
Hi Folks, I am the graphics guy for Preach Gaming on Twitch and I've been using lens studio for some time making fun filters for stream, but I have been trying to come up with some more elaborate body replacements, which specifically will work with only the shoulders and head visible - this generally rules out full body tracking.
Ideally I would like to keep using the face tracking as I am, and then utilize some means of having the bust part of the model move with the head without actually tracking to something on the body like the torso.
Logically I would have thought this would be achieved with some form of IK rigging while pinning specific bones, but I am not sure how to approach it. Potentially even chain physics with both sides being pinned (one to the head binding and the other to a fixed location) would probably work.
Finding some solution to this would be great in making Vtuber style filters viable in Snap Camera so could see it being useful for lots of people.
Any help would be appreciated.
Hi Chunkeyninja
So basically you only want tracking for shoulders/ head?
Yes Ideally a viable means of tracking just the head and the shoulders/upper chest on a 3D model without relying on tracking info for the rest of the body.,
If this should not be possible, then simply having the body element follow the head would be fine provided it could approximate the appearance of the avatar being visible from the chest up.
If you just track head position but not rotation, it will pretty much align with the shoulders...unless they shift their head like a snake side to side which rarely happens lol
I made a tutorial on this method: https://youtu.be/cmotSVG9b-4
Fancier way:
In this longer, more complex, method the Lens studio team shows how to make a bust that moves with the head but the shoulders are locked. This may be perfect for you: https://youtu.be/6SYBmg8O6Fg
Looks like your script will basically do what I need by the looks of things. I expected a script would probably be the solution but the sight of code generally gives me the conniptions lol.
Thanks Brandon, huge help <3
What do you think of this?
For frontcam only, it works with bone manipulation, manipulating the head more than the body
https://lens.snapchat.com/9dcb28f547ef4c2c80d1b2366644025f?share_id=RUZDNzZD&locale=de_DE
That looks great Lukator :) also seems a very viable option. Would you be able to give me a quick rundown on the steps to do this bone manipulation as you have please?