Record character mocap and play it in world lens

Permanently deleted user

Snap Lens Network Member Lens Studio Team

July 13, 2021 16:33

Hello, I was wondering whether the following features are built inside the lens studio.

Record the animation of full-body tracking character
Save the character's movement, make it as an object, and make it available for the back camera world lens.

So it would be like a barracuda and BVH recorder in Unity allowing the creator to easily make an animation and play the character animation in the real world.

If anyone has some idea about how to realize this, I'd appreciate it.

Permanently deleted user
Snap Lens Network Member Lens Studio Team

July 13, 2021 16:42
That's a great idea!

I am not sure if this can be done by using a workaround atm.

But I agree with you and I would 100% create Lenses using this technique!
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

July 14, 2021 15:07
This is not available out of the box, but it may be doable with scripting. You should be able to save all the bone rotations/positions of the full-body tracking character and then loop through those saved values.
Comment actions Permalink
Permanently deleted user
Snap Lens Network Member Lens Studio Team

July 15, 2021 14:12
Thank you modelsbymike3d for the tip.

I did not know that recording the motions is possible via script. Are there any links you encountered that deal with this?

Maybe saving the selection position every millis and storing each of them in the array, then go through that arrays is the way to implement replay of the recording?
Comment actions Permalink
modelsbymike3d
Snap Lens Network Member Lens Studio Team

July 15, 2021 15:16
There are no links or examples that I know of. Here is a rough overview of the process.
1. Make sure your final character and whatever model you use for the 3D body tracking are rigged in the same manner (same bones etc)
2. Add a 3D model for the body tracking. You can make it invisible with a transparent material or possibly stick it on a non-rendered layer.
3. When the user triggers the recording (by tapping a button or whatever you want), store the position and rotation (for example getTransform().getLocalRotation()) and save those to an array every frame.
4. When the user switches to the back camera, loop through the array on every frame update and set the positions and rotations of your character bones.
Comment actions Permalink
Permanently deleted user
Snap Lens Network Member Lens Studio Team

July 15, 2021 15:26
Thank you so much modelsbymike3d for the amazing tip.

I'll try this out!
Comment actions Permalink

Record character mocap and play it in world lens

We're here to help! We just need a little bit of information...

What system do you run Lens Studio on?

Follow the next steps to help us solve your issue:

Thanks for submitting this issue.

We'll try to resolve this issue as soon as possible. Thanks for letting us know about it!