Replace Camera Input & Tracking
Wondering if it's possible to replace the input of the camera and tracking features, so that I could use a video instead of the live camera. Replacing the camera texture doesn't appear to affect the tracking.
Ultimately I would to be able to track and replace the face in a video, potentially also with the new image picker, or the live face.
Does that sound possible?
Hi Tom, at this time this is not possible as you've suggested. We're investigating ways to make the "face in video" use case easier. Basically, the ability to easily import a video and replace the face with the live face (or face image picker) as you've suggested. Know it's an area we're interested in improving. But at this time, it's not possible just using Lens studio.
The way to accomplish this now is to create a 3D animation that moves a mesh (like the Face Mesh found in the Face Image Picker template). And this 3D animation is keyed to the background video you'll be imported. Then, you just need to play them at the same time / make sure they are lined up.
yo Travis, thanks will try tracking some footage and then hooking up a mesh to it, see if it works!