mapping my face on a 3d figure?

Hi El!

Yep this is possible!

It might be useful to first take a look at Face Image Picker (https://lensstudio.snapchat.com/templates/world/face-image-picker/). It's pretty similar to what we're trying to get, but instead of getting it from the camera feed we get it from the user's camera roll--which will allow the users to try different faces. If this works for you then all you have to do is move the face mesh to where you want it to be. 

To get a still image of the user's face, we'll need a couple things. First we want to use the Face Image Texture so we can extract the camera feed centered on the user's face:

Next, we can go into it's Inspector panel and set its input to the Device Camera Texture

If you apply this texture to a mesh you can see the user's live face on your mesh.

However, since only one phone camera can be active at a time (we can't both have front and world camera active), we need to save a frame from the live feed. 

What we want to do next is render the texture onto a virtual camera. So create an orthographic camera and a billboard which uses the Face Texture

Now all we need to do is render the texture from this camera!

I grabbed the FACE_GEO mesh from the Face Image Picker template, and then created a new unlit material which has the output texture from the orthographic camera we just made. 

To "take a picture" of the virtual camera, all you have to do is disable the virtual camera!

// Set to be called on tap

// @input Component.Camera camera
script.camera.enabled = !script.camera.enabled;

Here's the example project to help you get started.

Hope this helps! Can't wait to see the final result :)

Cheers,

Jon

--

Hi Dominique!

I think what you're asking for is slightly different. To do this, check out Amir's guide on how to connect BlendShapes to the user's face! https://lensstudio.zendesk.com/hc/en-us/community/posts/360042675692-BlendShape-Example

Cheers,

Jon