The forum on this site is closed for new comments and posts. Continue the conversation in our Snap AR Discord server.

The Matrix - LiDAR based lens

Follow
Avatar
Denis Rossiev
Snap Lens Network Member Lens Studio Team

Last week I've been playing with LiDAR sensor on iPhone 12 Pro and developed this! https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=482fdcadbcc54c189aa88df162f139c3&metadata=01

The hardest part was texturing: LiDAR mesh doesn't have any UV so you can't just apply a texture to it. So I had to generate UV on-the-fly using projections.

If you have iPhone 12 Pro (Pro Max) or new iPad Pro, it will work nice:

I also added fallback for older devices. If there is no LiDAR, effect uses ground segmentation:

And this is how auto-UV looks like:

Try it now:

1
  • Avatar
    trendalmamlkah
    Snap Lens Network Member Lens Studio Team

    cool

    Comment actions Permalink
  • Avatar
    SirQu3ntin
    Snap Lens Network Member Lens Studio Team

    Very cool, and congrats to OLC :D

     

    Cheers,

    SirQu3ntin

    Comment actions Permalink
  • Avatar
    Permanently deleted user
    Snap Lens Network Member Lens Studio Team

    Hi, could you share how to get the UV based on the lidar mesh? Thanks!

    Comment actions Permalink
  • Avatar
    fncischen
    Snap Lens Network Member Lens Studio Team

    love this!

    Comment actions Permalink

We're here to help! We just need a little bit of information...

What system are you using?

Have you downloaded the latest version of Lens Studio?

Please download the latest version of Lens Studio. If you still run into this issue, please come back and report it!

Is this issue causing Lens Studio to crash?

What system do you run Lens Studio on?

Version

Graphics

Follow the next steps to help us solve your issue:

  • Copy and paste this text into your TerminalCommand Window
    open ~/Library/Preferences/Snap/Lens\ Studio/ %LOCALAPPDATA%\Snap\Lens Studio Copy Text
  • Press ReturnEnter to run the command. The Lens Studio folder will automatically open
  • Prepare to upload your files: zip the "Log" Folder by right-clicking and choosing "compress."
    Locate the Log.txt file right above it.

    Attach a screenshot of the issue:

Name:

Email:

What is this most relevant to?

Please enter a brief description of your issue:

Thanks for submitting this issue.

Unfortunately, it's likely due to the operating system or hardware you're using – since they don't meet the system requirements for Lens Studio.

Still, we hear you loud and clear, and are logging the issue in case there's ever a workaround we can provide!

Minimum Requirements

Operating System: Windows 10 (64 bit); MacOS 10.11+

Hardware: Minimum of Intel Core i3 2.5Ghz or AMD Phenom II 2.6Ghz with 4 GB RAM; Intel HD Graphics 4000 / Nvidia GeForce 710 / AMD Radeon HD 6450 or better; screen resolution of 1280x768 or higher

We'll try to resolve this issue as soon as possible. Thanks for letting us know about it!

Keep an eye out for a followup email from us. We may have a couple more questions for you, or we might already have a solution to offer.

Happy creating!

Back
Next Next Next Submit Issue Got It