Plane detection in world tracking mode

  • LiDAR enabled devices can detect multiple surfaces. But for widespread support you are limited to tracking just the ground or other horizontal surfaces (only with the rear camera).

    The easiest way to add this is to add the "World Object Controller" which is found in the Helper Scripts section if you are adding something to the Objects Panel. This will add the script and some example objects to your scene. Once added, select the script and set the device tracking input and you should be good to start playing around with it.

    Example template: https://lensstudio.snapchat.com/templates/interactive/animated-object-2021/

    Comment actions Permalink
  • Thanks! If I'm not mistaken, this is intended for attaching to a single horizontal plane. Rather, I would like to be able to track all horizontal planes. I've managed to do this using the raw events (there are 3 plane events, two of which are completely undocumented but do exist). 

    One problem is that there is no way to raycast against planes. I can write my own quad/ray intersection test for planes approximated as a rectangle but the estimated plane geometry is not accessible (there appears to be no way to extract vertices from a provided mesh). 

    Is there some other intended workflow for this?

    Comment actions Permalink
  • Hi Bart,

    I was wondering, because of your name, if you are based in Belgium or the Netherlands?

    I'm based there too and always good to connect with local creators :)

    Best,

    Bruno

    Comment actions Permalink
  • Hi Bruno,

    I heard the name Bart is quite common in that part of the world :) But alas, I am located in the US (Nevada). That said, I may be visiting the Netherlands next summer!

    Re: planes, I discovered that plane detection does work in world tracking mode and that one needs to subscribe to the plane update events (which are essentially undocumented).

    Bart

    Comment actions Permalink
Have a comment?

Please sign in to leave a comment.

We're here to help! We just need a little bit of information...

What system are you using?

Have you downloaded the latest version of Lens Studio?

Please download the latest version of Lens Studio. If you still run into this issue, please come back and report it!

Is this issue causing Lens Studio to crash?

What system do you run Lens Studio on?

Version

Graphics

Follow the next steps to help us solve your issue:

  • Copy and paste this text into your TerminalCommand Window
    open ~/Library/Preferences/Snap/Lens\ Studio/ %LOCALAPPDATA%\Snap\Lens Studio Copy Text
  • Press ReturnEnter to run the command. The Lens Studio folder will automatically open
  • Prepare to upload your files: zip the "Log" Folder by right-clicking and choosing "compress."
    Locate the Log.txt file right above it.

    Attach a screenshot of the issue:

Name:

Email:

What is this most relevant to?

Please enter a brief description of your issue:

Thanks for submitting this issue.

Unfortunately, it's likely due to the operating system or hardware you're using – since they don't meet the system requirements for Lens Studio.

Still, we hear you loud and clear, and are logging the issue in case there's ever a workaround we can provide!

Minimum Requirements

Operating System: Windows 10 (64 bit); MacOS 10.11+

Hardware: Minimum of Intel Core i3 2.5Ghz or AMD Phenom II 2.6Ghz with 4 GB RAM; Intel HD Graphics 4000 / Nvidia GeForce 710 / AMD Radeon HD 6450 or better; screen resolution of 1280x768 or higher

We'll try to resolve this issue as soon as possible. Thanks for letting us know about it!

Keep an eye out for a followup email from us. We may have a couple more questions for you, or we might already have a solution to offer.

Happy creating!