Dear Lens Studio Community!
I'm testing out if I can track if a user is looking at the top or bottom of the screen.
The normal head/eye binding does not look at the direction or position of the pupil but the eye color effect does.
Is there a way to get the value's of the eye color tracking?
Thanks in advance!
What system are you using?
Have you downloaded the latest version of Lens Studio?
Is this issue causing Lens Studio to crash?
Version
Graphics
Attach a screenshot of the issue:
Name:
Email:
What is this most relevant to?
Please enter a brief description of your issue:
Unfortunately, it's likely due to the operating system or hardware you're using – since they don't meet the system requirements for Lens Studio.
Still, we hear you loud and clear, and are logging the issue in case there's ever a workaround we can provide!
Minimum Requirements
Operating System: Windows 10 (64 bit); MacOS 10.11+
Hardware: Minimum of Intel Core i3 2.5Ghz or AMD Phenom II 2.6Ghz with 4 GB RAM; Intel HD Graphics 4000 / Nvidia GeForce 710 / AMD Radeon HD 6450 or better; screen resolution of 1280x768 or higher
Keep an eye out for a followup email from us. We may have a couple more questions for you, or we might already have a solution to offer.
Happy creating!
Hey Simon,
It's currently not possible to receive the tracking data for the eyes. That being said, consider adding a face sprite and positioning it to the eye via the dropdown (left or right - both should work). Then you can track the sprite's position to see if it moved up or down (indicating looking up or down).
Cheers,
Kaitlyn
Hi Kaitlyn,
Thanks for the response!
Unfortunately what I would like to do is cross reference the eye tracking with the head tracking so even if the head or the phone moves up or down, the value that the eye tracking gives is consistent.
Is it an idea the do a feature request to be able to reach the same position value's the 'eye color' effect is getting?
Hey Simon,
As for cross referencing with the head, you can add another head binding to the middle of the face and compare the eye positions to that using math like this:
function getLocalOffset(objA, objB){
var trA = objA.getTransform();
var trB = objB.getTransform();
var matrixA = trA.getInvertedWorldTransform();
return matrixA.multiplyPoint(trB.getWorldPosition());
}
But the math does get tricky get cumbersome when you try to make it relative.
In the meantime I can definitely let the engineers know you'd like to track eye position as done in the "eye color" effect and inform when/if this feature is available.
Cheers,
Kaitlyn