-
公开(公告)号:US20190114480A1
公开(公告)日:2019-04-18
申请号:US16223611
申请日:2018-12-18
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Michael Anthony Klug , Gholamreza Amayeh
Abstract: Systems and methods for eye pose identification using features of an eye are described. Embodiments of the systems and methods can include segmenting an iris of an eye in the eye image to obtain pupillary and limbic boundaries of the eye, determining two angular coordinates (e.g., pitch and yaw) of an eye pose using the pupillary and limbic boundaries of the eye, identifying an eye feature of the eye (e.g., an iris feature or a scleral feature), determining a third angular coordinate (e.g., roll) of the eye pose using the identified eye feature, and utilizing the eye pose measurement for display of an image or a biometric application. In some implementations, iris segmentation may not be performed, and the two angular coordinates are determined from eye features.
-
公开(公告)号:US20190087659A1
公开(公告)日:2019-03-21
申请号:US16194688
申请日:2018-11-19
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Gary Bradski
IPC: G06K9/00 , H04N13/398 , H04N13/344 , H04N5/232 , G06T7/11 , G01S3/00
Abstract: Methods and devices for estimating position of a device within a 3D environment are described. Embodiments of the methods include sequentially receiving multiple image segments forming an image representing a field of view (FOV) comprising a portion of the environment. The image includes multiple sparse points that are identifiable based in part on a corresponding subset of image segments of the multiple image segments. The method also includes sequentially identifying one or more sparse points of the multiple sparse points when each subset of image segments corresponding to the one or more sparse points is received and estimating a position of the device in the environment based on the identified the one or more sparse points.
-
公开(公告)号:US20190065722A1
公开(公告)日:2019-02-28
申请号:US16170915
申请日:2018-10-25
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
-
公开(公告)号:US20190034765A1
公开(公告)日:2019-01-31
申请号:US15994599
申请日:2018-05-31
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Gary Bradski , Vijay Badrinarayanan
Abstract: Disclosed herein are examples of a wearable display system capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.
-
公开(公告)号:US20190034692A1
公开(公告)日:2019-01-31
申请号:US16146228
申请日:2018-09-28
Applicant: Magic Leap, Inc.
Inventor: Gholamreza Amayeh , Adrian Kaehler
IPC: G06K9/00
Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
-
公开(公告)号:US20180336332A1
公开(公告)日:2018-11-22
申请号:US15982844
申请日:2018-05-17
Applicant: Magic Leap, Inc.
Inventor: Nitin Singh , Adrian Kaehler
Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.
-
公开(公告)号:US10127369B2
公开(公告)日:2018-11-13
申请号:US15449780
申请日:2017-03-03
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.
-
公开(公告)号:US20180157398A1
公开(公告)日:2018-06-07
申请号:US15829249
申请日:2017-12-01
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
IPC: G06F3/0481 , G06T19/00 , G06F3/01 , G06K9/46 , G06N3/02
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
公开(公告)号:US20180089834A1
公开(公告)日:2018-03-29
申请号:US15605567
申请日:2017-05-25
Applicant: Magic Leap, Inc.
Inventor: Alexey Spizhevoy , Adrian Kaehler , Vijay Badrinarayanan
CPC classification number: G06T7/10 , G06K9/0061 , G06K9/00617 , G06K9/036 , G06K9/4628 , G06K9/4652 , G06K9/627 , G06T7/0002 , G06T7/11 , G06T7/12 , G06T7/194 , G06T2207/10024 , G06T2207/20076 , G06T2207/20081 , G06T2207/20084 , G06T2207/30041 , G06T2207/30168 , G06T2207/30196
Abstract: Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. The segmented eye image can include a background region, a sclera region, an iris region, or a pupil region. In another aspect, a convolutional neural network with a merged architecture can be trained for eye image segmentation and image quality estimation. In yet another aspect, the device can use the segmented eye image to determine eye contours such as a pupil contour and an iris contour. The device can use the eye contours to create a polar image of the iris region for computing an iris code or biometric authentication.
-
公开(公告)号:US20180081179A1
公开(公告)日:2018-03-22
申请号:US15713420
申请日:2017-09-22
Applicant: Magic Leap, Inc.
Inventor: Nicole Elizabeth Samec , Nastasja U. Robaina , Adrian Kaehler , Mark Baerenrodt , Eric Baerenrodt , Christopher M. Harrises , Tammy Sherri Powers
IPC: G02B27/01 , G06F3/01 , G01N21/359 , G01N33/483 , F21V8/00 , G01J3/427 , G01J3/28 , G01J3/10
Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.
-
-
-
-
-
-
-
-
-