公开(公告)号：US11022797B2

公开(公告)日：2021-06-01

申请号：US15072341

申请日：2016-03-16

Applicant: Magic Leap Inc.

Inventor： Nicole Elizabeth Samec ,  Adrian Kaehler

IPC: A61B5/1455 ,  G02B27/01 ,  A61B3/14 ,  A61B3/113 ,  A61B3/16 ,  G06T19/00 ,  A61B3/10 ,  G16H40/63 ,  G16H40/67 ,  A61B5/145 ,  A61M21/02 ,  A61B3/00 ,  A61B3/12 ,  A61B5/361 ,  A61B5/369 ,  A61B5/398 ,  A61B5/00 ,  A61B8/10 ,  A61B8/00 ,  A61B3/08 ,  A61B3/103 ,  A61F9/00 ,  G02B27/00 ,  A61B3/028 ,  A61B3/06 ,  A61B3/02 ,  A61B3/13 ,  G02B21/00 ,  A61B3/024 ,  A61B5/01 ,  A61M21/00 ,  G02C7/02 ,  A61F7/00 ,  A61N5/06 ,  A61F9/008

Abstract: One embodiment is directed to a system comprising a head-mounted member removably coupleable to the user's head; one or more electromagnetic radiation emitters coupled to the head-mounted member and configured to emit light with at least two different wavelengths toward at least one of the eyes of the user; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering at least one blood vessel of the eye; and a controller operatively coupled to the one or more electromagnetic radiation emitters and detectors and configured to cause the one or more electromagnetic radiation emitters to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light, and to produce an output that is proportional to an oxygen saturation level in the blood vessel.

公开(公告)号：US20210080321A1

公开(公告)日：2021-03-18

申请号：US16982426

申请日：2019-03-21

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Christopher M. Harrises ,  Eric Baerenrodt ,  Mark Baerenrodt ,  Nastasja U. Robaina ,  Nicole Elizabeth Samec ,  Tammy Sherri Powers ,  Ivan Li Chuen Yeoh ,  Adam Carl Wright

IPC: G01J3/02 ,  G06F3/01 ,  G09G5/37 ,  G01J3/42 ,  G01N21/27 ,  G01N21/25 ,  G02B27/01 ,  F21V8/00

Abstract: Wearable spectroscopy systems and methods for identifying one or more characteristics of a target object are described. Spectroscopy systems may include a light source configured to emit light in an irradiated field of view and an electromagnetic radiation detector configured to receive reflected light from a target object irradiated by the light source. One or more processors of the systems may identify a characteristic of the target object based on a determined level of light absorption by the target object. Some systems and methods may include one or more corrections for scattered and/or ambient light such as applying an ambient light correction, passing the reflected light through an anti-scatter grid, or using a time-dependent variation in the emitted light.

公开(公告)号：US10922393B2

公开(公告)日：2021-02-16

申请号：US15497927

申请日：2017-04-26

Applicant: Magic Leap, Inc.

Inventor： Alexey Spizhevoy ,  Adrian Kaehler ,  Gary Bradski

IPC: G06K9/00 ,  G06F21/32 ,  G06N3/04 ,  G06N3/08 ,  G06N7/00

Abstract: Systems and methods for iris authentication are disclosed. In one aspect, a deep neural network (DNN) with a triplet network architecture can be trained to learn an embedding (e.g., another DNN) that maps from the higher dimensional eye image space to a lower dimensional embedding space. The DNN can be trained with segmented iris images or images of the periocular region of the eye (including the eye and portions around the eye such as eyelids, eyebrows, eyelashes, and skin surrounding the eye). With the triplet network architecture, an embedding space representation (ESR) of a person's eye image can be closer to the ESRs of the person's other eye images than it is to the ESR of another person's eye image. In another aspect, to authenticate a user as an authorized user, an ESR of the user's eye image can be sufficiently close to an ESR of the authorized user's eye image.

公开(公告)号：US20200272720A1

公开(公告)日：2020-08-27

申请号：US16870737

申请日：2020-05-08

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06F21/32 ,  G06K9/00 ,  G06K9/20

Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.

公开(公告)号：US20200250872A1

公开(公告)日：2020-08-06

申请号：US16780698

申请日：2020-02-03

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Gary Bradski ,  Vijay Badrinarayanan

IPC: G06T11/60 ,  G06K9/46 ,  G06K9/00 ,  G06T3/20 ,  G02B27/01

Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.

公开(公告)号：US20200226830A1

公开(公告)日：2020-07-16

申请号：US16721625

申请日：2019-12-19

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06T17/20 ,  G10L21/10 ,  G06T13/40 ,  G06K9/00 ,  G02B27/00 ,  G02B27/01

Abstract: Systems and methods for synthesizing an image of the face by a head-mounted device (HMD) are disclosed. The HMD may not be able to observe a portion of the face. The systems and methods described herein can generate a mapping from a conformation of the portion of the face that is not imaged to a conformation of the portion of the face observed. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.

公开(公告)号：US10664582B2

公开(公告)日：2020-05-26

申请号：US16170915

申请日：2018-10-25

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06K9/00 ,  G06F21/32 ,  G06K9/20

Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.

公开(公告)号：US10558047B2

公开(公告)日：2020-02-11

申请号：US15713420

申请日：2017-09-22

Applicant: Magic Leap, Inc.

Inventor： Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Adrian Kaehler ,  Mark Baerenrodt ,  Eric Baerenrodt ,  Christopher M. Harrises ,  Tammy Sherri Powers

IPC: G02B27/01 ,  G01J3/10 ,  G01J3/28 ,  G01J3/427 ,  G01N21/359 ,  G01N33/483 ,  F21V8/00 ,  G06F3/01 ,  G01J3/42

Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.

公开(公告)号：US20200018973A1

公开(公告)日：2020-01-16

申请号：US16584554

申请日：2019-09-26

Applicant: Magic Leap, Inc.

Inventor： Michael Anthony Klug ,  Adrian Kaehler

IPC: G02B27/01 ,  A61B3/113 ,  A61B3/14 ,  A61B3/12 ,  G02B27/00 ,  A61B5/11 ,  A61B5/00 ,  A61B5/16 ,  A61B3/10

Abstract: Examples of an imaging system for use with a head mounted display (HMD) are disclosed. The imaging system can include a forward-facing imaging camera and a surface of a display of the HMD can include an off-axis diffractive optical element (DOE) or hot mirror configured to reflect light to the imaging camera. The DOE or hot mirror can be segmented. The imaging system can be used for eye tracking, biometric identification, multiscopic reconstruction of the three-dimensional shape of the eye, etc.

公开(公告)号：US20200005462A1

公开(公告)日：2020-01-02

申请号：US16570418

申请日：2019-09-13

Applicant: Magic Leap, Inc.

Inventor： Alexey Spizhevoy ,  Adrian Kaehler ,  Vijay Badrinarayanan

IPC: G06T7/10 ,  G06K9/00 ,  G06T7/00

Abstract: Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. The segmented eye image can include a background region, a sclera region, an iris region, or a pupil region. In another aspect, a convolutional neural network with a merged architecture can be trained for eye image segmentation and image quality estimation. In yet another aspect, the device can use the segmented eye image to determine eye contours such as a pupil contour and an iris contour. The device can use the eye contours to create a polar image of the iris region for computing an iris code or biometric authentication.