公开(公告)号：US11749025B2

公开(公告)日：2023-09-05

申请号：US17478743

申请日：2021-09-17

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Michael Anthony Klug ,  Gholamreza Amayeh

IPC: G06V40/18 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06T7/60

CPC classification number: G06V40/197 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06T7/60 ,  G06V40/193 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0187 ,  G06T2207/30196

Abstract: Systems and methods for eye pose identification using features of an eye are described. Embodiments of the systems and methods can include segmenting an iris of an eye in the eye image to obtain pupillary and limbic boundaries of the eye, determining two angular coordinates (e.g., pitch and yaw) of an eye pose using the pupillary and limbic boundaries of the eye, identifying an eye feature of the eye (e.g., an iris feature or a scleral feature), determining a third angular coordinate (e.g., roll) of the eye pose using the identified eye feature, and utilizing the eye pose measurement for display of an image or a biometric application. In some implementations, iris segmentation may not be performed, and the two angular coordinates are determined from eye features.

公开(公告)号：US11636652B2

公开(公告)日：2023-04-25

申请号：US17453813

申请日：2021-11-05

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06T19/00 ,  G06T17/20 ,  G10L21/10 ,  G06T13/40 ,  G06V40/16 ,  G06V40/18 ,  G02B27/00 ,  G02B27/01

Abstract: Systems and methods for synthesizing an image of the face by a head-mounted device (HMD) are disclosed. The HMD may not be able to observe a portion of the face. The systems and methods described herein can generate a mapping from a conformation of the portion of the face that is not imaged to a conformation of the portion of the face observed. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.

公开(公告)号：US11460705B2

公开(公告)日：2022-10-04

申请号：US17391889

申请日：2021-08-02

Applicant: Magic Leap, Inc.

Inventor： Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Adrian Kaehler ,  Mark Baerenrodt ,  Eric Baerenrodt ,  Christopher M. Harrises ,  Tammy Sherri Powers

IPC: G02B27/01 ,  G01J3/02 ,  G01J3/42 ,  A61B5/1455 ,  A61B5/11 ,  A61B5/00 ,  G06F3/03 ,  G01J3/10 ,  G06F3/01 ,  G01J3/28 ,  G01J3/427 ,  G01N21/359 ,  G01N33/483 ,  F21V8/00 ,  G02B27/00

Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.

公开(公告)号：US20220245404A1

公开(公告)日：2022-08-04

申请号：US17719885

申请日：2022-04-13

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Gary R. Bradski ,  Vijay Badrinarayanan

IPC: G06K9/62 ,  G06N3/04 ,  G06N3/10 ,  G06K9/00 ,  G06F3/01 ,  G06V20/10 ,  G06V20/20 ,  G06V40/20 ,  G06T7/70 ,  G06F3/0346 ,  G06F3/04815 ,  G06N3/08 ,  G06T19/00

Abstract: Disclosed herein are examples of a wearable display system capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

公开(公告)号：US20220156995A1

公开(公告)日：2022-05-19

申请号：US17590724

申请日：2022-02-01

Applicant: Magic Leap, Inc.

Inventor： Christopher M. Harrises ,  Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Mark Baerenrodt ,  Adam Carl Wright ,  Adrian Kaehler

IPC: G06T11/60 ,  G02B27/01

Abstract: A display system comprises a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. The display area is at least partially transparent and is configured to provide a view of an ambient environment through the display area. The display device is configured to determine that a reflection of the user is within the user's field of view through the display area. After making this determination, augmented reality content is displayed in the display area with the augmented reality content augmenting the user's view of the reflection. In some embodiments, the augmented reality content may overlie on the user's view of the reflection, thereby allowing all or portions of the reflection to appear to be modified to provide a realistic view of the user with various modifications made to their appearance.

公开(公告)号：US11334765B2

公开(公告)日：2022-05-17

申请号：US17148249

申请日：2021-01-13

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Gary R. Bradski ,  Vijay Badrinarayanan

IPC: G06F3/01 ,  G06K9/62 ,  G06N3/04 ,  G06N3/10 ,  G06K9/00 ,  G06V20/10 ,  G06V20/20 ,  G06V40/20 ,  G06T7/70 ,  G06F3/0346 ,  G06F3/04815 ,  G06N3/08 ,  G06T19/00 ,  G06N7/00 ,  G06N5/02 ,  G06N5/00 ,  G06V10/44

Abstract: A wearable display system can be capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

公开(公告)号：US11288350B2

公开(公告)日：2022-03-29

申请号：US16870737

申请日：2020-05-08

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06F21/32 ,  G06V10/141 ,  G06V10/145 ,  G06V40/19 ,  G06V40/40 ,  G06V40/18

Abstract: Systems and methods for blue light adjustment with a wearable display system are provided. Embodiments of the systems and methods for blue light adjustment can include receiving an eye image of an eye exposed to an adjusted level of blue light; detecting a change in a pupillary response by comparison of the received eye image to a first image; determining that the pupillary response corresponds to a biometric characteristic of a human individual; and allowing access to a biometric application based on the pupillary response determination.

公开(公告)号：US20220026717A1

公开(公告)日：2022-01-27

申请号：US17391889

申请日：2021-08-02

Applicant: Magic Leap, Inc.

Inventor： Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Adrian Kaehler ,  Mark Baerenrodt ,  Eric Baerenrodt ,  Christopher M. Harrises ,  Tammy Sherri Powers

IPC: G02B27/01 ,  G01J3/02 ,  G01J3/42 ,  A61B5/1455 ,  A61B5/11 ,  A61B5/00 ,  G06F3/03 ,  G01J3/10 ,  G06F3/01 ,  G01J3/28 ,  G01J3/427 ,  G01N21/359 ,  G01N33/483 ,  F21V8/00

Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.

公开(公告)号：US20210278675A1

公开(公告)日：2021-09-09

申请号：US17326920

申请日：2021-05-21

Applicant: Magic Leap, Inc.

Inventor： Michael Anthony Klug ,  Adrian Kaehler

IPC: G02B27/01 ,  A61B3/10 ,  A61B3/113 ,  A61B3/14 ,  A61B3/12 ,  G02B27/00 ,  A61B5/11 ,  A61B5/00 ,  A61B5/16

Abstract: Examples of an imaging system for use with a head mounted display (HMD) are disclosed. The imaging system can include a forward-facing imaging camera and a surface of a display of the HMD can include an off-axis diffractive optical element (DOE) or hot mirror configured to reflect light to the imaging camera. The DOE or hot mirror can be segmented. The imaging system can be used for eye tracking, biometric identification, multiscopic reconstruction of the three-dimensional shape of the eye, etc.

公开(公告)号：US20210231959A1

公开(公告)日：2021-07-29

申请号：US17228362

申请日：2021-04-12

Applicant: Magic Leap, Inc.

Inventor： Nicole Elizabeth Samec ,  Adrian Kaehler

IPC: G02B27/01 ,  A61B3/14 ,  A61B3/113 ,  A61B3/16 ,  G06T19/00 ,  A61B3/10 ,  G16H40/63 ,  G16H40/67 ,  A61B5/145 ,  A61M21/02 ,  A61B3/00 ,  A61B3/12 ,  A61B5/361 ,  A61B5/369 ,  A61B5/398 ,  A61B5/1455 ,  A61B5/00 ,  A61B8/10 ,  A61B8/00 ,  A61B3/08 ,  A61B3/103 ,  A61F9/00 ,  G02B27/00 ,  A61B3/028 ,  A61B3/06 ,  A61B3/02 ,  A61B3/13 ,  G02B21/00 ,  A61B3/024

Abstract: One embodiment is directed to a system comprising a head-mounted member removably coupleable to the user's head; one or more electromagnetic radiation emitters coupled to the head-mounted member and configured to emit light with at least two different wavelengths toward at least one of the eyes of the user; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering at least one blood vessel of the eye; and a controller operatively coupled to the one or more electromagnetic radiation emitters and detectors and configured to cause the one or more electromagnetic radiation emitters to emit pulses of light while also causing the one or more electromagnetic radiation detectors to detect levels of light absorption related to the emitted pulses of light, and to produce an output that is proportional to an oxygen saturation level in the blood vessel.