公开(公告)号：US11100692B2

公开(公告)日：2021-08-24

申请号：US16780698

申请日：2020-02-03

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Gary Bradski ,  Vijay Badrinarayanan

IPC: G06T11/60 ,  G06K9/00 ,  G06K9/46 ,  G02B27/01 ,  G06T3/20

Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.

公开(公告)号：US11079598B2

公开(公告)日：2021-08-03

申请号：US16775123

申请日：2020-01-28

Applicant: Magic Leap, Inc.

Inventor： Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Adrian Kaehler ,  Mark Baerenrodt ,  Eric Baerenrodt ,  Christopher M. Harrises ,  Tammy Sherri Powers

IPC: G02B27/01 ,  G01J3/02 ,  G01J3/42 ,  A61B5/1455 ,  A61B5/11 ,  A61B5/00 ,  G06F3/03 ,  G01J3/10 ,  G06F3/01 ,  G01J3/28 ,  G01J3/427 ,  G01N21/359 ,  G01N33/483 ,  F21V8/00 ,  G02B27/00

Abstract: In some embodiments, a system comprises a head-mounted frame removably coupleable to the user's head; one or more light sources coupled to the head-mounted frame and configured to emit light with at least two different wavelengths toward a target object in an irradiation field of view of the light sources; one or more electromagnetic radiation detectors coupled to the head-mounted member and configured to receive light reflected after encountering the target object; and a controller operatively coupled to the one or more light sources and detectors and configured to determine and display an output indicating the identity or property of the target object as determined by the light properties measured by the detectors in relation to the light properties emitted by the light sources.

公开(公告)号：US10955662B2

公开(公告)日：2021-03-23

申请号：US15982844

申请日：2018-05-17

Applicant: Magic Leap, Inc.

Inventor： Nitin Singh ,  Adrian Kaehler

IPC: G06F21/32 ,  H04W4/80 ,  G02B27/00 ,  G02B27/01 ,  H04W8/00 ,  G06K9/00 ,  H04M1/60 ,  G06F21/44 ,  H04W12/00 ,  H04L29/06 ,  H04W12/06 ,  H04B1/3827 ,  G02B6/34 ,  F21V8/00

Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.

公开(公告)号：US20210073845A1

公开(公告)日：2021-03-11

申请号：US17099057

申请日：2020-11-16

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06Q30/02 ,  G06K9/00 ,  G06F21/32

Abstract: Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.

公开(公告)号：US20200293744A1

公开(公告)日：2020-09-17

申请号：US16889536

申请日：2020-06-01

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06K9/00 ,  G02B27/01

Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).

公开(公告)号：US10607609B2

公开(公告)日：2020-03-31

申请号：US15673894

申请日：2017-08-10

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Sommers ,  Jennifer M. R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  G06F17/24 ,  G06F17/28 ,  G06K9/00 ,  G10L25/84 ,  G10L15/18 ,  H04N7/15 ,  G10L15/08

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20200092538A1

公开(公告)日：2020-03-19

申请号：US16694606

申请日：2019-11-25

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: H04N13/393 ,  G02B27/22 ,  G09G3/00 ,  H04N13/307 ,  H04N13/32 ,  H04N13/324 ,  H04N13/398

Abstract: Apparatuses and methods for displaying a 3-D representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. The apparatuses can store a light field image to be displayed, the light field image providing multiple different views of the object at different viewing directions. A processor can drive the motor to rotate the rotatable structure and map the light field image to each of the light field sub-displays based in part on the rotation angle, and illuminate the light field sub-displays based in part on the mapped light field image. The apparatuses can include a display panel configured to be viewed from a fiducial viewing direction, where the display panel is curved out of a plane that is perpendicular to the fiducial viewing direction, and a plurality of light field sub-displays disposed on the display panel.

公开(公告)号：US10534954B2

公开(公告)日：2020-01-14

申请号：US15611398

申请日：2017-06-01

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06K9/00 ,  G06K9/62 ,  G06T19/00

Abstract: An augmented reality device (ARD) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ARD can detect a linkage between a person in the FOV of the ARD and a physical object (e.g., a document presented by the person) or detect linkages between the documents. The linkages may be used in identity verification or document verification.

公开(公告)号：US10445881B2

公开(公告)日：2019-10-15

申请号：US15605567

申请日：2017-05-25

Applicant: Magic Leap, Inc.

Inventor： Alexey Spizhevoy ,  Adrian Kaehler ,  Vijay Badrinarayanan

IPC: G06T7/00 ,  G06T7/10 ,  G06K9/00 ,  G06T7/12 ,  G06T7/194 ,  G06T7/11 ,  G06K9/03 ,  G06K9/46 ,  G06K9/62

Abstract: Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. The segmented eye image can include a background region, a sclera region, an iris region, or a pupil region. In another aspect, a convolutional neural network with a merged architecture can be trained for eye image segmentation and image quality estimation. In yet another aspect, the device can use the segmented eye image to determine eye contours such as a pupil contour and an iris contour. The device can use the eye contours to create a polar image of the iris region for computing an iris code or biometric authentication.

公开(公告)号：US10378930B2

公开(公告)日：2019-08-13

申请号：US15824777

申请日：2017-11-28

Applicant: MAGIC LEAP, INC.

Inventor： Adrian Kaehler

IPC: G02B6/00 ,  G01D5/26 ,  G02B6/10 ,  G02B27/01

Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.