公开(公告)号：US20250157108A1

公开(公告)日：2025-05-15

申请号：US19022825

申请日：2025-01-15

Applicant: Magic Leap, Inc.

Inventor： Christopher M. Harrises ,  Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Mark Baerenrodt ,  Adam Carl Wright ,  Adrian Kaehler

IPC: G06T11/60 ,  G02B27/01 ,  G06T19/00

Abstract: A display system includes a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. The display area is at least partially transparent and is configured to provide a view of an ambient environment through the display area. The display device is configured to determine that a reflection of the user is within the user's field of view through the display area. After making this determination, augmented reality content is displayed in the display area with the augmented reality content augmenting the user's view of the reflection. In some embodiments, the augmented reality content may overlie on the user's view of the reflection, thereby allowing all or portions of the reflection to appear to be modified to provide a realistic view of the user with various modifications made to their appearance.

公开(公告)号：US12204111B2

公开(公告)日：2025-01-21

申请号：US18345396

申请日：2023-06-30

Applicant: Magic Leap, Inc.

Inventor： Gholamreza Amayeh ,  Adrian Kaehler ,  Douglas Lee

IPC: G02B27/01 ,  G02B27/00 ,  G06V20/64 ,  G06V40/16 ,  G06V40/19

Abstract: Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. The images obtained by the eye cameras may be analyzed using a stereoscopic vision technique, a monocular vision technique, or a combination, to generate a face model for the user.

公开(公告)号：US12192437B2

公开(公告)日：2025-01-07

申请号：US17508798

申请日：2021-10-22

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: H04N13/393 ,  G02B30/27 ,  G02B30/54 ,  G02B30/56 ,  G09G3/00 ,  H04N13/307 ,  H04N13/32 ,  H04N13/324 ,  H04N13/398

Abstract: Apparatuses and methods for displaying a 3-D representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. The apparatuses can store a light field image to be displayed, the light field image providing multiple different views of the object at different viewing directions. A processor can drive the motor to rotate the rotatable structure and map the light field image to each of the light field sub-displays based in part on the rotation angle, and illuminate the light field sub-displays based in part on the mapped light field image. The apparatuses can include a display panel configured to be viewed from a fiducial viewing direction, where the display panel is curved out of a plane that is perpendicular to the fiducial viewing direction, and a plurality of light field sub-displays disposed on the display panel.

公开(公告)号：US12105282B2

公开(公告)日：2024-10-01

申请号：US18493113

申请日：2023-10-24

Applicant: Magic Leap, Inc.

Inventor： Nitin Singh ,  Adrian Kaehler

IPC: G02B27/00 ,  G02B27/01 ,  G06F21/32 ,  G06F21/44 ,  G06V20/80 ,  H04L9/40 ,  H04M1/60 ,  H04W4/80 ,  H04W8/00 ,  H04W12/065 ,  H04W12/069 ,  H04W12/50 ,  H04W12/77 ,  F21V8/00 ,  G02B6/34 ,  H04B1/3827

CPC classification number: G02B27/0093 ,  G02B27/017 ,  G06F21/32 ,  G06F21/44 ,  G06V20/80 ,  H04L63/0861 ,  H04L63/18 ,  H04M1/6066 ,  H04W4/80 ,  H04W8/005 ,  H04W12/065 ,  H04W12/069 ,  H04W12/50 ,  H04W12/77 ,  G02B6/0016 ,  G02B6/34 ,  G02B2027/0125 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0181 ,  H04B2001/3866

Abstract: This disclosure describes techniques for device authentication and/or pairing. A display system can comprise a head mountable display, computer memory, and processor(s). In response to receiving a request to authenticate a connection between the display system and a companion device (e.g., controller or other computer device), first data may be determined, the first data based at least partly on audio data spoken by a user. The first data may be sent to an authentication device configured to compare the first data to second data received from the companion device, the second data based at least partly on the audio data. Based at least partly on a correspondence between the first and second data, the authentication device can send a confirmation to the display system to permit communication between the display system and companion device.

公开(公告)号：US11835717B2

公开(公告)日：2023-12-05

申请号：US17179110

申请日：2021-02-18

Applicant: Magic Leap, Inc.

Inventor： Nitin Singh ,  Adrian Kaehler

IPC: G02B27/00 ,  G06F21/32 ,  G02B27/01 ,  H04W4/80 ,  H04W8/00 ,  H04M1/60 ,  G06F21/44 ,  H04L9/40 ,  H04W12/50 ,  H04W12/065 ,  H04W12/069 ,  H04W12/77 ,  G06V20/80 ,  H04B1/3827 ,  G02B6/34 ,  F21V8/00

CPC classification number: G02B27/0093 ,  G02B27/017 ,  G06F21/32 ,  G06F21/44 ,  G06V20/80 ,  H04L63/0861 ,  H04L63/18 ,  H04M1/6066 ,  H04W4/80 ,  H04W8/005 ,  H04W12/065 ,  H04W12/069 ,  H04W12/50 ,  H04W12/77 ,  G02B6/0016 ,  G02B6/34 ,  G02B2027/014 ,  G02B2027/0125 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B2027/0181 ,  H04B2001/3866

Abstract: Disclosed herein are systems and methods for device authentication or pairing. In an aspect, a wearable display system comprises a display, an image capture device configured to capture images of a companion device, a computer-readable storage medium configured to store the images of the companion device, and a processor in communication with the image capture device and the storage medium. The processor can be programmed with executable instructions to receive a first image of a first optical pattern displayed by the companion device captured by the image capture device, wherein the first optical pattern is generated by the companion device based on first shared data, extract first data from the first optical pattern in the received first image, authenticate the companion device based on the first data extracted from the first optical pattern, and notify a user of the wearable display system that the companion device is authenticated.

公开(公告)号：US20230315250A1

公开(公告)日：2023-10-05

申请号：US18331308

申请日：2023-06-08

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  John Adam Croston

IPC: G06F3/04815 ,  G06T19/00 ,  G06N3/02 ,  G06F3/01 ,  G06N20/00 ,  G06V10/46 ,  G06V20/20 ,  G06V40/10

CPC classification number: G06F3/04815 ,  G06T19/006 ,  G06N3/02 ,  G06F3/017 ,  G06N20/00 ,  G06V10/464 ,  G06V20/20 ,  G06V40/107

Abstract: A wearable display system includes a mixed reality display for presenting a virtual image to a user, an outward-facing imaging system configured to image an environment of the user, and a hardware processor operably coupled to the mixed reality display and to the imaging system. The hardware processor is programmed to generate a virtual remote associated with a parent device, render the virtual remote and the virtual control element on the mixed reality display, determine when the user of the wearable system interacts with the virtual control element of the virtual remote, and perform certain functions in response to user interaction with a virtual control element of the virtual remote. These functions may include generation the virtual control element to move on the mixed reality display; and when movement of the virtual control element surpasses a threshold condition, generate a focus indicator for the virtual control element.

公开(公告)号：US11630314B2

公开(公告)日：2023-04-18

申请号：US17719885

申请日：2022-04-13

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Gary R. Bradski ,  Vijay Badrinarayanan

IPC: G06F3/01 ,  G02B27/01 ,  G06N3/10 ,  G06V20/10 ,  G06V20/20 ,  G06V40/20 ,  G06F18/214 ,  G06F18/00 ,  G06N3/044 ,  G06N3/045 ,  G06N3/048 ,  G06T7/70 ,  G06F3/0346 ,  G06F3/04815 ,  G06N3/08 ,  G06T19/00 ,  G06N5/025 ,  G06V10/44 ,  G06N3/047 ,  G06N5/01 ,  G06N7/01

Abstract: An example wearable display system can be capable of determining a user interface (UI) event with respect to a virtual UI device (e.g., a button) and a pointer (e.g., a finger or a stylus) using a neural network. The wearable display system can render a representation of the UI device onto an image of the pointer captured when the virtual UI device is shown to the user and the user uses the pointer to interact with the virtual UI device. The representation of the UI device can include concentric shapes (or shapes with similar or the same centers of gravity) of high contrast. The neural network can be trained using training images with representations of virtual UI devices and pointers.

公开(公告)号：US20230087868A1

公开(公告)日：2023-03-23

申请号：US17958273

申请日：2022-09-30

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler ,  Christopher M. Harrises ,  Eric Baerenrodt ,  Mark Baerenrodt ,  Natasja U. Robaina ,  Nicole Elizabeth Samec ,  Tammy Sherri Powers ,  Ivan Li Chuen Yeoh ,  Adam Carl Wright

IPC: G01J3/02 ,  G01J3/42 ,  G01N21/25 ,  G01N21/27 ,  F21V8/00 ,  G02B27/01 ,  G06F3/01 ,  G09G5/37

Abstract: Wearable spectroscopy systems and methods for identifying one or more characteristics of a target object are described. Spectroscopy systems may include a light source configured to emit light in an irradiated field of view and an electromagnetic radiation detector configured to receive reflected light from a target object irradiated by the light source. One or more processors of the systems may identify a characteristic of the target object based on a determined level of light absorption by the target object. Some systems and methods may include one or more corrections for scattered and/or ambient light such as applying an ambient light correction, passing the reflected light through an anti-scatter grid, or using a time-dependent variation in the emitted light.

公开(公告)号：US11579694B2

公开(公告)日：2023-02-14

申请号：US17521618

申请日：2021-11-08

Applicant: Magic Leap, Inc.

Inventor： Adrian Kaehler

IPC: G06F3/01 ,  G06T19/00 ,  G06T13/40 ,  G06F1/16 ,  G06V10/42 ,  G06V10/22 ,  G06V10/98 ,  G06V20/20 ,  G06V40/19 ,  G06V40/20 ,  G06V40/50 ,  G06V40/18 ,  G06T7/73 ,  G06T1/20 ,  G06T11/60 ,  G06T3/40

Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image set selection can include comparing a determined image quality metric with an image quality threshold to identify an eye image passing an image quality threshold, and selecting, from a plurality of eye images, a set of eye images that passes the image quality threshold.

公开(公告)号：US11568035B2

公开(公告)日：2023-01-31

申请号：US17129711

申请日：2020-12-21

Applicant: Magic Leap, Inc.

Inventor： Alexey Spizhevoy ,  Adrian Kaehler ,  Gary Bradski

IPC: G06F21/32 ,  G06N3/04 ,  G06V40/19 ,  G06V40/18 ,  G06N3/08 ,  G06N7/00

Abstract: Systems and methods for iris authentication are disclosed. In one aspect, a deep neural network (DNN) with a triplet network architecture can be trained to learn an embedding (e.g., another DNN) that maps from the higher dimensional eye image space to a lower dimensional embedding space. The DNN can be trained with segmented iris images or images of the periocular region of the eye (including the eye and portions around the eye such as eyelids, eyebrows, eyelashes, and skin surrounding the eye). With the triplet network architecture, an embedding space representation (ESR) of a person's eye image can be closer to the ESRs of the person's other eye images than it is to the ESR of another person's eye image. In another aspect, to authenticate a user as an authorized user, an ESR of the user's eye image can be sufficiently close to an ESR of the authorized user's eye image.