公开(公告)号：US12189128B2

公开(公告)日：2025-01-07

申请号：US18297191

申请日：2023-04-07

Applicant: Magic Leap, Inc.

Inventor： Ivan Li Chuen Yeoh ,  Lionel Ernest Edwin ,  Nicole Elizabeth Samec ,  Nastasja U. Robaina ,  Vaibhav Mathur ,  Timothy Mark Dalrymple ,  Jason Schaefer ,  Clinton Carlisle ,  Hui-Chuan Cheng ,  Chulwoo Oh ,  Philip Premysler ,  Xiaoyang Zhang ,  Adam C. Carlson

IPC: G02B27/01 ,  G02B27/00 ,  G06T15/00 ,  G06T19/00 ,  H04N13/279 ,  H04N13/341 ,  H04N13/344 ,  H04N13/383 ,  H04N13/395 ,  H04N13/398

Abstract: Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include monitoring eye orientations of a user of a display system based on detected sensor information. A fixation point is determined based on the eye orientations, the fixation point representing a three-dimensional location with respect to a field of view. Location information of virtual objects to present is obtained, with the location information indicating three-dimensional positions of the virtual objects. Resolutions of at least one virtual object is adjusted based on a proximity of the at least one virtual object to the fixation point. The virtual objects are presented to a user by display system with the at least one virtual object being rendered according to the adjusted resolution.

公开(公告)号：US12008723B2

公开(公告)日：2024-06-11

申请号：US17962289

申请日：2022-10-07

Applicant: Magic Leap, Inc.

Inventor： Samuel A. Miller ,  Lomesh Agarwal ,  Lionel Ernest Edwin ,  Ivan Li Chuen Yeoh ,  Daniel Farmer ,  Sergey Fyodorovich Prokushkin ,  Yonatan Munk ,  Edwin Joseph Selker ,  Erik Fonseka ,  Paul M. Greco ,  Jeffrey Scott Sommers ,  Bradley Vincent Stuart ,  Shiuli Das ,  Suraj Manjunath Shanbhag

IPC: G06F3/01 ,  F21V8/00 ,  G02B27/01 ,  G06T19/00

CPC classification number: G06T19/006 ,  G02B6/0076 ,  G02B27/0172 ,  G06F3/013 ,  G02B2027/014 ,  G06T2200/24

Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

公开(公告)号：US12007573B2

公开(公告)日：2024-06-11

申请号：US17093784

申请日：2020-11-10

Applicant: Magic Leap, Inc

Inventor： Ivan Li Chuen Yeoh ,  Lionel Ernest Edwin ,  Brian T. Schowengerdt ,  Michael Anthony Klug ,  Jahja I. Trisnadi

IPC: G02B26/00 ,  F21V8/00 ,  G02B3/14 ,  G02B27/01 ,  G06F3/01 ,  G06T5/80 ,  G06T19/00 ,  G02B27/00

CPC classification number: G02B27/0179 ,  G02B3/14 ,  G02B6/005 ,  G02B26/004 ,  G02B27/0172 ,  G06F3/011 ,  G06F3/013 ,  G06T5/80 ,  G06T19/006 ,  G02B6/0038 ,  G02B6/0068 ,  G02B27/0093 ,  G02B2027/0123 ,  G02B2027/0127 ,  G02B2027/0185 ,  G02B2027/0187

Abstract: An augmented reality (AR) device is described with a display system configured to adjust an apparent distance between a user of the AR device and virtual content presented by the AR device. The AR device includes a first tunable lens that change shape in order to affect the position of the virtual content. Distortion of real-world content on account of the changes made to the first tunable lens is prevented by a second tunable lens that changes shape to stay substantially complementary to the optical configuration of the first tunable lens. In this way, the virtual content can be positioned at almost any distance relative to the user without degrading the view of the outside world or adding extensive bulk to the AR device. The augmented reality device can also include tunable lenses for expanding a field of view of the augmented reality device.

公开(公告)号：US11899200B2

公开(公告)日：2024-02-13

申请号：US17233283

申请日：2021-04-16

Applicant: Magic Leap, Inc.

Inventor： Lionel Ernest Edwin ,  Bjorn Nicolaas Servatius Vlaskamp ,  Samuel A. Miller ,  Aaron M. Clarke

IPC: G02B26/10 ,  G02B26/08 ,  G03B21/00 ,  H04N9/31

CPC classification number: G02B26/101 ,  G02B26/0833 ,  G03B21/008 ,  H04N9/3129 ,  H04N9/3161

Abstract: An image display system includes an optical subsystem configured to emit a modulated light beam, and a scanning mirror for generating a reflected light beam that is scanned according to randomly selected or pseudo-randomly selected scan patterns to generate multiple image fields of a multiple interlaced scan image. A plurality of different scan patterns can be cycled through, randomly or pseudo-randomly selected, for the different image fields to reduce artifacts that may be observed while viewing a projected image.

公开(公告)号：US11710469B2

公开(公告)日：2023-07-25

申请号：US17581760

申请日：2022-01-21

Applicant: Magic Leap, Inc.

Inventor： Vaibhav Mathur ,  Lionel Ernest Edwin ,  Xiaoyang Zhang ,  Bjorn Nicolaas Servatius Vlaskamp

IPC: G09G5/391 ,  G06F3/01 ,  G06T5/00

CPC classification number: G09G5/391 ,  G06F3/013 ,  G06T5/002 ,  G09G2320/0606 ,  G09G2320/0613 ,  G09G2340/0428 ,  G09G2354/00

Abstract: Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include determining a fixation point of a user's eyes. Location information associated with a first virtual object to be presented to the user via a display device is obtained. A resolution-modifying parameter of the first virtual object is obtained. A particular resolution at which to render the first virtual object is identified based on the location information and the resolution-modifying parameter of the first virtual object. The particular resolution is based on a resolution distribution specifying resolutions for corresponding distances from the fixation point. The first virtual object rendered at the identified resolution is presented to the user via the display system.

公开(公告)号：US11604353B2

公开(公告)日：2023-03-14

申请号：US17175054

申请日：2021-02-12

Applicant: Magic Leap, Inc.

Inventor： Samuel A. Miller ,  William Hudson Welch ,  Lionel Ernest Edwin ,  Ivan Li Chuen Yeoh

IPC: G02B27/01 ,  G09G3/00 ,  G02B27/00 ,  G03B21/10 ,  G09G3/3208

Abstract: This disclosure describes a head-mounted display with a display assembly configured to display content to most or all of a user's field of view. The display assembly can be configured to display content in far-peripheral regions of the user's field of view differently than content upon which a user can focus. For example, spatial resolution, color resolution, refresh rate and intensity (i.e. brightness) can be adjusted to save resources and/or to bring attention to virtual content positioned within a far-peripheral region. In some embodiments, these changes can save processing resources without detracting from the user's overall experience.

公开(公告)号：US20230057556A1

公开(公告)日：2023-02-23

申请号：US17895313

申请日：2022-08-25

Applicant: Magic Leap, Inc.

Inventor： Vaibhav Mathur ,  David Manly ,  Jahja I. Trisnadi ,  Clinton Carlisle ,  Lionel Ernest Edwin ,  Michael Anthony Klug

IPC: G06T15/50 ,  G06F3/01 ,  G06T15/80 ,  G02B27/01

Abstract: Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

公开(公告)号：US11461961B2

公开(公告)日：2022-10-04

申请号：US17330146

申请日：2021-05-25

Applicant: Magic Leap, Inc.

Inventor： Vaibhav Mathur ,  David Manly ,  Jahja I. Trisnadi ,  Clinton Carlisle ,  Lionel Ernest Edwin ,  Michael Anthony Klug

IPC: G06T15/50 ,  G06F3/01 ,  G06T15/80 ,  G02B27/01

Abstract: Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

公开(公告)号：US11290706B2

公开(公告)日：2022-03-29

申请号：US17125932

申请日：2020-12-17

Applicant: Magic Leap, Inc.

Inventor： Lionel Ernest Edwin ,  Zachary C. Nienstedt ,  Ivan Li Chuen Yeoh ,  Samuel A. Miller ,  Yan Xu ,  Jordan Alexander Cazamias

IPC: H04N13/344 ,  G02B27/01 ,  G02B27/00 ,  G06F3/04815 ,  H04N13/383 ,  G06F3/01 ,  G02B30/40

Abstract: A wearable device may include a head-mounted display (HMD) for rendering a three-dimensional (3D) virtual object which appears to be located in an ambient environment of a user of the display. The relative positions of the HMD and one or more eyes of the user may not be in desired positions to receive, or register, image information outputted by the HMD. For example, the HMD-to-eye alignment vary for different users and may change over time (e.g., as a given user moves around or as the HMD slips or otherwise becomes displaced). The wearable device may determine a relative position or alignment between the HMD and the user's eyes. Based on the relative positions, the wearable device may determine if it is properly fitted to the user, may provide feedback on the quality of the fit to the user, and may take actions to reduce or minimize effects of any misalignment.

公开(公告)号：US20220091427A1

公开(公告)日：2022-03-24

申请号：US17418190

申请日：2019-12-20

Applicant: Magic Leap, Inc.

Inventor： Lionel Ernest Edwin ,  Andrew Ian Russell ,  Howard Russell Cohen

IPC: G02B27/09 ,  G02B27/00 ,  G02B27/01

Abstract: Systems and methods are disclosed for low motion-to-photon latency for augmented and virtual reality systems. Some systems generate rendered frames that are presented to a user by outputting light from a head-mounted display unit. The rendered frames are perceived by the user as virtual content. The head-mounted display unit includes an orientation sensor, a display configured to output light to the user, and processors. The processors receive a rendered frame of virtual content, obtain orientation information from the orientation sensor, and warp or modify the rendered frame of virtual content based on changes to the orientation of the user's head. The warped rendered frame is subsequently outputted from the display using modulated light. The processors and the orientation sensor may be part of a spatial light modulator for modulating the light used to present the warped rendered frame. In addition, the spatial light modulator may be a LED array having low persistence and a high duty cycle.