公开(公告)号：US10553017B2

公开(公告)日：2020-02-04

申请号：US15999160

申请日：2018-08-17

Applicant: Magic Leap, Inc.

Inventor： Ivan Li Chuen Yeoh ,  Lionel Ernest Edwin ,  Samuel A. Miller

IPC: G06T1/60 ,  G06T13/00 ,  G06T15/00 ,  G06T15/20 ,  G06T19/00 ,  G06F3/01 ,  G06F3/0481 ,  A63F13/00 ,  G02B27/01

Abstract: Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

公开(公告)号：US10551568B2

公开(公告)日：2020-02-04

申请号：US16445115

申请日：2019-06-18

Applicant: Magic Leap, Inc.

Inventor： Ivan Li Chuen Yeoh ,  Lionel Ernest Edwin ,  Hui-Chuan Cheng

IPC: G02B6/293 ,  G02B27/44 ,  F21V8/00 ,  G02B27/00 ,  G02B27/42 ,  G02B27/10 ,  G02B5/18

Abstract: An eyepiece for projecting an image to an eye of a viewer includes a first planar waveguide positioned in a first lateral plane, a second planar waveguide positioned in a second lateral plane adjacent the first lateral plane, and a third planar waveguide positioned in a third lateral plane adjacent the second lateral plane. The first waveguide includes a first diffractive optical element (DOE) coupled thereto and disposed at a lateral position. The second waveguide includes a second DOE coupled thereto and disposed at the lateral position. The third waveguide includes a third DOE coupled thereto and disposed at the lateral position. The eyepiece further includes a first optical filter disposed between the first waveguide and the second waveguide at the lateral position, and a second optical filter positioned between the second waveguide and the third waveguide at the lateral position.

公开(公告)号：US20200026348A1

公开(公告)日：2020-01-23

申请号：US16588830

申请日：2019-09-30

Applicant: Magic Leap, Inc.

Inventor： Zachary C. Nienstedt ,  Samuel A. Miller ,  Barak Freedman ,  Lionel Ernest Edwin ,  Eric C. Browy ,  William Hudson Welch ,  Ron Liraz Lidji

IPC: G06F3/01 ,  G02B27/01 ,  G06F1/16

Abstract: Techniques are disclosed for performing localization of a handheld device with respect to a wearable device. At least one sensor mounted to the handheld device, such as an inertial measurement unit (IMU), may obtain handheld data indicative of movement of the handheld device with respect to the world. An imaging device mounted to either the handheld device or the wearable device may capture a fiducial image containing a number of fiducials affixed to the other device. The number of fiducials contained in the image are determined. Based on the number of fiducials, at least one of a position and an orientation of the handheld device with respect to the wearable device are updated based on the image and the handheld data in accordance with a first operating state, a second operating state, or a third operating state.

公开(公告)号：US10520737B2

公开(公告)日：2019-12-31

申请号：US16437229

申请日：2019-06-11

Applicant: Magic Leap, Inc.

Inventor： Ivan L. Yeoh ,  Lionel Ernest Edwin ,  Robert Dale Tekolste

IPC: G02B27/22 ,  G02B27/01 ,  G06F3/01 ,  F21V8/00 ,  G01B11/27 ,  G06T19/00 ,  G02B26/10 ,  G06F3/00 ,  G06T15/50 ,  G02B27/00

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

公开(公告)号：US20190324276A1

公开(公告)日：2019-10-24

申请号：US16389529

申请日：2019-04-19

Applicant: Magic Leap, Inc.

Inventor： Lionel Ernest Edwin ,  Ivan Li Chuen Yeoh ,  Samuel A. Miller ,  Edwin Joseph Selker ,  Adam C. Carlson ,  Bjorn Nicolaas Servatius Vlaskamp ,  Paul M. Greco

IPC: G02B27/01 ,  G06T19/00 ,  G06K9/00 ,  G09G5/00

Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

公开(公告)号：US20190287495A1

公开(公告)日：2019-09-19

申请号：US16355603

申请日：2019-03-15

Applicant: Magic Leap, Inc.

Inventor： Vaibhav Mathur ,  Lionel Ernest Edwin ,  Xiaoyang Zhang ,  Bjorn Nicolaas Servatius Vlaskamp

IPC: G09G5/391 ,  G06F3/01 ,  G06T5/00

Abstract: Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include determining a fixation point of a user's eyes. Location information associated with a first virtual object to be presented to the user via a display device is obtained. A resolution-modifying parameter of the first virtual object is obtained. A particular resolution at which to render the first virtual object is identified based on the location information and the resolution-modifying parameter of the first virtual object. The particular resolution is based on a resolution distribution specifying resolutions for corresponding distances from the fixation point. The first virtual object rendered at the identified resolution is presented to the user via the display system.

公开(公告)号：US10042166B2

公开(公告)日：2018-08-07

申请号：US15405146

申请日：2017-01-12

Applicant: Magic Leap, Inc.

Inventor： Ivan L. Yeoh ,  Lionel Ernest Edwin ,  Robert Dale TeKolste

IPC: G06T15/50 ,  G06T15/60 ,  G02B27/01 ,  G01B11/27 ,  F21V8/00 ,  G02B26/10 ,  G02B27/00 ,  G06F3/00 ,  G06T19/00

Abstract: A virtual image generation system for use by an end user comprises a projection subsystem configured for generating a collimated light beam, and a display configured emitting light rays in response to the collimated light beam to display a pixel of an image frame to the end user. The pixel has a location encoded with angles of the emitted light rays. The virtual image generation system further comprises a sensing assembly configured for sensing at least one parameter indicative of at least one of the emitted light ray angles, and a control subsystem configured for generating image data defining a location of the pixel, and controlling an angle of the light beam relative to the display based on the defined location of the pixel and the sensed parameter(s).

公开(公告)号：US09978182B2

公开(公告)日：2018-05-22

申请号：US15198983

申请日：2016-06-30

Applicant: MAGIC LEAP, INC.

Inventor： Ivan Li Chuen Yeoh ,  Samuel A. Miller ,  Randall E. Hand ,  Lionel Ernest Edwin ,  Philip O'Connor ,  Brian David Schwab ,  Spencer Lindsay

IPC: G09G5/00 ,  G06T19/00 ,  G02B27/01 ,  G06K9/00 ,  G06K9/46 ,  G06K9/52 ,  G06T7/20 ,  G06T7/60 ,  G06F3/01 ,  G06F17/21

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06F1/163 ,  G06F1/1686 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06F17/211 ,  G06K9/00335 ,  G06K9/00442 ,  G06K9/00671 ,  G06K9/4661 ,  G06K9/52 ,  G06T7/20 ,  G06T7/60 ,  G06T19/00 ,  G06T2207/20112 ,  G06T2219/004

Abstract: A virtual image generation system and method of operating same is provided. An end user is allowed to visualize the object of interest in a three-dimensional scene. A text region is spatially associated with the object of interest. A textual message that identifies at least one characteristic of the object of interest is generated. A textual message is streamed within the text region.

公开(公告)号：US20240295732A1

公开(公告)日：2024-09-05

申请号：US18647479

申请日：2024-04-26

Applicant: Magic Leap, Inc.

Inventor： Lionel Ernest Edwin ,  Ivan Li Chuen Yeoh ,  Zhiheng Jia ,  Adam C. Carlson

IPC: G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06T19/00

CPC classification number: G02B27/0093 ,  G02B6/0025 ,  G02B6/0028 ,  G02B6/0031 ,  G02B27/0176 ,  G06F3/013 ,  G06T19/006 ,  G02B2027/0138 ,  G02B2027/0174

Abstract: A head-mounted display system is configured to project light to an eye of a user wearing the head-mounted display system to display content in a vision field of said user. The head-mounted display system comprises at least one diffusive optical element, at least one out-coupling optical element, at least one mask comprising at least one mask opening, at least one illumination in-coupling optical element configured to in-couple light from at least one illumination source into a light-guiding component, an image projector configured to in-couple an image and an at least one illumination source is configured to in-couple light into at least one illumination in-coupling optical element, an eyepiece, a curved light-guiding component, a light-guiding component comprising a portion of a frame, and/or two light-guiding components disposed on opposite sides of at least one out-coupling optical element.

公开(公告)号：US11977230B2

公开(公告)日：2024-05-07

申请号：US17418687

申请日：2019-12-20

Applicant: Magic Leap, Inc.

Inventor： Michael Anthony Klug ,  Evgeni Poliakov ,  Jahja I. Trisnadi ,  Hyunsun Chung ,  Lionel Ernest Edwin ,  Howard Russell Cohen ,  Robert Blake Taylor ,  Andrew Ian Russell ,  Kevin Richard Curtis ,  Clinton Carlisle

IPC: G02B27/01 ,  G02B6/26 ,  G02B27/09 ,  G02B27/18 ,  G02B27/30 ,  G02B27/40 ,  G02B27/62 ,  G09G3/00 ,  G09G3/32 ,  H02N2/02 ,  G02B27/10 ,  G02B27/14

CPC classification number: G02B27/0172 ,  G02B6/262 ,  G02B27/0176 ,  G02B27/0972 ,  G02B27/18 ,  G02B27/30 ,  G02B27/40 ,  G02B27/62 ,  G09G3/002 ,  G09G3/32 ,  H02N2/028 ,  G02B6/26 ,  G02B2027/0112 ,  G02B2027/0154 ,  G02B2027/0178 ,  G02B27/102 ,  G02B27/149 ,  G09G2310/08 ,  G09G2340/0407

Abstract: A wearable display system includes one or more emissive micro-displays, e.g., micro-LED displays. The micro-displays may be monochrome micro-displays or full-color micro-displays. The micro-displays may include arrays of light emitters. Light collimators may be utilized to narrow the angular emission profile of light emitted by the light emitters. Where a plurality of emissive micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, e.g., an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.