-
公开(公告)号:US10890465B2
公开(公告)日:2021-01-12
申请号:US16047771
申请日:2018-07-27
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
-
公开(公告)号:US20200232622A1
公开(公告)日:2020-07-23
申请号:US16841429
申请日:2020-04-06
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Gary Bradski
IPC: F21V3/02 , F21V19/00 , F21K9/68 , H04N13/395 , H04N13/344 , H04N13/254 , H04N13/128
Abstract: A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.
-
公开(公告)号:US10719951B2
公开(公告)日:2020-07-21
申请号:US16134600
申请日:2018-09-18
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Douglas Bertram Lee , Vijay Badrinarayanan
IPC: G06K9/46 , G06T7/70 , G06T7/20 , G06F3/01 , G06F3/0481 , G06N3/02 , G02B27/01 , G06F3/0346 , G06T7/246 , G06F1/16 , G02B27/00 , G06T19/00
Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.
-
公开(公告)号:US20200184975A1
公开(公告)日:2020-06-11
申请号:US16791855
申请日:2020-02-14
Applicant: Magic Leap, Inc.
Inventor: Jeffrey Scott Sommers , Jennifer M.R. Devine , Joseph Wayne Seuck , Adrian Kaehler
IPC: G10L15/26 , H04N7/15 , G10L25/84 , G10L15/18 , G06K9/00 , G06F40/242 , G06F40/169 , G06F40/58
Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.
-
公开(公告)号:US20200184201A1
公开(公告)日:2020-06-11
申请号:US16709105
申请日:2019-12-10
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: An augmented reality device (ARD) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ARD can detect a linkage between a person in the FOV of the ARD and a physical object (e.g., a document presented by the person) or detect linkages between the documents. The linkages may be used in identity verification or document verification.
-
公开(公告)号:US10671845B2
公开(公告)日:2020-06-02
申请号:US16179541
申请日:2018-11-02
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
-
公开(公告)号:US20200097080A1
公开(公告)日:2020-03-26
申请号:US16585852
申请日:2019-09-27
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
IPC: G06F3/01 , G06K9/20 , G06K9/03 , G06F1/16 , G06K9/00 , G06T19/00 , G06T13/40 , G06T7/73 , G06K9/52 , G06T1/20 , G06T11/60 , G06T3/40
Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image set selection can include comparing a determined image quality metric with an image quality threshold to identify an eye image passing an image quality threshold, and selecting, from a plurality of eye images, a set of eye images that passes the image quality threshold.
-
公开(公告)号:US10594959B2
公开(公告)日:2020-03-17
申请号:US15916250
申请日:2018-03-08
Applicant: MAGIC LEAP, INC.
Inventor: Adrian Kaehler
Abstract: This disclosure is directed to an image sensor. The image sensor includes a two-dimensional pixel array divided into a plurality of blocks, each of the plurality of blocks comprising pixels arranged in at least two different rows and two different columns, and a shutter mechanism that exposes the plurality of blocks sequentially, with all pixels in each block being exposed synchronously.
-
公开(公告)号:US10536690B2
公开(公告)日:2020-01-14
申请号:US15410455
申请日:2017-01-19
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
IPC: H04N13/393 , H04N13/32 , H04N13/324 , H04N13/398 , G02B27/22
Abstract: Apparatuses and methods for displaying a 3-D representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. The apparatuses can store a light field image to be displayed, the light field image providing multiple different views of the object at different viewing directions. A processor can drive the motor to rotate the rotatable structure and map the light field image to each of the light field sub-displays based in part on the rotation angle, and illuminate the light field sub-displays based in part on the mapped light field image. The apparatuses can include a display panel configured to be viewed from a fiducial viewing direction, where the display panel is curved out of a plane that is perpendicular to the fiducial viewing direction, and a plurality of light field sub-displays disposed on the display panel.
-
公开(公告)号:US20190316753A1
公开(公告)日:2019-10-17
申请号:US16407030
申请日:2019-05-08
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Gary Bradski
IPC: F21V3/02 , H04N13/395 , F21V19/00 , F21K9/68 , H04N13/128 , H04N13/344 , H04N13/254
Abstract: A texture projecting light bulb includes an extended light source located within an integrator. The integrator includes at least one aperture configured to allow light to travel out of the interior of the integrator. In various embodiments, the interior of the integrator may be a diffusely reflective surface and the integrator may be configured to produce a uniform light distribution at the aperture to approximate a point source. The integrator may be surrounded by a light bulb enclosure. In various embodiments, the light bulb enclosure may include transparent and opaque regions configured to project a structured pattern of visible and/or infrared light.
-
-
-
-
-
-
-
-
-