-
公开(公告)号:US20220357582A1
公开(公告)日:2022-11-10
申请号:US17872443
申请日:2022-07-25
Applicant: Magic Leap, Inc.
Inventor: Gholamreza Amayeh , Adrian Kaehler , Douglas Lee
Abstract: Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. The images obtained by the eye cameras may be analyzed using a stereoscopic vision technique, a monocular vision technique, or a combination, to generate a face model for the user.
-
公开(公告)号:US11454523B2
公开(公告)日:2022-09-27
申请号:US17111372
申请日:2020-12-03
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
-
公开(公告)号:US11428941B2
公开(公告)日:2022-08-30
申请号:US17196394
申请日:2021-03-09
Applicant: Magic Leap, Inc.
Inventor: Gholamreza Amayeh , Adrian Kaehler , Douglas Lee
Abstract: Systems and methods for generating a face model for a user of a head-mounted device are disclosed. The head-mounted device can include one or more eye cameras configured to image the face of the user while the user is putting the device on or taking the device off. The images obtained by the eye cameras may be analyzed using a stereoscopic vision technique, a monocular vision technique, or a combination, to generate a face model for the user.
-
公开(公告)号:US11423909B2
公开(公告)日:2022-08-23
申请号:US16791855
申请日:2020-02-14
Applicant: Magic Leap, Inc.
Inventor: Jeffrey Scott Sommers , Jennifer M. R. Devine , Joseph Wayne Seuck , Adrian Kaehler
IPC: G10L15/26 , G06F40/58 , G06F40/169 , G06F40/242 , G06V20/20 , G10L15/18 , G10L25/84 , H04N7/15 , H04N7/14 , G10L15/08
Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.
-
公开(公告)号:US20220130113A1
公开(公告)日:2022-04-28
申请号:US17453813
申请日:2021-11-05
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: Systems and methods for synthesizing an image of the face by a head-mounted device (HMD) are disclosed. The HMD may not be able to observe a portion of the face. The systems and methods described herein can generate a mapping from a conformation of the portion of the face that is not imaged to a conformation of the portion of the face observed. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.
-
公开(公告)号:US20220083198A1
公开(公告)日:2022-03-17
申请号:US17482256
申请日:2021-09-22
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
公开(公告)号:US11263438B2
公开(公告)日:2022-03-01
申请号:US16709105
申请日:2019-12-10
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
Abstract: An augmented reality device (ARD) can present virtual content which can provide enhanced experiences with the user's physical environment. For example, the ARD can detect a linkage between a person in the FOV of the ARD and a physical object (e.g., a document presented by the person) or detect linkages between the documents. The linkages may be used in identity verification or document verification.
-
公开(公告)号:US20220020192A1
公开(公告)日:2022-01-20
申请号:US17385724
申请日:2021-07-26
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Gary Bradski , Vijay Badrinarayanan
Abstract: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
-
公开(公告)号:US11159783B2
公开(公告)日:2021-10-26
申请号:US16694606
申请日:2019-11-25
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler
IPC: H04N13/393 , H04N13/32 , H04N13/324 , H04N13/398 , G09G3/00 , H04N13/307 , G02B30/27 , G02B30/54 , G02B30/56
Abstract: Apparatuses and methods for displaying a 3-D representation of an object are described. Apparatuses can include a rotatable structure, motor, and multiple light field sub-displays disposed on the rotatable structure. The apparatuses can store a light field image to be displayed, the light field image providing multiple different views of the object at different viewing directions. A processor can drive the motor to rotate the rotatable structure and map the light field image to each of the light field sub-displays based in part on the rotation angle, and illuminate the light field sub-displays based in part on the mapped light field image. The apparatuses can include a display panel configured to be viewed from a fiducial viewing direction, where the display panel is curved out of a plane that is perpendicular to the fiducial viewing direction, and a plurality of light field sub-displays disposed on the display panel.
-
公开(公告)号:US11126842B2
公开(公告)日:2021-09-21
申请号:US16223611
申请日:2018-12-18
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , Michael Anthony Klug , Gholamreza Amayeh
Abstract: Systems and methods for eye pose identification using features of an eye are described. Embodiments of the systems and methods can include segmenting an iris of an eye in the eye image to obtain pupillary and limbic boundaries of the eye, determining two angular coordinates (e.g., pitch and yaw) of an eye pose using the pupillary and limbic boundaries of the eye, identifying an eye feature of the eye (e.g., an iris feature or a scleral feature), determining a third angular coordinate (e.g., roll) of the eye pose using the identified eye feature, and utilizing the eye pose measurement for display of an image or a biometric application. In some implementations, iris segmentation may not be performed, and the two angular coordinates are determined from eye features.
-
-
-
-
-
-
-
-
-