-
公开(公告)号:US11861941B1
公开(公告)日:2024-01-02
申请号:US16779297
申请日:2020-01-31
Applicant: Apple Inc.
Inventor: Keenan Molner , Qiong Huang , Branko Petljanski , Edward A. Valko , Tom Sengelaub , Martin Haller , Andrei Nikiforov , Hua Gao , Emanuele Mandelli
IPC: G06V40/19 , G02B27/01 , G02B5/30 , G06V40/18 , H01L31/0203 , H01L31/0216
CPC classification number: G06V40/19 , G02B5/3025 , G02B27/0172 , G06V40/18 , G02B2027/0161 , G02B2027/0178 , H01L31/0203 , H01L31/0216
Abstract: Methods and apparatus for using polarized light (e.g., infrared (IR) light) to improve eye-related functions such as iris recognition. An eye camera system includes one or more IR cameras that capture images of the user's eyes that are processed to perform iris recognition, gaze tracking, or other functions. At least one polarizing element may be located in the path of the light which is used to capture images of the user's eye. The user's eye may be illuminated by IR light emitted by one or more LEDs. At least one of the LEDs may be an LED with a polarizing filter. Instead or in addition, at least one polarizer may be located at the eye camera sensor, in the eye camera optics, or as or in an additional optical element located on the light path between the eye camera and the user's eye.
-
32.
公开(公告)号:US20230377194A1
公开(公告)日:2023-11-23
申请号:US18196756
申请日:2023-05-12
Applicant: Apple Inc.
Inventor: Hao Qin , Chia-Yin Tsai , Tom Sengelaub , Hua Gao , Jie Zhong
IPC: G06T7/73
CPC classification number: G06T7/74 , G06T2207/10048 , G06T2207/30201
Abstract: Various implementations disclosed herein include an inconspicuous eye enrollment for user devices through the simultaneous or near-simultaneous eye characteristic tracking and eye model updating. The implementations disclosed herein direct light towards an eye of a user to produce glint reflections and obtain, via one or more sensors, image frames comprising depictions of the glint reflections. Based on those image frames, the implementations disclosed herein track eye characteristics and update an eye model of the eye during a period of time between obtaining a first image frame of the image frames and obtaining a second image frame of the image frames.
-
公开(公告)号:US20230324690A1
公开(公告)日:2023-10-12
申请号:US18179899
申请日:2023-03-07
Applicant: Apple Inc.
Inventor: Ritu Shah , Edward S. Huo , Jason L. Slupeiks , Ryan J. Dunn , Tom Sengelaub , Tong Chen
CPC classification number: G02B27/0172 , G02B27/0093 , G02B2027/0138 , G02B2027/014
Abstract: A head-mounted device may have a head-mounted support structure. Displays may present images to eye boxes at the rear of the head-mounted support structure. Cameras and other sensors may be supported by the head-mounted support structure. Tracking cameras may be used to track the movement of a user's hands or other external objects. In dim ambient lighting conditions, a supplemental illumination system may be activated to provide supplemental illumination for the tracking cameras. A single beam of supplemental illumination may be emitted over a given coverage area or a smaller beam of supplemental illumination may be steered across the given coverage area. Light-emitting devices such as infrared light-emitting diodes and infrared lasers may be used to form infrared light sources for the supplemental illumination system.
-
公开(公告)号:US20230315201A1
公开(公告)日:2023-10-05
申请号:US18145828
申请日:2022-12-22
Applicant: Apple Inc.
Inventor: Tom Sengelaub , Emanuele Mandelli , Aleksandr M Movshovich , Martin Haller , Hao Qin , Hua Gao
IPC: G06F3/01 , G06V10/141 , G06V10/60 , G02B27/01 , G06T5/50
CPC classification number: G06F3/013 , G02B27/0172 , G06T5/50 , G06V10/141 , G06V10/60 , G06T2207/20221
Abstract: Methods and apparatus for stray light mitigation in optical systems that include two or more illumination sources (e.g., point light sources such as light-emitting diodes (LEDs)) that illuminate an object to be imaged, and a camera configured to capture images of light from the point light sources reflected by the object when illuminated. To mitigate “occlusions” or artifacts caused by, for example, stray light or reflections of the illumination sources off of other components of the system, multiple images of the object are captured with different groups of the illumination sources enabled. The captured images can then be processed and merged to generate an output image with the occlusions or artifacts caused by stray light or reflections mitigated or eliminated.
-
公开(公告)号:US20230306927A1
公开(公告)日:2023-09-28
申请号:US18189422
申请日:2023-03-24
Applicant: Apple Inc.
Inventor: Ritu Shah , Ryan J. Dunn , Tom Sengelaub
CPC classification number: G09G5/10 , G09G3/3413 , G06T7/90 , G06V10/25 , G06F3/013 , G09G2320/0626 , G09G2360/144 , G06T2207/10024
Abstract: Operating an outward-facing display device for low light conditions may include receiving information indicative of ambient lighting conditions for the display device's environment; in accordance with a determination that the ambient lighting conditions do not satisfy a brightness criterion, determining a set of pixels in the outward-facing display device corresponding to an area of interest in the environment; and driving the set of pixels at a particular brightness to improve lighting in the area of interest.
-
公开(公告)号:US11729463B2
公开(公告)日:2023-08-15
申请号:US17497435
申请日:2021-10-08
Applicant: Apple Inc.
Inventor: Eberhard Schmidt , Tom Sengelaub , Christian Villwock
IPC: H04N21/442 , H04N21/4223 , H04N21/431 , H04N21/44 , G02B27/00 , G06F3/01 , H04N21/4728
CPC classification number: H04N21/44218 , G02B27/0093 , G06F3/013 , H04N21/4223 , H04N21/4318 , H04N21/44008 , H04N21/4728
Abstract: Method for subsequently displaying a stream of images in a display area of a display device, wherein a first area within the display area is determined around a point of regard. A first image of the stream of images is displayed in the display area such that a first part of the first image, which is displayed in the first area, is displayed according to a first parameter value of at least one parameter and a second part of the first image, which is displayed in at least one second area outside the first area, is displayed according to a second parameter value of the at least one parameter. Moreover, the determining of the point of regard is performed as predicting the point of regard for a certain future point of time, at which the first image is displayed.
-
公开(公告)号:US11326763B1
公开(公告)日:2022-05-10
申请号:US16779269
申请日:2020-01-31
Applicant: Apple Inc.
Inventor: Keenan Molner , Qiong Huang , Emanuele Mandelli , Edward A. Valko , Martin Haller , Tom Sengelaub
IPC: F21V9/14 , H01L33/52 , G02B27/01 , F21Y115/10
Abstract: Methods and apparatus for fabricating light-emitting diodes (LEDs) that include polarizing or wavefront-altering optical components are described in which additional optical components are added to the LED package to filter or modify the polarization of the emitted photons. Packaged LEDs that include polarizing or wavefront-altering optical components are also described. The packaged LEDs may emit infrared light that is polarized or otherwise altered by the optical components added during the fabrication process.
-
公开(公告)号:US11307659B2
公开(公告)日:2022-04-19
申请号:US17021901
申请日:2020-09-15
Applicant: Apple Inc.
Inventor: Tom Sengelaub
Abstract: Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include head odometers, eye odometers, or both head odometers and eye odometers to reduce power consumption of the system. Head odometers may be used to detect movement of the device with respect to the user's eyes, which may allow 3D reconstruction to generate 3D models of the user's eyes used in eye tracking to be performed only when movement of the device with respect to the user's eyes has been detected. Eye odometers may be used as a low-power component to track relative movement of the user's eyes with respect to the device between frames captured by the eye tracking cameras, which may allow the frame rate of the eye tracking cameras to be reduced.
-
公开(公告)号:US11170212B2
公开(公告)日:2021-11-09
申请号:US16570389
申请日:2019-09-13
Applicant: Apple Inc.
Inventor: Tom Sengelaub , Hua Gao , Hao Qin , Julia Benndorf
Abstract: Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.
-
公开(公告)号:US20210081039A1
公开(公告)日:2021-03-18
申请号:US17021912
申请日:2020-09-15
Applicant: Apple Inc.
Inventor: Tom Sengelaub
Abstract: Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include eye tracking cameras and eye odometers that may reduce power consumption of the system. The eye odometers may be used as a low-power component to track relative movement of the user's eyes with respect to the HMD between frames captured by the eye tracking cameras, which may allow the frame rate of the eye tracking cameras to be reduced.
-
-
-
-
-
-
-
-
-