-
1.发明公开公开(公告)号：US20230377194A1
公开(公告)日：2023-11-23
申请号：US18196756
申请日：2023-05-12
Applicant: Apple Inc.
Inventor： Hao Qin , Chia-Yin Tsai , Tom Sengelaub , Hua Gao , Jie Zhong
IPC: G06T7/73
CPC classification number: G06T7/74 , G06T2207/10048 , G06T2207/30201
Abstract: Various implementations disclosed herein include an inconspicuous eye enrollment for user devices through the simultaneous or near-simultaneous eye characteristic tracking and eye model updating. The implementations disclosed herein direct light towards an eye of a user to produce glint reflections and obtain, via one or more sensors, image frames comprising depictions of the glint reflections. Based on those image frames, the implementations disclosed herein track eye characteristics and update an eye model of the eye during a period of time between obtaining a first image frame of the image frames and obtaining a second image frame of the image frames.
-
公开(公告)号：US20230315201A1
公开(公告)日：2023-10-05
申请号：US18145828
申请日：2022-12-22
Applicant: Apple Inc.
Inventor： Tom Sengelaub , Emanuele Mandelli , Aleksandr M Movshovich , Martin Haller , Hao Qin , Hua Gao
IPC: G06F3/01 , G06V10/141 , G06V10/60 , G02B27/01 , G06T5/50
CPC classification number: G06F3/013 , G02B27/0172 , G06T5/50 , G06V10/141 , G06V10/60 , G06T2207/20221
Abstract: Methods and apparatus for stray light mitigation in optical systems that include two or more illumination sources (e.g., point light sources such as light-emitting diodes (LEDs)) that illuminate an object to be imaged, and a camera configured to capture images of light from the point light sources reflected by the object when illuminated. To mitigate “occlusions” or artifacts caused by, for example, stray light or reflections of the illumination sources off of other components of the system, multiple images of the object are captured with different groups of the illumination sources enabled. The captured images can then be processed and merged to generate an output image with the occlusions or artifacts caused by stray light or reflections mitigated or eliminated.
-
公开(公告)号：US11170212B2
公开(公告)日：2021-11-09
申请号：US16570389
申请日：2019-09-13
Applicant: Apple Inc.
Inventor： Tom Sengelaub , Hua Gao , Hao Qin , Julia Benndorf
Abstract: Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.
-
公开(公告)号：US10893801B2
公开(公告)日：2021-01-19
申请号：US16009084
申请日：2018-06-14
Applicant: Apple Inc.
Inventor： Kun Liu , Walter Nistico , Hao Qin
Abstract: The invention relates to an eye tracking system (10) and a method for operating an eye tracking system (10) for determining if one of a left and a right eye of a user is dominant, wherein at least one image of the left and the right eye of the user is captured (S30), based on the at least one image and according to a predefined accuracy function a left accuracy score for the left eye (S34a) and a right accuracy score for the right eye (S34c) is determined and it is determined if one of the left and the right eye of the user is dominant in dependency of at least the left and the right accuracy score (S36). Thereby user-specific properties relating to his eyes can be provided and considered when performing eye tracking so that the robustness and accuracy of eye tracking can be enhanced.
-
公开(公告)号：US11710350B2
公开(公告)日：2023-07-25
申请号：US17499205
申请日：2021-10-12
Applicant: Apple Inc.
Inventor： Tom Sengelaub , Hua Gao , Hao Qin , Julia Benndorf
CPC classification number: G06V40/19 , G06F3/013 , G06T7/50 , G06T7/70 , G06T7/74 , G06T7/90 , G06V40/165 , G06T2200/04 , G06T2207/10024 , G06T2207/10028 , G06T2207/10048 , G06T2207/30041 , G06T2207/30201
Abstract: Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.
-
Patent Agency Ranking
公开(公告)号：US20240104958A1
公开(公告)日：2024-03-28
申请号：US18470367
申请日：2023-09-19
Applicant: Apple Inc.
Inventor： Hao Qin , Hua Gao , Tom Sengelaub , Jie Zhong
CPC classification number: G06V40/197 , G06T7/75 , G06T17/00 , G06T2207/10048 , G06V40/50
Abstract: Methods and apparatus for providing eye model matching in a device are disclosed. When a user activates a device and the presence of the user's eye is detected, an image of the user's eye is captured. An eye model matching process is then implemented to determine a stored eye model (e.g., an eye model stored after enrollment of the eye on the device) that best matches the eye in the captured image. Determination of the best matching eye model may be based on matching between properties of the user's eye in the captured image (such as cornea and pupil features) and properties of the user's eye determined by the eye model. The best matching eye model may then be implemented in, for example, an eye gaze tracking process. In certain instances, the best matching eye model satisfies a threshold for matching before being implemented in the downstream process.
-
公开(公告)号：US20240272709A1
公开(公告)日：2024-08-15
申请号：US18568256
申请日：2022-06-08
Applicant: Apple Inc.
Inventor： Hao Qin , Hua Gao , Tom Sengelaub , Chia-Yin Tsai
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: Methods and apparatus for generating user-aware eye models. During an enrollment process, images of a user's eye are captured by one or more cameras when the eye is in two or more different orientations and at two or more different levels of display brightness. The captured images are processed to generate a 3-dimensional, user-aware eye model, for example a model of at least the eye's cornea and pupil features. The generated user-aware eye model may be used in other processes, for example in a gaze tracking process. The enrollment process may be an iterative process to optimize the eye model, or a continuous process performed while the user is using the system.
-
公开(公告)号：US20240211039A1
公开(公告)日：2024-06-27
申请号：US18534398
申请日：2023-12-08
Applicant: Apple Inc.
Inventor： Hao Qin , Hua Gao , Tom Sengelaub
CPC classification number: G06F3/013 , G06F1/163 , G06T7/75 , G06T2207/30196
Abstract: In an unobtrusive visual axis enrollment process, a line of text or other content is displayed at a known vertical location and virtual depth that the user can then read. This line of text may be content that the user needs to read as part of the normal enrollment process. As the user reads the line of text, eye tracking cameras may capture images of the eye. This data may then be used to estimate a stimulus plane. The error between the estimated stimulus plane and the ground truth stimulus plane (the actual location of the line of text in virtual space) may then be used to estimate the kappa angle.
-
公开(公告)号：US20240104967A1
公开(公告)日：2024-03-28
申请号：US18470364
申请日：2023-09-19
Applicant: Apple Inc.
Inventor： Rene Heideklang , Hua Gao , Hao Qin , Tom Sengelaub
CPC classification number: G06V40/50 , G06F3/013 , G06T7/70 , G06V40/19 , H04L9/0866 , G06T2207/30201
Abstract: A personalized eye model is used to generate synthetic gaze features at ground-truth eye poses Gg. Corresponding synthetic gaze poses Gs are estimated from the synthetic gaze features using an average eye model. A linear regression is applied between Gg and Gs to generate a gaze correction function. The gaze correction function represents differences between the synthetic gaze Gs of the subject eye at the display and that of the average eye model Gg at the display, but does not contain security- or privacy-sensitive information. Further, the personalized eye model cannot be recovered from the gaze correction function, and thus the gaze correction function can be stored unencrypted and available for use during a cold boot of a device prior to login. On a cold boot of the device, the gaze correction function may be accessed and used with an average eye model to improve gaze-based interactions.
-
公开(公告)号：US20220027621A1
公开(公告)日：2022-01-27
申请号：US17499205
申请日：2021-10-12
Applicant: Apple Inc.
Inventor： Tom Sengelaub , Hua Gao , Hao Qin , Julia Benndorf
Abstract: Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.
-
-
-
-
-
-
-
-
-
Search Results
13
records
(took 0.014 seconds)
