-
公开(公告)号:US20250113998A1
公开(公告)日:2025-04-10
申请号:US18980560
申请日:2024-12-13
Applicant: Apple Inc.
Inventor: Walter Nistico
Abstract: Various implementations determine gaze direction based on a cornea center and (a) a pupil center or (b) an eyeball center. The cornea center is determined using a directional light source to produce one or more glints reflected from the surface of the eye and captured by a sensor. The angle (e.g., direction) of the light from the directional light source may be known, for example, using an encoder that records the orientation of the light source. The known direction of the light source facilitates determining the distance of the glint on the cornea and enables the cornea position to be determined, for example, based on a single glint. The cornea center can be determined (e.g., using an average cornea radius, or a previously measured cornea radius or using information from a second glint). The cornea center and a pupil center or eyeball center may be used to determine gaze direction.
-
公开(公告)号:US20240069631A1
公开(公告)日:2024-02-29
申请号:US18144079
申请日:2023-05-05
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
公开(公告)号:US11644896B2
公开(公告)日:2023-05-09
申请号:US17707013
申请日:2022-03-29
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
14.
公开(公告)号:US11003245B2
公开(公告)日:2021-05-11
申请号:US16667309
申请日:2019-10-29
Applicant: Apple Inc.
Inventor: Kun Liu , Fabian Wanner , Walter Nistico , Matthias Nieser
Abstract: The invention relates to a method for automatically identifying at least one user of an eye tracking device (10) by means of the eye tracking device (10), wherein user identification data of the at least one user are captured by a capturing device (14) of the eye tracking device (10). Under the first condition that at least one profile (P1, P2, P3) with associated identification data (I1, I2, I3) of at least one specific user is stored in a storage medium (20), the stored identification data (I1, I2, I3) of the at least one profile (P1, P2, P3) are compared with the captured user identification data, and under the second condition that the captured user identification data match the stored identification data (I1, I2, I3) according to a predefined criterion, the at least one user is identified as the at least one specific user, for whom the at least one profile (P1, P2, P3) was stored.
-
公开(公告)号:US20210068652A1
公开(公告)日:2021-03-11
申请号:US17010071
申请日:2020-09-02
Applicant: Apple Inc.
Inventor: Walter Nistico
Abstract: Various implementations determine gaze direction based on a cornea center and (a) a pupil center or (b) an eyeball center. The cornea center is determined using a directional light source to produce one or more glints reflected from the surface of the eye and captured by a sensor. The angle (e.g., direction) of the light from the directional light source may be known, for example, using an encoder that records the orientation of the light source. The known direction of the light source facilitates determining the distance of the glint on the cornea and enables the cornea position to be determined, for example, based on a single glint. The cornea center can be determined (e.g., using an average cornea radius, or a previously measured cornea radius or using information from a second glint). The cornea center and a pupil center or eyeball center may be used to determine gaze direction.
-
公开(公告)号:US10893801B2
公开(公告)日:2021-01-19
申请号:US16009084
申请日:2018-06-14
Applicant: Apple Inc.
Inventor: Kun Liu , Walter Nistico , Hao Qin
Abstract: The invention relates to an eye tracking system (10) and a method for operating an eye tracking system (10) for determining if one of a left and a right eye of a user is dominant, wherein at least one image of the left and the right eye of the user is captured (S30), based on the at least one image and according to a predefined accuracy function a left accuracy score for the left eye (S34a) and a right accuracy score for the right eye (S34c) is determined and it is determined if one of the left and the right eye of the user is dominant in dependency of at least the left and the right accuracy score (S36). Thereby user-specific properties relating to his eyes can be provided and considered when performing eye tracking so that the robustness and accuracy of eye tracking can be enhanced.
-
公开(公告)号:US12248626B2
公开(公告)日:2025-03-11
申请号:US18681275
申请日:2022-08-05
Applicant: APPLE INC.
Inventor: Walter Nistico , Patrick R. Gill
Abstract: Various implementations disclosed herein include devices, systems, and methods that perform gaze tracking using combinations of ultrasound and imaging data. Some implementations detect a first attribute of an eye using imaging measurements in a first image of the eye, and a first location associated with the first attribute is determined in a 3D coordinate system based on depth information. A second attribute of the eye is detected based on depth information from ultrasound based measurements of the eye, and a second location associated with the second attribute is determined in the 3D coordinate system based on the depth information and a 3D model of a portion of the eye. A gaze direction in the 3D coordinate system is determined based on the first location and the second location. In some implementations, user characteristics are identified (e.g., authentication) using ultrasonic biometric characteristics with imaging biometrics.
-
公开(公告)号:US20220214747A1
公开(公告)日:2022-07-07
申请号:US17707013
申请日:2022-03-29
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
19.
公开(公告)号:US11009945B2
公开(公告)日:2021-05-18
申请号:US16526386
申请日:2019-07-30
Applicant: Apple Inc.
Inventor: Fabian Wanner , Matthias Nieser , Kun Liu , Walter Nistico
Abstract: The invention relates to a method for operating an eye tracking device (10) for multi¬user eye tracking, wherein images (24) of a predefined capturing area (14) of the eye tracking device (10) are captured by means of an imaging device (12) of the eye tracking device (10) and the captured images (24) are processed by means of a processing unit (16) of the eye tracking device (10). If a first user (26a) and a second user (26b) are present in the predefined capturing area (14) of the eye tracking device (10), a first information relating to the first user (26a) and a second information relating to the second user (26b) are determined on the basis of the captured images (24) by processing the images (24). Furthermore the images (24) are captured successively in a predeterminable time sequence.
-
20.
公开(公告)号:US10521012B2
公开(公告)日:2019-12-31
申请号:US15557588
申请日:2016-03-10
Applicant: APPLE INC.
Inventor: Kun Liu , Fabian Wanner , Walter Nistico , Matthias Nieser
Abstract: The invention relates to a method for automatically identifying at least one user of an eye tracking device (10) by means of the eye tracking device (10), wherein user identification data of the at least one user are captured by a capturing device (14) of the eye tracking device (10). Under the first condition that at least one profile (P1, P2, P3) with associated identification data (I1, I2, I3) of at least one specific user is stored in a storage medium (20), the stored identification data (I1, I2, I3) of the at least one profile (P1, P2, P3) are compared with the captured user identification data, and under the second condition that the captured user identification data match the stored identification data (I1, I2, I3) according to a predefined criterion, the at least one user is identified as the at least one specific user, for whom the at least one profile (P1, P2, P3) was stored.
-
-
-
-
-
-
-
-
-