-
公开(公告)号:US20240069631A1
公开(公告)日:2024-02-29
申请号:US18144079
申请日:2023-05-05
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
公开(公告)号:US11644896B2
公开(公告)日:2023-05-09
申请号:US17707013
申请日:2022-03-29
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
公开(公告)号:US11003245B2
公开(公告)日:2021-05-11
申请号:US16667309
申请日:2019-10-29
Applicant: Apple Inc.
Inventor: Kun Liu , Fabian Wanner , Walter Nistico , Matthias Nieser
Abstract: The invention relates to a method for automatically identifying at least one user of an eye tracking device (10) by means of the eye tracking device (10), wherein user identification data of the at least one user are captured by a capturing device (14) of the eye tracking device (10). Under the first condition that at least one profile (P1, P2, P3) with associated identification data (I1, I2, I3) of at least one specific user is stored in a storage medium (20), the stored identification data (I1, I2, I3) of the at least one profile (P1, P2, P3) are compared with the captured user identification data, and under the second condition that the captured user identification data match the stored identification data (I1, I2, I3) according to a predefined criterion, the at least one user is identified as the at least one specific user, for whom the at least one profile (P1, P2, P3) was stored.
-
公开(公告)号:US20210068652A1
公开(公告)日:2021-03-11
申请号:US17010071
申请日:2020-09-02
Applicant: Apple Inc.
Inventor: Walter Nistico
Abstract: Various implementations determine gaze direction based on a cornea center and (a) a pupil center or (b) an eyeball center. The cornea center is determined using a directional light source to produce one or more glints reflected from the surface of the eye and captured by a sensor. The angle (e.g., direction) of the light from the directional light source may be known, for example, using an encoder that records the orientation of the light source. The known direction of the light source facilitates determining the distance of the glint on the cornea and enables the cornea position to be determined, for example, based on a single glint. The cornea center can be determined (e.g., using an average cornea radius, or a previously measured cornea radius or using information from a second glint). The cornea center and a pupil center or eyeball center may be used to determine gaze direction.
-
公开(公告)号:US10893801B2
公开(公告)日:2021-01-19
申请号:US16009084
申请日:2018-06-14
Applicant: Apple Inc.
Inventor: Kun Liu , Walter Nistico , Hao Qin
Abstract: The invention relates to an eye tracking system (10) and a method for operating an eye tracking system (10) for determining if one of a left and a right eye of a user is dominant, wherein at least one image of the left and the right eye of the user is captured (S30), based on the at least one image and according to a predefined accuracy function a left accuracy score for the left eye (S34a) and a right accuracy score for the right eye (S34c) is determined and it is determined if one of the left and the right eye of the user is dominant in dependency of at least the left and the right accuracy score (S36). Thereby user-specific properties relating to his eyes can be provided and considered when performing eye tracking so that the robustness and accuracy of eye tracking can be enhanced.
-
公开(公告)号:US20240310908A1
公开(公告)日:2024-09-19
申请号:US18673189
申请日:2024-05-23
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device, wherein a stimulus object is displayed within a certain display area, such that the stimulus object is at least temporarily moving along a defined trajectory and images of at least one eye of at least one user are captured during the displaying of the stimulus object.
-
公开(公告)号:US20230333371A1
公开(公告)日:2023-10-19
申请号:US18105709
申请日:2023-02-03
Applicant: Apple Inc.
Inventor: Tong Chen , Mark T. Winkler , Edward Vail , Xibin Zhou , Ahmet Fatih Cihan , Walter Nistico
CPC classification number: G02B27/0093 , G02B27/0172 , G02B2027/0138
Abstract: An eye tracking device includes a head-mountable frame, an optical sensor subsystem mounted to the head-mountable frame, and a processor. The optical sensor subsystem includes a set of one or more SMI sensors. The processor is configured to operate the optical sensor subsystem to cause the set of one or more SMI sensors to emit a set of one or more beams of light toward an eye of a user; to receive a set of one or more SMI signals from the set of one or more SMI sensors; and to track a movement of the eye using the set of one or more SMI signals.
-
8.
公开(公告)号:US20200064916A1
公开(公告)日:2020-02-27
申请号:US16667309
申请日:2019-10-29
Applicant: Apple Inc.
Inventor: Kun Liu , Fabian Wanner , Walter Nistico , Matthias Nieser
Abstract: The invention relates to a method for automatically identifying at least one user of an eye tracking device (10) by means of the eye tracking device (10), wherein user identification data of the at least one user are captured by a capturing device (14) of the eye tracking device (10). Under the first condition that at least one profile (P1, P2, P3) with associated identification data (I1, I2, I3) of at least one specific user is stored in a storage medium (20), the stored identification data (I1, I2, I3) of the at least one profile (P1, P2, P3) are compared with the captured user identification data, and under the second condition that the captured user identification data match the stored identification data (I1, I2, I3) according to a predefined criterion, the at least one user is identified as the at least one specific user, for whom the at least one profile (P1, P2, P3) was stored.
-
公开(公告)号:US10528127B2
公开(公告)日:2020-01-07
申请号:US15034895
申请日:2014-12-09
Applicant: APPLE INC.
Inventor: Claudio Caraffi , Matthias Nieser , Fabian Wanner , Walter Nistico
IPC: G06F3/01 , G06K9/00 , G06F1/3234 , G06F1/3206 , H04N5/225 , H04N5/232 , H04N5/247
Abstract: The invention relates to a method for operating an eye tracking device (10) comprising as components an imaging device (20), an illumination unit (30) and a processing unit (40) and further at least two adjustment parameters (PA), for adjusting the components (20; 30; 40). The eye tracking device (10) comprises a control unit (42) for controlling the adjustment parameters (PA). According to the method an image (60) of an eye is captured, a condition (44) with respect to a quality related to eye tracking or a power consumption of the components (20; 30; 40) is set, a predefined correlation (42a) correlating the adjustment parameters (PA) to the quality and the power consumption is provided and the control unit (42) controls the adjustment parameters (PA) according to the predefined correlation (42a), so that the element, with respect to which the condition (44) was set, fulfils the condition (44).
-
公开(公告)号:US20180005010A1
公开(公告)日:2018-01-04
申请号:US15702567
申请日:2017-09-12
Applicant: Apple Inc.
Inventor: Stefan Ronnecke , Thomas Jablonski , Christian Villwock , Walter Nistico
CPC classification number: G06K9/0061 , A61B3/113 , G06K9/00362 , G06K9/00604 , G06K9/00624 , G06K9/2054 , G06T7/246 , G06T7/70 , G06T7/73 , G06T11/60 , G06T2207/30201
Abstract: An eye tracking method comprising: capturing image data by an image sensor; determining a region of interest as a subarea or disconnected subareas of said sensor which is to be read out from said sensor to perform an eye tracking based on the read out image data; wherein said determining said region of interest comprises: a) initially reading out only a part of the area of said sensor; b) searching the image data of said initially read out part for one or more features representing the eye position and/or the head position of a subject to be tracked; c) if said search for one or more features has been successful, determining the region of interest based on the location of the successfully searched one or more features, and d) if said search for one or more features has not been successful, reading out a further part of said sensor to perform a search for one or more features representing the eye position and/or the head position based on said further part.
-
-
-
-
-
-
-
-
-