-
公开(公告)号:US20240310908A1
公开(公告)日:2024-09-19
申请号:US18673189
申请日:2024-05-23
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193 , G06F2203/011
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device, wherein a stimulus object is displayed within a certain display area, such that the stimulus object is at least temporarily moving along a defined trajectory and images of at least one eye of at least one user are captured during the displaying of the stimulus object.
-
公开(公告)号:US20230333371A1
公开(公告)日:2023-10-19
申请号:US18105709
申请日:2023-02-03
Applicant: Apple Inc.
Inventor: Tong Chen , Mark T. Winkler , Edward Vail , Xibin Zhou , Ahmet Fatih Cihan , Walter Nistico
CPC classification number: G02B27/0093 , G02B27/0172 , G02B2027/0138
Abstract: An eye tracking device includes a head-mountable frame, an optical sensor subsystem mounted to the head-mountable frame, and a processor. The optical sensor subsystem includes a set of one or more SMI sensors. The processor is configured to operate the optical sensor subsystem to cause the set of one or more SMI sensors to emit a set of one or more beams of light toward an eye of a user; to receive a set of one or more SMI signals from the set of one or more SMI sensors; and to track a movement of the eye using the set of one or more SMI signals.
-
3.
公开(公告)号:US20200064916A1
公开(公告)日:2020-02-27
申请号:US16667309
申请日:2019-10-29
Applicant: Apple Inc.
Inventor: Kun Liu , Fabian Wanner , Walter Nistico , Matthias Nieser
Abstract: The invention relates to a method for automatically identifying at least one user of an eye tracking device (10) by means of the eye tracking device (10), wherein user identification data of the at least one user are captured by a capturing device (14) of the eye tracking device (10). Under the first condition that at least one profile (P1, P2, P3) with associated identification data (I1, I2, I3) of at least one specific user is stored in a storage medium (20), the stored identification data (I1, I2, I3) of the at least one profile (P1, P2, P3) are compared with the captured user identification data, and under the second condition that the captured user identification data match the stored identification data (I1, I2, I3) according to a predefined criterion, the at least one user is identified as the at least one specific user, for whom the at least one profile (P1, P2, P3) was stored.
-
公开(公告)号:US10528127B2
公开(公告)日:2020-01-07
申请号:US15034895
申请日:2014-12-09
Applicant: APPLE INC.
Inventor: Claudio Caraffi , Matthias Nieser , Fabian Wanner , Walter Nistico
IPC: G06F3/01 , G06K9/00 , G06F1/3234 , G06F1/3206 , H04N5/225 , H04N5/232 , H04N5/247
Abstract: The invention relates to a method for operating an eye tracking device (10) comprising as components an imaging device (20), an illumination unit (30) and a processing unit (40) and further at least two adjustment parameters (PA), for adjusting the components (20; 30; 40). The eye tracking device (10) comprises a control unit (42) for controlling the adjustment parameters (PA). According to the method an image (60) of an eye is captured, a condition (44) with respect to a quality related to eye tracking or a power consumption of the components (20; 30; 40) is set, a predefined correlation (42a) correlating the adjustment parameters (PA) to the quality and the power consumption is provided and the control unit (42) controls the adjustment parameters (PA) according to the predefined correlation (42a), so that the element, with respect to which the condition (44) was set, fulfils the condition (44).
-
公开(公告)号:US20180005010A1
公开(公告)日:2018-01-04
申请号:US15702567
申请日:2017-09-12
Applicant: Apple Inc.
Inventor: Stefan Ronnecke , Thomas Jablonski , Christian Villwock , Walter Nistico
CPC classification number: G06K9/0061 , A61B3/113 , G06K9/00362 , G06K9/00604 , G06K9/00624 , G06K9/2054 , G06T7/246 , G06T7/70 , G06T7/73 , G06T11/60 , G06T2207/30201
Abstract: An eye tracking method comprising: capturing image data by an image sensor; determining a region of interest as a subarea or disconnected subareas of said sensor which is to be read out from said sensor to perform an eye tracking based on the read out image data; wherein said determining said region of interest comprises: a) initially reading out only a part of the area of said sensor; b) searching the image data of said initially read out part for one or more features representing the eye position and/or the head position of a subject to be tracked; c) if said search for one or more features has been successful, determining the region of interest based on the location of the successfully searched one or more features, and d) if said search for one or more features has not been successful, reading out a further part of said sensor to perform a search for one or more features representing the eye position and/or the head position based on said further part.
-
公开(公告)号:US11856305B2
公开(公告)日:2023-12-26
申请号:US17401385
申请日:2021-08-13
Applicant: APPLE INC.
Inventor: Emanuele Mandelli , Walter Nistico
Abstract: In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.
-
公开(公告)号:US20210334992A1
公开(公告)日:2021-10-28
申请号:US17236129
申请日:2021-04-21
Applicant: Apple Inc.
Inventor: Walter Nistico
Abstract: Various implementations disclosed herein include techniques for estimating depth using sensor data indicative of changes in light intensity. In one implementation a method includes acquiring pixel events output by an event sensor that correspond to a scene disposed within a field of view of the event sensor. Each respective pixel event is generated in response to a specific pixel sensor within a pixel array of the event sensor detecting a change in light intensity that exceeds a comparator threshold. Mapping data is generated by correlating the pixel events with multiple illumination patterns projected by an optical system towards the scene. Depth data is determined for the scene relative to a reference position based on the mapping data.
-
公开(公告)号:US10976813B2
公开(公告)日:2021-04-13
申请号:US16308804
申请日:2017-06-12
Applicant: APPLE INC.
Inventor: Walter Nistico , Andrii Nikiforov , Borys Lysyansky
Abstract: The invention is concerned with a method for performing a calibration procedure for calibrating an eye tracking device (12), wherein a stimulus object (S) is displayed within a certain display area (22), such that the stimulus object (S) is at least temporarily moving along a defined trajectory (26) and images of at least one eye (16) of at least one user (18) are captured during the displaying of the stimulus object (S). Based on the captured images gaze data are provided and in dependency of the gaze data gaze points (P) of the at least one eye (16) of the user (18) with respect to the display area (22) are determined. Further, at least one calibration parameter (a1; a2; a3; a4; a5; a6; a7; a8; a9; a10; a11; a12; a13; a14; Θ; R; K; a; b; r) of at least one predefined calibration model (M, M1, M2, M3, M4, M5, M6) is determined in dependency of a first analysis at least of positions of at least part of the respective gaze points (P) with regard to the defined trajectory (26) of the stimulus object (S). Further, at least one control parameter (N, (A, D), T) is determined in dependency of at least part of the captured gaze data and controlling the execution of at least part of the calibration procedure in dependency of the at least one determined control parameter (N, (A, D), T).
-
9.
公开(公告)号:US10416764B2
公开(公告)日:2019-09-17
申请号:US15557599
申请日:2016-03-10
Applicant: APPLE INC.
Inventor: Fabian Wanner , Matthias Nieser , Kun Liu , Walter Nistico
Abstract: The invention relates to a method for operating an eye tracking device (10) for multi-user eye tracking, wherein images (24) of a predefined capturing area (14) of the eye tracking device (10) are captured by means of an imaging device (12) of the eye tracking device (10) and the captured images (24) are processed by means of a processing unit (16) of the eye tracking device (10). If a first user (26a) and a second user (26b) are present in the predefined capturing area (14) of the eye tracking device (10), a first information relating to the first user (26a) and a second information relating to the second user (26b) are determined on the basis of the captured images (24) by processing the images (24). Furthermore the images (24) are captured successively in a predeterminable time sequence.
-
10.
公开(公告)号:US10354136B2
公开(公告)日:2019-07-16
申请号:US15555441
申请日:2015-11-06
Applicant: APPLE INC.
Inventor: Tom Sengelaub , Walter Nistico , Matthias Nieser , Martin Haller , Denis Williams
IPC: G06K9/00 , G06G5/00 , A61B3/113 , G06F3/01 , G06T7/73 , G06T7/246 , G06T7/80 , A61B3/00 , A61B3/14
Abstract: The invention relates to a method and a head mounted eye tracking device (10a, 10b) for determining at least a feature of an eye (12), wherein the eye tracking device (10a, 10b) comprises a capturing device (C) for capturing light reflected by the eye (12) and an optical component (14; E, E1, En, E2) capable of altering a propagation direction of the light passing through the optical component (14; E, E1, En, E2). The eye tracking device (10a, 10b) is configured such that when fixed to the head of the user the light captured by the capturing device (C) has passed through the optical component (14; E, E1, En, E2) and constitutes at least part of an image and the feature is determined on the basis of the image in dependency of an information about a relative position between the eye (12) and the head mounted eye tracking device (10a, 10b).
-
-
-
-
-
-
-
-
-