-
公开(公告)号:US11681366B2
公开(公告)日:2023-06-20
申请号:US17574979
申请日:2022-01-13
申请人: Tobii AB
发明人: Tiesheng Wang , Gilfredo Remon Salazar , Yimu Wang , Pravin Kumar Rana , Johannes Kron , Mark Ryan , Torbjörn Sundberg
CPC分类号: G06F3/013 , G06V40/19 , G06V40/193
摘要: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
-
公开(公告)号:US11243607B2
公开(公告)日:2022-02-08
申请号:US16420818
申请日:2019-05-23
申请人: Tobii AB
发明人: Pravin Kumar Rana , Yimu Wang
摘要: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.
-
公开(公告)号:US20200026068A1
公开(公告)日:2020-01-23
申请号:US16449828
申请日:2019-06-24
申请人: Tobii AB
发明人: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC分类号: G02B26/08 , A61B5/16 , A61B3/11 , A61B3/113 , A61B5/107 , A61B5/11 , A61B5/00 , G06F3/01 , G06K9/00 , G02B27/00 , G06T7/73 , G06T7/70
摘要: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
公开(公告)号:US11593962B2
公开(公告)日:2023-02-28
申请号:US17136640
申请日:2020-12-29
申请人: Tobii AB
摘要: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation. For one or more right-eye-images and one or more corresponding left-eye-images, the eye tracking system can: determine at least one right-eye-gaze-signal based on the right-eye-image and at least one left-eye-gaze-signal based on the corresponding left-eye-image; and calculate a combined-gaze-signal from a weighted sum of the right-eye-gaze-signal and the left-eye-gaze-signal using the right-eye-weighting and the left-eye-weighting.
-
公开(公告)号:US20220207768A1
公开(公告)日:2022-06-30
申请号:US17136640
申请日:2020-12-29
申请人: Tobii AB
摘要: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation. For one or more right-eye-images and one or more corresponding left-eye-images, the eye tracking system can: determine at least one right-eye-gaze-signal based on the right-eye-image and at least one left-eye-gaze-signal based on the corresponding left-eye-image; and calculate a combined-gaze-signal from a weighted sum of the right-eye-gaze-signal and the left-eye-gaze-signal using the right-eye-weighting and the left-eye-weighting.
-
公开(公告)号:US11259010B2
公开(公告)日:2022-02-22
申请号:US16669914
申请日:2019-10-31
申请人: Tobii AB
发明人: Tiesheng Wang , Pravin Kumar Rana , Yimu Wang , Mark Ryan
IPC分类号: H04N13/00 , H04N13/383 , G06F3/01 , H04N13/344
摘要: Images of an eye are captured at respective time instances by a camera of a head-mounted device. For each time instance, a position of a center of corneal curvature is estimated using an image captured at that time instance, a position of a pupil center is estimated using an image captured at that time instance, and a line is determined through the estimated corneal curvature center position and the estimated pupil center position. A first estimated position of a center of the eye is computed based on the lines determined for time instances in a first time period. A second estimated position of the center of the eye is computed based on the lines determined for time instances in a second time period. Relocation of the head-mounted device relative to a user's head is detected based on the first and second estimated positions of the eye center.
-
公开(公告)号:US10852531B2
公开(公告)日:2020-12-01
申请号:US16449828
申请日:2019-06-24
申请人: Tobii AB
发明人: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC分类号: G02B26/08 , G06F3/01 , G06K9/00 , G02B27/00 , G06T7/73 , A61B5/16 , A61B3/11 , A61B3/113 , A61B5/107 , A61B5/11 , A61B5/00 , G06T7/70
摘要: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
-
-
-
-
-