-
公开(公告)号:US11249547B2
公开(公告)日:2022-02-15
申请号:US16670483
申请日:2019-10-31
Applicant: Tobii AB
Inventor: Tiesheng Wang , Gilfredo Remon Salazar , Yimu Wang , Pravin Kumar Rana , Johannes Kron , Mark Ryan , Torbjörn Sundberg
Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
-
2.
公开(公告)号:US11622103B2
公开(公告)日:2023-04-04
申请号:US16970549
申请日:2019-02-15
Applicant: Tobii AB
Inventor: Jonas Andersson , Anders Clausen , Richard Hainzl , Anders Kingbäck , Simon Olin , Mark Ryan , Daniel Tornéus , Björn Nutti , Torbjörn Sundberg , Catarina Tidbeck , Ralf Biedert , Niklas Blomqvist , Dennis Rådell , Robin Thunström
Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
-
公开(公告)号:US10852531B2
公开(公告)日:2020-12-01
申请号:US16449828
申请日:2019-06-24
Applicant: Tobii AB
Inventor: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC: G02B26/08 , G06F3/01 , G06K9/00 , G02B27/00 , G06T7/73 , A61B5/16 , A61B3/11 , A61B3/113 , A61B5/107 , A61B5/11 , A61B5/00 , G06T7/70
Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
公开(公告)号:US11665333B2
公开(公告)日:2023-05-30
申请号:US16917657
申请日:2020-06-30
Applicant: Tobii AB
Inventor: Daniel Tornéus , Torbjörn Sundberg , Magnus Arvidsson
CPC classification number: H04N17/002 , G02B27/0093 , G06F3/012 , G06F3/013 , G06T7/50 , G06T7/80 , H04N23/56 , G02B2027/0138 , G06T2207/30168 , G06T2207/30204 , G06T2207/30244
Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.
-
公开(公告)号:US20210076026A1
公开(公告)日:2021-03-11
申请号:US16917657
申请日:2020-06-30
Applicant: Tobii AB
Inventor: Daniel Tornéus , Torbjörn Sundberg , Magnus Arvidsson
Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.
-
公开(公告)号:US10394019B2
公开(公告)日:2019-08-27
申请号:US15893340
申请日:2018-02-09
Applicant: Tobii AB
Inventor: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC: A61B3/11 , A61B5/00 , A61B5/11 , A61B5/16 , G06F3/01 , G06K9/00 , G06T7/70 , G06T7/73 , A61B3/113 , A61B5/107 , G02B26/08 , G02B27/00
Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
公开(公告)号:US11681366B2
公开(公告)日:2023-06-20
申请号:US17574979
申请日:2022-01-13
Applicant: Tobii AB
Inventor: Tiesheng Wang , Gilfredo Remon Salazar , Yimu Wang , Pravin Kumar Rana , Johannes Kron , Mark Ryan , Torbjörn Sundberg
CPC classification number: G06F3/013 , G06V40/19 , G06V40/193
Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
-
公开(公告)号:US20200026068A1
公开(公告)日:2020-01-23
申请号:US16449828
申请日:2019-06-24
Applicant: Tobii AB
Inventor: Mark Ryan , Torbjörn Sundberg , Pravin Rana , Yimu Wang
IPC: G02B26/08 , A61B5/16 , A61B3/11 , A61B3/113 , A61B5/107 , A61B5/11 , A61B5/00 , G06F3/01 , G06K9/00 , G02B27/00 , G06T7/73 , G06T7/70
Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.
-
公开(公告)号:US20190253700A1
公开(公告)日:2019-08-15
申请号:US16232398
申请日:2018-12-26
Applicant: Tobii AB
Inventor: Daniel Tornéus , Torbjörn Sundberg , Magnus Arvidsson
CPC classification number: H04N17/002 , G02B27/0093 , G06F3/013 , G06T7/80 , G06T2207/30244 , H04N5/2256
Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.
-
10.
公开(公告)号:US11917126B2
公开(公告)日:2024-02-27
申请号:US18174079
申请日:2023-02-24
Applicant: Tobii AB
Inventor: Jonas Andersson , Anders Clausen , Richard Hainzl , Anders Kingbäck , Simon Olin , Mark Ryan , Daniel Tornéus , Björn Nutti , Torbjörn Sundberg , Catarina Tidbeck , Ralf Biedert , Niklas Blomqvist , Dennis Rådell , Robin Thunström
CPC classification number: H04N17/002 , G02B27/0093 , G06F3/012 , G06F3/013 , G06T7/50 , G06T7/80 , H04N23/56 , G02B2027/0138 , G06T2207/30168 , G06T2207/30204 , G06T2207/30244
Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
-
-
-
-
-
-
-
-
-