公开(公告)号：US20220253134A1

公开(公告)日：2022-08-11

申请号：US16716073

申请日：2019-12-16

Applicant: Tobii AB

Inventor： David Figgins Henderek ,  Anders Olsson ,  Magnus Carl Olof Sävmarker ,  Staffan Wingren

IPC: G06F3/01 ,  G06F3/033 ,  G06F3/0481 ,  G06F3/02 ,  G06F3/041 ,  G06F3/0482

Abstract: A computer system can be controlled with non-contact inputs through zonal control. In an embodiment, a non-contact input that is an eye-tracking device is used to track the gaze of a user. A computer's display, and beyond, can be separated into a number of discrete zones according to a configuration. Each zone is associated with a computer function. The zones and/or their functions can, but need not, be indicated to the user. The user can perform the various functions by moving gaze towards the zone associated with that function and providing an activation signal of intent. The activation signal of intent can be a contact-required or non-contact action, such as a button press or dwelling gaze, respectively.

公开(公告)号：US20210011548A1

公开(公告)日：2021-01-14

申请号：US16796239

申请日：2020-02-20

Applicant: Tobii AB

Inventor： Mårten Skogö ,  Anders Olsson ,  John Mikael Elvesjö ,  Aron Yu

IPC: G06F3/01 ,  G06F1/3234

Abstract: A gaze tracking system, leaving a low power mode in response to an activation signal, initial burst of eye pictures in short time by restricting the image area of a sensor, purpose of enabling an increased frame rate. Subsequent eye pictures are captured at le rate. The first gaze point value is computed memorylessly based on the initial burst res and no additional imagery, while subsequent values may be computed recursively to account previous gaze point values or information from previous eye pictures. The restriction of the image area may be guided by a preliminary overview picture captured using the different sensor. From the gaze point values, the system may derive a control signal to a computer device with a visual display.

公开(公告)号：US10534526B2

公开(公告)日：2020-01-14

申请号：US15851292

申请日：2017-12-21

Applicant: Tobii AB

Inventor： Anders Olsson ,  Mårten Skogö

IPC: G06F3/0485 ,  G06K9/00 ,  G06F1/16 ,  G06F3/01

Abstract: Disclosed are various embodiments for automatic scrolling of content displayed on a display device in response to gaze detection. Content may be displayed in a window rendered on a display screen. Gaze detection components may be used to detect that a user is gazing at the displayed content and to determine a gaze point relative to the display screen. At least one applicable scroll zone relative to the display screen and a scroll action associated with each applicable scroll zone may be determined. In response to determining that the gaze point is within a first applicable scroll zone, an associated first scroll action may be initiated. The first scroll action causes the content to scroll within the window until at least one of: expiration of a defined period, determining that a portion of the content scrolls past a defined position within the window, determining that the gaze point is outside of the first scroll zone, and detecting an indicator that the user begins reading the content.

公开(公告)号：US10452140B2

公开(公告)日：2019-10-22

申请号：US16216788

申请日：2018-12-11

Applicant: Tobii AB

Inventor： John Elvesjö ,  Anders Olsson ,  Johan Sahlén

IPC: G06F3/033 ,  G09G5/08 ,  G06F3/01 ,  G06F3/03 ,  G06F3/16

Abstract: The present invention relates to control of a computer system, which includes a data processing unit, a display and an eye tracker adapted to register a user's gaze point with respect to the display. The data processing unit is adapted to present graphical information on the display, which includes feedback data reflecting the user's commands entered into the unit. The data processing unit is adapted to present the feedback data such that during an initial phase, the feedback data is generated based on an absolute position of the gaze point. An imaging device of the system is also adapted to register image data representing movements of a body part of the user and to forward a representation of the image data to the data processing unit. Hence, during a phase subsequent to the initial phase, the data is instead generated based on the image data.

公开(公告)号：US10394320B2

公开(公告)日：2019-08-27

申请号：US15379233

申请日：2016-12-14

Applicant: Tobii AB

Inventor： Erland George-Svahn ,  Dzenan Dzemidzic ,  Anders Vennström ,  Ida Nilsson ,  Anders Olsson ,  Rebecka Lannsjö ,  Mårten Skogö

IPC: G06F3/01 ,  G06F1/16 ,  G06F3/0488 ,  G02B27/01 ,  G06F3/16

Abstract: A method and system for assisting a user when interacting with a graphical user interface combines gaze based input with gesture based user commands. A user of a computer system without a traditional touch-screen can interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. A solution for touch-screen like interaction uses gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen. Combined gaze and gesture based interaction with graphical user interfaces can be used to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavorable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.

公开(公告)号：US10372203B2

公开(公告)日：2019-08-06

申请号：US14290634

申请日：2014-05-29

Applicant: Tobii AB

Inventor： Mårten Skogö ,  John Mikael Elvesjö ,  Anders Olsson

IPC: G06F3/01 ,  G06F3/03

Abstract: A personal computer system provides a gaze-controlled graphical user interface having a bidirectional and a unidirectional interaction mode. In the bidirectional interaction mode, a display shows one or more graphical controls in motion, each being associated with an input operation to an operating system. A gaze tracking system provides gaze point data of a viewer, and a matching module attempts to match a relative gaze movement against a relative movement of one of the graphical controls. The system includes a selector which is preferably controllable by a modality other than gaze. The system initiates a transition from the unidirectional interaction mode to the bidirectional interaction mode in response to an input received at the selector. The display then shows graphical controls in motion in a neighborhood of the current gaze point, as determined based on current gaze data.

公开(公告)号：US10216994B2

公开(公告)日：2019-02-26

申请号：US15818439

申请日：2017-11-20

Applicant: Tobii AB

Inventor： Simon Gustafsson ,  Henrik Björk ,  Fredrik Lindh ,  Anders Olsson

IPC: G09G5/00 ,  G06K9/00 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/03 ,  G06F3/0485 ,  G09G5/34 ,  A61B3/113

Abstract: A method for panning content on a display of a wearable device is disclosed. The method may include determining, via an eye tracking device, a gaze direction of a user. The method may also include determining, via a movement detection system, a head direction of the user. The method may further include, based at least in part on the gaze direction and the head direction both being consistent with a particular direction, causing content displayed on a display of the wearable device to be panned in the particular direction. The method may additionally include determining during panning of the content, via the eye tracking device, that the gaze direction of the user has returned to a neutral position. The method may moreover include, based at least in part on the gaze direction of the user returning to the neutral position, causing content displayed on the display to stop panning.

公开(公告)号：US20190050644A1

公开(公告)日：2019-02-14

申请号：US16162223

申请日：2018-10-16

Applicant: Tobii AB

Inventor： Simon Gustafsson ,  Henrik Björk ,  Fredrik Lindh ,  Anders Olsson

IPC: G06K9/00 ,  G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06F3/03 ,  G06F3/0481 ,  G09G5/34 ,  G06F3/0485 ,  G06F3/0484 ,  A61B3/113

CPC classification number: G06K9/00604 ,  A61B3/113 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0179 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0304 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/0485 ,  G06F2203/0381 ,  G09G5/34 ,  G09G2340/0464 ,  G09G2354/00

Abstract: A method for panning content on a display of a wearable device is disclosed. The method may include determining, via an eye tracking device, a gaze direction of a user. The method may also include determining, via a movement detection system, a head direction of the user. The method may further include, based at least in part on the gaze direction and the head direction both being consistent with a particular direction, causing content displayed on a display of the wearable device to be panned in the particular direction. The method may additionally include determining during panning of the content, via the eye tracking device, that the gaze direction of the user has returned to a neutral position. The method may moreover include, based at least in part on the gaze direction of the user returning to the neutral position, causing content displayed on the display to stop panning.

公开(公告)号：US10025381B2

公开(公告)日：2018-07-17

申请号：US14601007

申请日：2015-01-20

Applicant: Tobii AB

Inventor： Markus Cederlund ,  Robert Gavelin ,  Anders Vennström ,  Anders Kaplan ,  Anders Olsson ,  Mårten Skogö ,  Erland George-Svahn

IPC: G06F3/01 ,  G06F3/0354 ,  G06F3/038 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/0488 ,  G02B27/01

Abstract: A control module for generating gesture based commands during user interaction with an information presentation area is provided. The control module is configured to acquire user input from a touchpad and gaze data signals from a gaze tracking module; and determine at least one user generated gesture based control command based on a user removing contact of a finger of the user with the touchpad; determine a gaze point area on the information presentation area including the user's gaze point based on at least the gaze data signals; and execute at least one user action manipulating a view presented on the graphical information presentation area based on the determined gaze point area and at least one user generated gesture based control command, wherein the user action is executed at said determined gaze point area.

公开(公告)号：US20180181272A1

公开(公告)日：2018-06-28

申请号：US15851292

申请日：2017-12-21

Applicant: Tobii AB

Inventor： Anders Olsson ,  Mårten Skogö

IPC: G06F3/0485 ,  G06F1/16 ,  G06K9/00 ,  G06F3/01

CPC classification number: G06F3/0485 ,  G06F1/1686 ,  G06F3/013 ,  G06K9/00604

Abstract: Disclosed are various embodiments for automatic scrolling of content displayed on a display device in response to gaze detection. Content may be displayed in a window rendered on a display screen. Gaze detection components may be used to detect that a user is gazing at the displayed content and to determine a gaze point relative to the display screen. At least one applicable scroll zone relative to the display screen and a scroll action associated with each applicable scroll zone may be determined. In response to determining that the gaze point is within a first applicable scroll zone, an associated first scroll action may be initiated. The first scroll action causes the content to scroll within the window until at least one of: expiration of a defined period, determining that a portion of the content scrolls past a defined position within the window, determining that the gaze point is outside of the first scroll zone, and detecting an indicator that the user begins reading the content.