公开(公告)号：US20240161374A1

公开(公告)日：2024-05-16

申请号：US18054802

申请日：2022-11-11

申请人： Tobii AB

发明人： Daniel Johansson Tornéus ,  Johan Bouvin

IPC分类号： G06T13/40 ,  G06F3/01

CPC分类号： G06T13/40 ,  G06F3/012 ,  G06F3/013

摘要： Systems and methods for avatar eye animation is provided. The method include obtaining a first gaze vector of a user associated with a first eye of the user and obtaining a second gaze vector of the user associated with a second eye of the user. The method further includes determining a first point in a three-dimensional (3D) virtual space that the user is looking toward. The method also includes creating a second point in the 3D virtual space corresponding to the first point in the 3D virtual space. The method then includes rendering a first eye and a second eye of an avatar of the user in the 3D virtual space based on the second point in the 3D virtual space such that the first eye and the second eye of the avatar are looking toward the second point in the 3D virtual space.

公开(公告)号：US11917126B2

公开(公告)日：2024-02-27

申请号：US18174079

申请日：2023-02-24

申请人： Tobii AB

发明人： Jonas Andersson ,  Anders Clausen ,  Richard Hainzl ,  Anders Kingbäck ,  Simon Olin ,  Mark Ryan ,  Daniel Tornéus ,  Björn Nutti ,  Torbjörn Sundberg ,  Catarina Tidbeck ,  Ralf Biedert ,  Niklas Blomqvist ,  Dennis Rådell ,  Robin Thunström

IPC分类号： G09G5/00 ,  H04N17/00 ,  G06F3/01 ,  G06T7/80 ,  G02B27/00 ,  G06T7/50 ,  H04N23/56 ,  G02B27/01

CPC分类号： H04N17/002 ,  G02B27/0093 ,  G06F3/012 ,  G06F3/013 ,  G06T7/50 ,  G06T7/80 ,  H04N23/56 ,  G02B2027/0138 ,  G06T2207/30168 ,  G06T2207/30204 ,  G06T2207/30244

摘要： An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.

公开(公告)号：US20230390972A1

公开(公告)日：2023-12-07

申请号：US18258887

申请日：2021-01-21

申请人： Tobii AB

发明人： Marcin Krajewski

IPC分类号： B29C39/26 ,  B29C39/02 ,  B29C33/38 ,  B29C39/10

CPC分类号： B29C39/26 ,  B29C39/026 ,  B29C33/38 ,  B29C39/10 ,  B29K2105/0002

摘要： A method of forming a polymer is disclosed. The method comprises: positioning a mould in relation to a bath containing a molten material to form a mould cavity between the mould and the molten material; adding a monomer within the mould cavity; and curing the monomer to form a polymer.

公开(公告)号：US20230319417A1

公开(公告)日：2023-10-05

申请号：US18127718

申请日：2023-03-29

申请人： TOBII AB

发明人： SIMON JOHANSSON ,  MIKAEL ROSELL

IPC分类号： H04N23/695 ,  G06V40/18 ,  G06F3/01 ,  G02B27/01

CPC分类号： H04N23/695 ,  G06V40/193 ,  G06F3/013 ,  G02B27/017 ,  G06V2201/07

摘要： The invention is related to a method and arrangement for calibrating the camera of an eye tracking device and compensate for a potential angular offset of the camera. The method comprises: the steps of capturing an eye image of a user, wherein the eye image contains a plurality of glints created by a plurality of illuminators in the eye tracking system; detecting glints in the eye image; projecting illuminator positions onto the eye image to determine expected glint positions; determining an angular offset between expected glint positions and detected glint positions for corresponding pairs of expected and detected glint positions; determining the angular correction for the eye tracking camera using the determined angular offset angle; and applying the angular correction for the eye tracking camera to an eye tracker camera model.

公开(公告)号：US20230314797A1

公开(公告)日：2023-10-05

申请号：US17709462

申请日：2022-03-31

申请人： Tobii AB

发明人： Kayla Kearns ,  Louise Wändesjö ,  Fredrik Norén ,  Ola Glimåker ,  Mårten Selin

IPC分类号： G02B27/00 ,  G02B27/01

CPC分类号： G02B27/0093 ,  G02B27/0101 ,  G02B2027/0138

摘要： The invention is related to an assembly for an eye-tracking system, the assembly comprising a substantially ring-shaped carrier, a seat in the carrier, a plurality of light emitting devices disposed on a substrate, wherein the substrate is positioned against the seat, an alignment window comprising an opening extending through the carrier, an imaging device provided within and supported by the alignment window, wherein the imaging device is facing inwardly, and wherein the carrier is configured to guide light emitted from the plurality of light emitting devices towards an eye of a user when the assembly is used with the eye tracking system. The invention also relates to a corresponding head-mounted device utilizing the assembly.

公开(公告)号：US11715231B2

公开(公告)日：2023-08-01

申请号：US17210079

申请日：2021-03-23

申请人： Tobii AB

发明人： Mårten Skogö

IPC分类号： G06V10/00 ,  G06T7/73 ,  G06V40/10 ,  G06V40/18 ,  G06F3/01

CPC分类号： G06T7/73 ,  G06F3/012 ,  G06V40/10 ,  G06V40/18 ,  G06T2207/20081 ,  G06T2207/30201

摘要： Head pose information may be determined using information describing a fixed gaze and image data corresponding to a user's eyes. The head pose information may be determined in a manner that is disregards facial features with the exception of the user's eyes. The head pose information may be usable to interact with a user device.

公开(公告)号：US11709545B2

公开(公告)日：2023-07-25

申请号：US16773056

申请日：2020-01-27

申请人： Tobii AB

发明人： Fredrik Lindh ,  Mattias Gustavsson ,  Anders Vennström ,  Andreas Edling

IPC分类号： G06F3/01 ,  A61B3/113 ,  G05D1/02 ,  G06T19/00

CPC分类号： G06F3/013 ,  A61B3/113 ,  G05D1/027 ,  G05D1/0242 ,  G05D1/0244 ,  G05D1/0263 ,  G06T19/006

摘要： A method for determining if a user's gaze is directed in the direction of a zone of interest in a 3D scene comprises: providing a 3D scene containing a zone of interest; associating a property with the zone of interest; creating a bitmap representing the location of the zone of interest in a projected view of the 3D scene, each pixel of the bitmap to which the zone of interest is projected storing the property of the zone of interest; detecting the direction of the user's gaze; using the bitmap to determine if the detected user's gaze is directed in the direction of the zone of interest.

公开(公告)号：US11699439B2

公开(公告)日：2023-07-11

申请号：US17129188

申请日：2020-12-21

申请人： Tobii AB

发明人： Erland George-Svahn ,  Sourabh Pateriya ,  Onur Kurt ,  Deepak Akkil

IPC分类号： G10L15/22 ,  G10L17/06 ,  G10L17/24 ,  G10L25/78 ,  G06V40/10 ,  G06V40/19 ,  G06V40/16

CPC分类号： G10L15/22 ,  G06V40/10 ,  G06V40/174 ,  G06V40/19 ,  G10L17/06 ,  G10L17/24 ,  G10L25/78 ,  G10L2015/226

摘要： Method for voice-based interactive communication using a digital assistant, wherein the method comprises,

an attention detection step, in which the digital assistant detects a user attention and as a result is set into a listening mode;
a speaker detection step, in which the digital assistant detects the user as a current speaker;
a speech sound detection step, in which the digital assistant detects and records speech uttered by the current speaker, which speech sound detection step further comprises a lip movement detection step, in which the digital assistant detects a lip movement of the current speaker;
a speech analysis step, in which the digital assistant parses said recorded speech and extracts speech-based verbal informational content from said recorded speech; and
a subsequent response step, in which the digital assistant provides feed-back to the user based on said recorded speech.

公开(公告)号：US20230217008A1

公开(公告)日：2023-07-06

申请号：US18174079

申请日：2023-02-24

申请人： Tobii AB

发明人： Jonas Andersson ,  Anders Clausen ,  Richard Hainzl ,  Anders Kingbäck ,  Simon Olin ,  Mark Ryan ,  Daniel Tornéus ,  Björn Nutti ,  Torbjörn Sundberg ,  Catarina Tidbeck ,  Ralf Biedert ,  Niklas Blomqvist ,  Dennis Rådell ,  Robin Thunström

IPC分类号： H04N17/00 ,  G06F3/01 ,  G06T7/80 ,  G02B27/00 ,  G06T7/50 ,  H04N23/56

CPC分类号： H04N17/002 ,  G02B27/0093 ,  G06F3/012 ,  G06F3/013 ,  G06T7/50 ,  G06T7/80 ,  H04N23/56 ,  G02B2027/0138 ,  G06T2207/30244

摘要： An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.

公开(公告)号：US20230214011A1

公开(公告)日：2023-07-06

申请号：US18146215

申请日：2022-12-23

申请人： Tobii AB

发明人： Denny Rönngren

IPC分类号： G06F3/01 ,  G06T19/20

CPC分类号： G06F3/013 ,  G06T19/20 ,  G06T2219/2016

摘要： Method for determining a current gaze direction of a user in relation to a three-dimensional (“3D”) scene, the 3D scene being sampled by a rendering function to produce at least one projection image of the 3D scene, wherein the method comprises the steps: determining, by a reprojection means, a reprojection transformation to be applied to the projection image before being displayed so as to be visible to the user at a gaze time point; determining, by a gaze direction detection means, a physical gaze direction of the user at said gaze time point; and determining a modified gaze direction of the user at said gaze time point, the modified gaze direction being determined in relation to the 3D scene based on both the physical gaze direction and the reprojection transformation. The disclosure also relates to a system and to a computer software function.