公开(公告)号：US10699439B2

公开(公告)日：2020-06-30

申请号：US16290934

申请日：2019-03-03

Applicant: APPLE INC.

Inventor： Jan Hoffmann ,  Tom Sengelaub ,  Denis Williams

IPC: G06K9/00 ,  G06T7/73 ,  A61B3/113

Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

公开(公告)号：US11676302B2

公开(公告)日：2023-06-13

申请号：US16878932

申请日：2020-05-20

Applicant: APPLE INC.

Inventor： Jan Hoffmann ,  Tom Sengelaub ,  Denis Williams

IPC: G06K9/00 ,  G06T7/73 ,  A61B3/113 ,  G06V40/19

CPC classification number: G06T7/75 ,  A61B3/113 ,  G06V40/19 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/30201

Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

公开(公告)号：US11314089B2

公开(公告)日：2022-04-26

申请号：US16080381

申请日：2017-03-06

Applicant: APPLE INC.

Inventor： Tobias Langner ,  Martin Haller ,  Denis Williams ,  Arnd Rose

IPC: G02B27/01 ,  G06F3/01 ,  G06K9/00 ,  G02B27/00 ,  G06Q30/00 ,  H04N13/344 ,  G06Q30/02

Abstract: The invention relates to a method for evaluating at least one view image (M) in order to image at least one viewpoint, which is provided in relation to at least one scene shot (S) of a scene (12), and/or at least one view direction of at least one person (10), said view direction being provided in relation to the at least one scene shot (S), towards a reference, the content of which matches at least one part of the scene (12). The at least one scene shot (S) is provided with the at least one assigned viewpoint (B) and/or the at least one assigned view direction, and the reference (R) is provided together with a result (B′) of the at least one view image (M). Furthermore, the at least one view image (M) is evaluated by means of at least one predefined quality measurement (GM), and the result of the evaluation is provided.

公开(公告)号：US20240233178A1

公开(公告)日：2024-07-11

申请号：US18581765

申请日：2024-02-20

Applicant: Apple Inc.

Inventor： Jan Hoffmann ,  Tom Sengelaub ,  Denis Williams

IPC: G06T7/73 ,  A61B3/113 ,  G06V40/19

CPC classification number: G06T7/75 ,  A61B3/113 ,  G06V40/19 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/30201

Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

公开(公告)号：US11579686B2

公开(公告)日：2023-02-14

申请号：US16080386

申请日：2017-03-06

Applicant: APPLE INC.

Inventor： Eberhard Schmidt ,  Martin Haller ,  Denis Williams ,  Tobias Langner

IPC: G06F3/01 ,  G02B27/01 ,  G06Q30/02 ,  G06T7/194 ,  G06T7/20 ,  G06V20/20 ,  G06V20/00 ,  G06V40/19 ,  H04N13/344 ,  G06Q30/0251 ,  G06T15/20 ,  G02B27/00 ,  G06V10/28 ,  G06F18/24

Abstract: The invention relates to a device and a method for performing an eye gaze mapping (M), in which at least one point of vision (B) and/or a viewing direction of at least one person (10) in relation to at least one scene recording (S) of a scene (12) viewed by the at least one person (10) is mapped onto a reference (R). At least a part of an algorithm (A1, A2, A3) for performing the eye gaze mapping (M) is thereby selected from multiple predetermined algorithms (A1, A2, A3) as a function of at least one parameter (P), and the eye gaze mapping (M) is performed on the basis of the at least one part of the algorithm (A1, A2, A3).

公开(公告)号：US10354136B2

公开(公告)日：2019-07-16

申请号：US15555441

申请日：2015-11-06

Applicant: APPLE INC.

Inventor： Tom Sengelaub ,  Walter Nistico ,  Matthias Nieser ,  Martin Haller ,  Denis Williams

IPC: G06K9/00 ,  G06G5/00 ,  A61B3/113 ,  G06F3/01 ,  G06T7/73 ,  G06T7/246 ,  G06T7/80 ,  A61B3/00 ,  A61B3/14

Abstract: The invention relates to a method and a head mounted eye tracking device (10a, 10b) for determining at least a feature of an eye (12), wherein the eye tracking device (10a, 10b) comprises a capturing device (C) for capturing light reflected by the eye (12) and an optical component (14; E, E1, En, E2) capable of altering a propagation direction of the light passing through the optical component (14; E, E1, En, E2). The eye tracking device (10a, 10b) is configured such that when fixed to the head of the user the light captured by the capturing device (C) has passed through the optical component (14; E, E1, En, E2) and constitutes at least part of an image and the feature is determined on the basis of the image in dependency of an information about a relative position between the eye (12) and the head mounted eye tracking device (10a, 10b).

公开(公告)号：US11948332B2

公开(公告)日：2024-04-02

申请号：US18111099

申请日：2023-02-17

Applicant: APPLE INC.

Inventor： Jan Hoffmann ,  Tom Sengelaub ,  Denis Williams

IPC: G06K9/00 ,  A61B3/113 ,  G06T7/73 ,  G06V40/19

CPC classification number: G06T7/75 ,  A61B3/113 ,  G06V40/19 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/30201

Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.