公开(公告)号：US11726560B2

公开(公告)日：2023-08-15

申请号：US17021912

申请日：2020-09-15

Applicant: Apple Inc.

Inventor： Tom Sengelaub

IPC: G06F3/01 ,  G02B27/00 ,  G06T7/20 ,  G02B27/01 ,  H04N23/65 ,  H04N23/667

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/017 ,  G06T7/20 ,  H04N23/651 ,  H04N23/667 ,  G02B2027/0138 ,  G02B2027/0178 ,  G06T2207/10048 ,  G06T2207/30196

Abstract: Low-power eye tracking for detecting position and movements of a user's eyes in a head-mounted device (HMD). An eye tracking system for an HMD may include eye tracking cameras and eye odometers that may reduce power consumption of the system. The eye odometers may be used as a low-power component to track relative movement of the user's eyes with respect to the HMD between frames captured by the eye tracking cameras, which may allow the frame rate of the eye tracking cameras to be reduced.

公开(公告)号：US20220027621A1

公开(公告)日：2022-01-27

申请号：US17499205

申请日：2021-10-12

Applicant: Apple Inc.

Inventor： Tom Sengelaub ,  Hua Gao ,  Hao Qin ,  Julia Benndorf

IPC: G06K9/00 ,  G06F3/01 ,  G06T7/70 ,  G06T7/50

Abstract: Some implementations of the disclosure involve, at a device having one or more processors, one or more image sensors, and an illumination source, detecting a first attribute of an eye based on pixel differences associated with different wavelengths of light in a first image of the eye. These implementations next determine a first location associated with the first attribute in a three dimensional (3D) coordinate system based on depth information from a depth sensor. Various implementations detect a second attribute of the eye based on a glint resulting from light of the illumination source reflecting off a cornea of the eye. These implementations next determine a second location associated with the second attribute in the 3D coordinate system based on the depth information from the depth sensor, and determine a gaze direction in the 3D coordinate system based on the first location and the second location.

公开(公告)号：US11087127B2

公开(公告)日：2021-08-10

申请号：US16710725

申请日：2019-12-11

Applicant: Apple Inc.

Inventor： Eberhard Schmidt ,  Tom Sengelaub

IPC: G06K9/00 ,  A61B5/16 ,  G05B19/042 ,  G06T7/70 ,  A61B3/113 ,  A61B5/11 ,  G06Q10/06

Abstract: The invention relates to a system and method to control a workflow comprising at least one task to be performed by a person (P3), wherein information is provided about at least one certain object (20, 32, 36, 38) related to the at least one task of the workflow, eye data (24, 26) are captured of at least one eye of the person (P3), and in dependency of the eye data (24, 26) and the information about the at least one certain object (20, 32, 36, 38) it is checked whether at least one task condition consisting in whether the task had been performed and/or whether the task is allowed to be performed is fulfilled. The invention also relates to a system and method for providing a set of task-specific control parameters (CP).

公开(公告)号：US10354136B2

公开(公告)日：2019-07-16

申请号：US15555441

申请日：2015-11-06

Applicant: APPLE INC.

Inventor： Tom Sengelaub ,  Walter Nistico ,  Matthias Nieser ,  Martin Haller ,  Denis Williams

IPC: G06K9/00 ,  G06G5/00 ,  A61B3/113 ,  G06F3/01 ,  G06T7/73 ,  G06T7/246 ,  G06T7/80 ,  A61B3/00 ,  A61B3/14

Abstract: The invention relates to a method and a head mounted eye tracking device (10a, 10b) for determining at least a feature of an eye (12), wherein the eye tracking device (10a, 10b) comprises a capturing device (C) for capturing light reflected by the eye (12) and an optical component (14; E, E1, En, E2) capable of altering a propagation direction of the light passing through the optical component (14; E, E1, En, E2). The eye tracking device (10a, 10b) is configured such that when fixed to the head of the user the light captured by the capturing device (C) has passed through the optical component (14; E, E1, En, E2) and constitutes at least part of an image and the feature is determined on the basis of the image in dependency of an information about a relative position between the eye (12) and the head mounted eye tracking device (10a, 10b).