-
公开(公告)号:US10699439B2
公开(公告)日:2020-06-30
申请号:US16290934
申请日:2019-03-03
Applicant: APPLE INC.
Inventor: Jan Hoffmann , Tom Sengelaub , Denis Williams
Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.
-
公开(公告)号:US20240403402A1
公开(公告)日:2024-12-05
申请号:US18733414
申请日:2024-06-04
Applicant: Apple Inc.
Inventor: Martin Haller , Andrei Nikiforov , Benjamin Biron , Kyle C. Brogle , Lucie Kucerova , Oliver G. Wenisch , Petr Kostka , Tom Sengelaub , Tomislav Suchan
IPC: G06F21/32
Abstract: Techniques are disclosed relating to devices that support biometric authentication. In various embodiments, a device includes a biosensor configured to collect biometric data from a user. An authentication system of the device is configured to perform a user authentication based on the collected biometric data. After performance of the user authentication, the authentication system receives sensor data indicating that the user remains collocated with the device and receives a request to confirm an authentication of the user. Based on the user authentication and the received sensor data, the authentication system confirms that the user has been authenticated. In various embodiments, the authentication system is configured to receive additional sensor data indicating that the user is no longer collocated with the device and, in response to a subsequent authentication request, require the user to perform another biometric authentication using the biosensor.
-
公开(公告)号:US20240397032A1
公开(公告)日:2024-11-28
申请号:US18662826
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Michael J. Rockwell , Oriel Y. Bergig , Geoffrey Stahl , Thibaut Weise , Peter Kaufmann , Branko Petljanski , Jason L. Slupeiks , Tom Sengelaub , Kathrin Berkner Cieslicki , Yanghai Tsin , Hesam Najafi , Arthur Y. Zhang , Cheng Chen , Graham B. Myhre , Fletcher R. Rothkopf , Marinus Meursing , Phil M. Hobson , Jason C. Sauers , Jan K. Quijalvo , Jia Tao , Ivan S. Maric , Jeremy C. Franklin , Wey-Jiun Lin , Muhammad F. Hossain
IPC: H04N13/361 , G06F3/01 , H04N13/204 , H04N13/344 , H04N13/383
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US12093451B2
公开(公告)日:2024-09-17
申请号:US18014848
申请日:2021-06-24
Applicant: APPLE INC.
Inventor: Tobias Eble , Tom Sengelaub
CPC classification number: G06F3/013 , G06T7/70 , G06T2207/30244
Abstract: Various implementations disclosed herein include devices, systems, and methods that assess calibration between eye tracking and other components of a head-mounted device (HMD) using another device, such as a mobile device. For example, an example process may include obtaining first sensor data captured by a first sensor of a first device, the first sensor data including a representation of a portion of a second device, obtaining second sensor data captured by a second sensor of the second device, detecting a position of the first sensor of the first device based on the second sensor data, and assessing a calibration between the portion of the second device and the sensor of the second device based on the first sensor data and the detected position of the first sensor.
-
公开(公告)号:US20240272709A1
公开(公告)日:2024-08-15
申请号:US18568256
申请日:2022-06-08
Applicant: Apple Inc.
Inventor: Hao Qin , Hua Gao , Tom Sengelaub , Chia-Yin Tsai
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: Methods and apparatus for generating user-aware eye models. During an enrollment process, images of a user's eye are captured by one or more cameras when the eye is in two or more different orientations and at two or more different levels of display brightness. The captured images are processed to generate a 3-dimensional, user-aware eye model, for example a model of at least the eye's cornea and pupil features. The generated user-aware eye model may be used in other processes, for example in a gaze tracking process. The enrollment process may be an iterative process to optimize the eye model, or a continuous process performed while the user is using the system.
-
公开(公告)号:US20240233178A1
公开(公告)日:2024-07-11
申请号:US18581765
申请日:2024-02-20
Applicant: Apple Inc.
Inventor: Jan Hoffmann , Tom Sengelaub , Denis Williams
CPC classification number: G06T7/75 , A61B3/113 , G06V40/19 , G06T2200/04 , G06T2207/10028 , G06T2207/20076 , G06T2207/30201
Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.
-
公开(公告)号:US20240211569A1
公开(公告)日:2024-06-27
申请号:US18534346
申请日:2023-12-08
Applicant: Apple Inc.
Inventor: Gendong Zhang , Martin Haller , Abhishek Nagar , Saurabh Jain , Stefan Roennecke , Tomi P Maila , Andrei Nikiforov , Tom Sengelaub
CPC classification number: G06F21/32 , G06V40/19 , G06V40/193 , G06V40/197
Abstract: Methods for performing user authentication based on a multi-representation eye model for devices such as head-mounted display devices are disclosed. The multi-representation eye model may be generated and updated based on feature representations of an identified eye. The user authentication process may be initiated by causing an image to be captured of a current eye under a first set of conditions that may then be transformed into a current feature representation. The current feature representation may be applied to the multi-representation eye model to determine whether the current eye is a match for the identified eye.
-
公开(公告)号:US20240211039A1
公开(公告)日:2024-06-27
申请号:US18534398
申请日:2023-12-08
Applicant: Apple Inc.
Inventor: Hao Qin , Hua Gao , Tom Sengelaub
CPC classification number: G06F3/013 , G06F1/163 , G06T7/75 , G06T2207/30196
Abstract: In an unobtrusive visual axis enrollment process, a line of text or other content is displayed at a known vertical location and virtual depth that the user can then read. This line of text may be content that the user needs to read as part of the normal enrollment process. As the user reads the line of text, eye tracking cameras may capture images of the eye. This data may then be used to estimate a stimulus plane. The error between the estimated stimulus plane and the ground truth stimulus plane (the actual location of the line of text in virtual space) may then be used to estimate the kappa angle.
-
公开(公告)号:US20240104967A1
公开(公告)日:2024-03-28
申请号:US18470364
申请日:2023-09-19
Applicant: Apple Inc.
Inventor: Rene Heideklang , Hua Gao , Hao Qin , Tom Sengelaub
CPC classification number: G06V40/50 , G06F3/013 , G06T7/70 , G06V40/19 , H04L9/0866 , G06T2207/30201
Abstract: A personalized eye model is used to generate synthetic gaze features at ground-truth eye poses Gg. Corresponding synthetic gaze poses Gs are estimated from the synthetic gaze features using an average eye model. A linear regression is applied between Gg and Gs to generate a gaze correction function. The gaze correction function represents differences between the synthetic gaze Gs of the subject eye at the display and that of the average eye model Gg at the display, but does not contain security- or privacy-sensitive information. Further, the personalized eye model cannot be recovered from the gaze correction function, and thus the gaze correction function can be stored unencrypted and available for use during a cold boot of a device prior to login. On a cold boot of the device, the gaze correction function may be accessed and used with an average eye model to improve gaze-based interactions.
-
公开(公告)号:US20230379564A1
公开(公告)日:2023-11-23
申请号:US18027916
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Martin Haller , Tom Sengelaub
CPC classification number: H04N23/56 , G06V40/197 , G06V40/193 , G06V40/40 , G06F21/32
Abstract: Methods and apparatus for biometric authentication in which two or more biometric features or aspects are captured and analyzed individually or in combination to identify and authenticate a person. An imaging system captures images of a person's iris, eye, periorbital region, and/or other regions of the person's face, and two or more features from the captured images are analyzed individually or in combination to identify and authenticate the person and/or to detect attempts to spoof the biometric authentication. Embodiments may improve the performance of biometric authentication systems, and may help to reduce false positives and false negatives by the biometric authentication algorithms.
-
-
-
-
-
-
-
-
-