Method and an apparatus for determining a gaze point on a three-dimensional object

    公开(公告)号:US10699439B2

    公开(公告)日:2020-06-30

    申请号:US16290934

    申请日:2019-03-03

    Applicant: APPLE INC.

    Abstract: A system for determining the gaze endpoint of a subject, the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit, that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction, the eye tracker position and the 3D structure representation, calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.

    Authentication Continuity
    42.
    发明申请

    公开(公告)号:US20240403402A1

    公开(公告)日:2024-12-05

    申请号:US18733414

    申请日:2024-06-04

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed relating to devices that support biometric authentication. In various embodiments, a device includes a biosensor configured to collect biometric data from a user. An authentication system of the device is configured to perform a user authentication based on the collected biometric data. After performance of the user authentication, the authentication system receives sensor data indicating that the user remains collocated with the device and receives a request to confirm an authentication of the user. Based on the user authentication and the received sensor data, the authentication system confirms that the user has been authenticated. In various embodiments, the authentication system is configured to receive additional sensor data indicating that the user is no longer collocated with the device and, in response to a subsequent authentication request, require the user to perform another biometric authentication using the biosensor.

    Display calibration
    44.
    发明授权

    公开(公告)号:US12093451B2

    公开(公告)日:2024-09-17

    申请号:US18014848

    申请日:2021-06-24

    Applicant: APPLE INC.

    CPC classification number: G06F3/013 G06T7/70 G06T2207/30244

    Abstract: Various implementations disclosed herein include devices, systems, and methods that assess calibration between eye tracking and other components of a head-mounted device (HMD) using another device, such as a mobile device. For example, an example process may include obtaining first sensor data captured by a first sensor of a first device, the first sensor data including a representation of a portion of a second device, obtaining second sensor data captured by a second sensor of the second device, detecting a position of the first sensor of the first device based on the second sensor data, and assessing a calibration between the portion of the second device and the sensor of the second device based on the first sensor data and the detected position of the first sensor.

    EYE MODEL ENROLLMENT
    45.
    发明公开

    公开(公告)号:US20240272709A1

    公开(公告)日:2024-08-15

    申请号:US18568256

    申请日:2022-06-08

    Applicant: Apple Inc.

    CPC classification number: G06F3/013

    Abstract: Methods and apparatus for generating user-aware eye models. During an enrollment process, images of a user's eye are captured by one or more cameras when the eye is in two or more different orientations and at two or more different levels of display brightness. The captured images are processed to generate a 3-dimensional, user-aware eye model, for example a model of at least the eye's cornea and pupil features. The generated user-aware eye model may be used in other processes, for example in a gaze tracking process. The enrollment process may be an iterative process to optimize the eye model, or a continuous process performed while the user is using the system.

    Visual Axis Enrollment
    48.
    发明公开

    公开(公告)号:US20240211039A1

    公开(公告)日:2024-06-27

    申请号:US18534398

    申请日:2023-12-08

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G06F1/163 G06T7/75 G06T2207/30196

    Abstract: In an unobtrusive visual axis enrollment process, a line of text or other content is displayed at a known vertical location and virtual depth that the user can then read. This line of text may be content that the user needs to read as part of the normal enrollment process. As the user reads the line of text, eye tracking cameras may capture images of the eye. This data may then be used to estimate a stimulus plane. The error between the estimated stimulus plane and the ground truth stimulus plane (the actual location of the line of text in virtual space) may then be used to estimate the kappa angle.

    Synthetic Gaze Enrollment
    49.
    发明公开

    公开(公告)号:US20240104967A1

    公开(公告)日:2024-03-28

    申请号:US18470364

    申请日:2023-09-19

    Applicant: Apple Inc.

    Abstract: A personalized eye model is used to generate synthetic gaze features at ground-truth eye poses Gg. Corresponding synthetic gaze poses Gs are estimated from the synthetic gaze features using an average eye model. A linear regression is applied between Gg and Gs to generate a gaze correction function. The gaze correction function represents differences between the synthetic gaze Gs of the subject eye at the display and that of the average eye model Gg at the display, but does not contain security- or privacy-sensitive information. Further, the personalized eye model cannot be recovered from the gaze correction function, and thus the gaze correction function can be stored unencrypted and available for use during a cold boot of a device prior to login. On a cold boot of the device, the gaze correction function may be accessed and used with an average eye model to improve gaze-based interactions.

    BIOMETRIC AUTHENTICATION SYSTEM
    50.
    发明公开

    公开(公告)号:US20230379564A1

    公开(公告)日:2023-11-23

    申请号:US18027916

    申请日:2021-09-22

    Applicant: Apple Inc.

    CPC classification number: H04N23/56 G06V40/197 G06V40/193 G06V40/40 G06F21/32

    Abstract: Methods and apparatus for biometric authentication in which two or more biometric features or aspects are captured and analyzed individually or in combination to identify and authenticate a person. An imaging system captures images of a person's iris, eye, periorbital region, and/or other regions of the person's face, and two or more features from the captured images are analyzed individually or in combination to identify and authenticate the person and/or to detect attempts to spoof the biometric authentication. Embodiments may improve the performance of biometric authentication systems, and may help to reduce false positives and false negatives by the biometric authentication algorithms.

Patent Agency Ranking