公开(公告)号：US20240402799A1

公开(公告)日：2024-12-05

申请号：US18676387

申请日：2024-05-28

Applicant: Apple Inc.

Inventor： Christian W Gosch ,  Riley C Borgard ,  Sheila M Santos ,  Ritesh Gangadhar Sholapur ,  Sabine Webel

IPC: G06F3/01 ,  G06T7/73

Abstract: Various implementations disclosed herein include devices, systems, and methods that mitigate eye tracking loss. For example, a process may capture sensor data of a 3D region. The process may further generate eye tracking data comprising a 3D position of an eye based on tracking the 3D position of the eye. The 3D position may be updated over time based on the captured sensor data. The process may further detect a condition interfering with updating the 3D position of the eye based on the captured sensor data. The process may further update the eye tracking data using a smoothed 3D position of the eye. The smoothed 3D position may be determined based on previously-tracked 3D positions of the portion of the eye and a current 3D position of the portion of the eye determined based on current sensor data.

公开(公告)号：US20230305625A1

公开(公告)日：2023-09-28

申请号：US18056526

申请日：2022-11-17

Applicant: Apple Inc.

Inventor： Jacob Wilson ,  Tobias Eble ,  Sabine Webel ,  Hariprasad Puthukkootil Rajagopal ,  Andreas Gapel ,  Ritesh Gangadhar Sholapur

IPC: G06F3/01 ,  G06V10/44 ,  G06V40/18 ,  G06V40/19

CPC classification number: G06F3/013 ,  G06V10/44 ,  G06V40/19 ,  G06V40/193

Abstract: Eye tracking is performed by determining an initial pupil position of a user in relation to a lens situated in front of the user, detecting a change in pupil position in relation to the lens to an updated pupil position in relation to the lens, and determining that the updated pupil position is outside a bounding box associated with the lens. The updated pupil position is a replacement pupil position with a replacement pupil position within the bounding box associated with the lens, and the updated pupil position is utilized for eye-tracking functionality. Eye tracking is also performed by determining that a first pixel associated with a gaze direction is outside a visibility region, identifying a replacement pixel within the visibility region, determining an updated gaze angle based on the replacement pixel, and performing eye tracking using the updated gaze angle.

公开(公告)号：US20250123490A1

公开(公告)日：2025-04-17

申请号：US18740287

申请日：2024-06-11

Applicant: Apple Inc.

Inventor： Sabine Webel ,  Christian W Gosch ,  Ritesh Gangadhar Sholapur

IPC: G02B27/01 ,  G02B27/00 ,  G06T5/50

Abstract: A method of operating an electronic device to mitigate double vision is provided. The method can include using front-facing cameras to acquire passthrough content, using a graphics renderer to generate virtual content, mitigating double vision or improving vergence comfort by modifying at least the passthrough content, merging the passthrough content with the virtual content, and displaying the merged content. The passthrough content can be modified by selectively shifting or transforming left eye passthrough content or right eye passthrough content. The virtual content can be rendered based on a similar type of modification applied to the passthrough content. The virtual content can also be modified by selectively shifting or transforming left eye virtual content or right eye virtual content.