Systems and techniques for estimating eye pose

    公开(公告)号:US11675432B2

    公开(公告)日:2023-06-13

    申请号:US17659145

    申请日:2022-04-13

    CPC classification number: G06F3/013 G06T7/77 G06T2207/10152 G06T2207/30201

    Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system. In some instances, the eye-tracking system may estimate the location of a partially or totally occluded glint.

    EYE-TRACKING USING IMAGES HAVING DIFFERENT EXPOSURE TIMES

    公开(公告)号:US20220269344A1

    公开(公告)日:2022-08-25

    申请号:US17744506

    申请日:2022-05-13

    Inventor: David Cohen

    Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.

    Global shutter pixel circuit and method for computer vision applications

    公开(公告)号:US10923515B2

    公开(公告)日:2021-02-16

    申请号:US16219829

    申请日:2018-12-13

    Abstract: An image sensor device includes a plurality of pixel cells arranged in a pixel array, a control circuit for controlling an exposure phase and a sampling phase of the image sensor device. Each of the plurality of pixel cells includes a photodiode, a storage diode, and a floating diffusion region. The control circuit is configured to activate the photodiode in a plurality of time windows to sense light reflected from a target as a result of a corresponding plurality of emitted light pulses, with a pre-determined delay time between each time window and a corresponding emitted light pulse. The photodiode can be activated using a plurality of bias voltage pulses or a plurality of global shutter signal pulses.

    REAL TIME CALIBRATION FOR TIME-OF-FLIGHT DEPTH MEASUREMENT

    公开(公告)号:US20210004975A1

    公开(公告)日:2021-01-07

    申请号:US16936345

    申请日:2020-07-22

    Abstract: A method for determining a distance to a target object includes transmitting light pulses to illuminate the target object and sensing, in a first region of a light-sensitive pixel array, light provided from an optical feedback device that receives a portion of the transmitted light pulses. The feedback optical device includes a preset reference depth. The method includes calibrating time-of-flight (TOF) depth measurement reference information based on the sensed light in the first region of the pixel array. The method further includes sensing, in a second region of the light-sensitive pixel array, light reflected from the target object from the transmitted light pulses. The distance of the target object is determined based on the sensed reflected light and the calibrated TOF measurement reference information.

    SYSTEMS AND TECHNIQUES FOR ESTIMATING EYE POSE

    公开(公告)号:US20200372678A1

    公开(公告)日:2020-11-26

    申请号:US16878366

    申请日:2020-05-19

    Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system. In some instances, the eye-tracking system may estimate the location of a partially or totally occluded glint.

    GLOBAL SHUTTER PIXEL CIRCUIT AND METHOD FOR COMPUTER VISION APPLICATIONS

    公开(公告)号:US20230040144A1

    公开(公告)日:2023-02-09

    申请号:US17865107

    申请日:2022-07-14

    Abstract: An imaging system includes an illumination unit and a sensor unit disposed on a printed circuit board. The illumination unit includes a diode laser source inside an illumination housing. The sensor unit includes an image sensor having a pixel array and a lens barrel mounted on the image sensor with an adhesive, and an optical fiber coupled between the illumination housing and image sensor. The optical fiber is configured to collect a portion of light from the interior of the illumination housing that is emitted by the diode laser source and direct the portion of light to a corner of the pixel array of the image sensor that is located outside the lens barrel.

    Power-efficient hand tracking with time-of-flight sensor

    公开(公告)号:US12066545B2

    公开(公告)日:2024-08-20

    申请号:US17210152

    申请日:2021-03-23

    CPC classification number: G01S17/894 G06F3/017 G06F3/0325

    Abstract: Techniques are disclosed for operating a time-of-flight (TOF) sensor. The TOF may be operated in a low power mode by repeatedly performing a low power mode sequence, which may include performing a depth frame by emitting light pulses, detecting reflected light pulses, and computing a depth map based on the detected reflected light pulses. Performing the low power mode sequence may also include performing an amplitude frame at least one time by emitting a light pulse, detecting a reflected light pulse, and computing an amplitude map based on the detected reflected light pulse. In response to determining that an activation condition is satisfied, the TOF may be switched to operate in a high accuracy mode by repeatedly performing a high accuracy mode sequence, which may include performing the depth frame multiple times.

Patent Agency Ranking