Method and device for eye tracking using event camera data

    公开(公告)号:US11474348B2

    公开(公告)日:2022-10-18

    申请号:US17481272

    申请日:2021-09-21

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Lens Array for Shifting Perspective of an Imaging System

    公开(公告)号:US20220146820A1

    公开(公告)日:2022-05-12

    申请号:US17450128

    申请日:2021-10-06

    Applicant: Apple Inc.

    Abstract: This disclosure describes a novel lens system having an entrance pupil at a location matching, or nearly matching, the eye's optical system entrance pupil. The described lens system is significantly thinner than a single-aperture lens with matched entrance pupil and is achieved by using an array of camera elements. Each camera element contains camera optics called “lenslets” and a sensor (e.g., an image or depth sensor), where a lenslet can include one or more lens elements (e.g., a compound lens). Individual camera elements can be arranged such that THEIR optical axes intersect at, or near, the eye's entrance pupil location. In addition, each camera element's field-of-view (FOV) corresponds to a small sector of a large FOV. The FOVs of adjacent camera elements can be non- or slightly-overlapping so that a wide-angle image can be formed by concatenation of the individual camera element images.

    Lens array for shifting perspective of an imaging system

    公开(公告)号:US11143865B1

    公开(公告)日:2021-10-12

    申请号:US16210909

    申请日:2018-12-05

    Applicant: Apple Inc.

    Abstract: This disclosure describes a novel lens system having an entrance pupil at a location matching, or nearly matching, the eye's optical system entrance pupil. The described lens system is significantly thinner than a single-aperture lens with matched entrance pupil and is achieved by using an array of camera elements. Each camera element contains camera optics called “lenslets” and a sensor (e.g., an image or depth sensor), where a lenslet can include one or more lens elements (e.g., a compound lens). Individual camera elements can be arranged such that THEIR optical axes intersect at, or near, the eye's entrance pupil location. In addition, each camera element's field-of-view (FOV) corresponds to a small sector of a large FOV. The FOVs of adjacent camera elements can be non- or slightly-overlapping so that a wide-angle image can be formed by concatenation of the individual camera element images.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20200278539A1

    公开(公告)日:2020-09-03

    申请号:US16651228

    申请日:2017-09-28

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

Patent Agency Ranking