Method and device for eye tracking using event camera data

    公开(公告)号:US11150469B2

    公开(公告)日:2021-10-19

    申请号:US16651228

    申请日:2018-09-27

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    METHOD AND DEVICE FOR UTILIZING PHYSICAL OBJECTS AND PHYSICAL USAGE PATTERNS FOR PRESENTING VIRTUAL CONTENT

    公开(公告)号:US20210233323A1

    公开(公告)日:2021-07-29

    申请号:US17231917

    申请日:2021-04-15

    Applicant: Apple Inc.

    Abstract: In some implementations, a method includes: determining first usage patterns associated with a physical object within the physical environment; obtaining a first objective for an objective-effectuator (OE) instantiated in a computer-generated reality (CGR) environment, wherein the first objective is associated with a representation of the physical object; obtaining a first directive for the OE that limits actions for performance by the OE to achieve the first objective to the first usage patterns associated with the physical object; generating first actions, for performance by the OE, in order to achieve the first objective as limited by the first directive, wherein the first set of actions corresponds to a first subset of usage patterns from the first set of usage patterns associated with the physical object; and presenting the OE performing the first actions on the representation of the physical object overlaid on the physical environment.

    Optical flow techniques for event cameras

    公开(公告)号:US10600189B1

    公开(公告)日:2020-03-24

    申请号:US16539416

    申请日:2019-08-13

    Applicant: Apple Inc.

    Abstract: Determining a movement of an object may include obtaining an event stream corresponding to a scene over time, wherein the event stream includes events associated with detected changes in brightness, wherein each event includes a pixel location, a timestamp, and a brightness indication; selecting a first subset of pixels from the plurality of pixels corresponding to an object for a first time period; determining a first movement of the object based on the brightness indications and timestamps for the first subset of pixels; determining that the first movement is insufficient to generate a velocity measure; selecting, based on the first movement, a second subset of pixels associated with the object for a second time period; determining an updated movement of the object based on the brightness indications and timestamps for the second subset of pixels and the first movement; and generating a velocity measure based on the updated movement.

Patent Agency Ranking