Adaptive image warping based on object and distance information

    公开(公告)号:US11373271B1

    公开(公告)日:2022-06-28

    申请号:US17203069

    申请日:2021-03-16

    Applicant: Apple Inc.

    Abstract: A method includes obtaining an image via an image sensor, and identifying, within the image, a physical object represented by a portion of the image. The method includes determining, based on the image, a visual feature characterizing the physical object. The method includes warping, based on the visual feature satisfying a first feature criterion, the portion of the image according to a first warping function that is based on the first feature criterion and a distance between the electronic device and a reference point. The method includes warping, based on the visual feature satisfying a second feature criterion that is different from the first feature criterion, the portion of the image according to a second warping function that is based on the second feature criterion and the distance between the electronic device and the reference point.

    Warping an input image based on depth and offset information

    公开(公告)号:US11783444B1

    公开(公告)日:2023-10-10

    申请号:US17028004

    申请日:2020-09-22

    Applicant: Apple Inc.

    CPC classification number: G06T3/0093 G06T7/50 G06T11/00 G06T2207/20084

    Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.

    Method and device for eye tracking using event camera data

    公开(公告)号:US11474348B2

    公开(公告)日:2022-10-18

    申请号:US17481272

    申请日:2021-09-21

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20200278539A1

    公开(公告)日:2020-09-03

    申请号:US16651228

    申请日:2017-09-28

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Gesture tracking system
    7.
    发明授权

    公开(公告)号:US12289559B2

    公开(公告)日:2025-04-29

    申请号:US17590036

    申请日:2022-02-01

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that identify a gesture based on event camera data and frame-based camera data (e.g., for a CGR environment). In some implementations at an electronic device having a processor, event camera data is obtained corresponding to light (e.g., IR light) reflected from a physical environment and received at an event camera. In some implementations, frame-based camera data is obtained corresponding to light (e.g., visible light) reflected from the physical environment and received at a frame-based camera. In some implementations, a subset of the event camera data is identified based on the frame-based camera data, and a gesture (e.g., of a person in the physical environment) is identified based on the subset of event camera data. In some implementations, a path (e.g., of a hand) by tracking a grouping of blocks of event camera events in the subset of event camera data.

    METHOD AND DEVICE FOR EYE TRACKING USING EVENT CAMERA DATA

    公开(公告)号:US20230314798A1

    公开(公告)日:2023-10-05

    申请号:US17961963

    申请日:2022-10-07

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

    Modifying virtual content to invoke a target user state

    公开(公告)号:US11307650B1

    公开(公告)日:2022-04-19

    申请号:US16859879

    申请日:2020-04-27

    Applicant: Apple Inc.

    Abstract: In one implementation, a method for generating computer-generated reality content (CGR) content in order to invoke a target state of a user based on a user model is performed at an electronic device. The method includes: while presenting reference CGR content via the one or more displays, obtaining a request from a user to invoke a target state for the user; generating, based on a user model associated with the user and the reference CGR content, modified CGR content to invoke the target state for the user, wherein the user model provides projected reactions to CGR content; and presenting, via the one or more displays, the modified CGR content. In some implementations, obtaining the request from the user to invoke the target state for the user includes determining whether the user provided informed consent to store user information in the user model associated with the user of the device.

Patent Agency Ranking