Deformable object tracking
    2.
    发明授权

    公开(公告)号:US11379996B2

    公开(公告)日:2022-07-05

    申请号:US16761582

    申请日:2018-11-13

    Applicant: APPLE INC.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that use event camera data to track deformable objects such as faces, hands, and other body parts. One exemplary implementation involves receiving a stream of pixel events output by an event camera. The device tracks the deformable object using this data. Various implementations do so by generating a dynamic representation of the object and modifying the dynamic representation of the object in response to obtaining additional pixel events output by the event camera. In some implementations, generating the dynamic representation of the object involves identifying features disposed on the deformable surface of the object using the stream of pixel events. The features are determined by identifying patterns of pixel events. As new event stream data is received, the patterns of pixel events are recognized in the new data and used to modify the dynamic representation of the object.

    USER REPRESENTATION USING DEPTHS RELATIVE TO MULTIPLE SURFACE POINTS

    公开(公告)号:US20240005537A1

    公开(公告)日:2024-01-04

    申请号:US18214604

    申请日:2023-06-27

    Applicant: Apple Inc.

    CPC classification number: G06T7/521 G06V40/176 G06T13/40

    Abstract: Various implementations disclosed herein include devices, systems, and methods that generates values for a representation of a face of a user. For example, an example process may include obtaining sensor data (e.g., live data) of a user, wherein the sensor data is associated with a point in time, generating a set of values representing the user based on the sensor data, and providing the set of values, where a depiction of the user at the point in time is displayed based on the set of values. In some implementations, the set of values includes depth values that define three-dimensional (3D) positions of portions of the user relative to multiple 3D positions of points of a projected surface and appearance values (e.g., color, texture, opacity, etc.) that define appearances of the portions of the user.

Patent Agency Ranking