PHOTOREALISTIC REAL-TIME PORTRAIT ANIMATION
    2.
    发明公开

    公开(公告)号:US20240296614A1

    公开(公告)日:2024-09-05

    申请号:US18641472

    申请日:2024-04-22

    申请人: Snap Inc.

    IPC分类号: G06T13/80 G06T7/174 G06V40/16

    摘要: Provided are systems and methods for portrait animation. An example method includes receiving, by a computing device, scenario data including information concerning movements of a first head, receiving, by the computing device, a target image including a second head and a background, determining, by the computing device and based on the target image and the information concerning the movements of the first head, two-dimensional (2D) deformations of the second head in the target image, applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video, the at least one output frame including the second head displaced according to the movements of the first head, and filling, by the computing device and using a background prediction neural network, a portion of the background in gaps between the displaced second head and the background.

    IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND STORAGE MEDIUM

    公开(公告)号:US20230222833A1

    公开(公告)日:2023-07-13

    申请号:US18064632

    申请日:2022-12-12

    发明人: SHO SAITO

    摘要: An image processing apparatus includes at least one processor and at least one memory storing executable instructions which, when executed by the at least one processor, cause the image capturing apparatus to acquire an image of at least one person, detect at least one person in the acquired image, control processing for tracking the at least one detected person, and control processing for detecting an action of the at least one detected person based on a result of tracking the at least one detected person. The result of tracking the at least one detected person includes state information representing a tracking state of the at least one detected person. Whether to use the result of tracking the at least one detected person is based on a type of the action detection processing and the state information.