Object Animation Using Generative Neural Networks

    公开(公告)号:US20200265294A1

    公开(公告)日:2020-08-20

    申请号:US16276559

    申请日:2019-02-14

    Applicant: Adobe Inc.

    Abstract: In implementations of object animation using generative neural networks, one or more computing devices of a system implement an animation system for reproducing animation of an object in a digital video. A mesh of the object is obtained from a first frame of the digital video and a second frame of the digital video having the object is selected. Features of the object from the second frame are mapped to vertices of the mesh, and the mesh is warped based on the mapping. The warped mesh is rendered as an image by a neural renderer and compared to the object from the second frame to train a neural network. The rendered image is then refined by a generator of a generative adversarial network which includes a discriminator. The discriminator trains the generator to reproduce the object from the second frame as the refined image.

    Interaction Detection Model for Identifying Human-Object Interactions in Image Content

    公开(公告)号:US20190286892A1

    公开(公告)日:2019-09-19

    申请号:US15920027

    申请日:2018-03-13

    Applicant: Adobe Inc.

    Abstract: Certain embodiments detect human-object interactions in image content. For example, human-object interaction metadata is applied to an input image, thereby identifying contact between a part of a depicted human and a part of a depicted object. Applying the human-object interaction metadata involves computing a joint-location heat map by applying a pose estimation subnet to the input image and a contact-point heat map by applying an object contact subnet to the to the input image. The human-object interaction metadata is generated by applying an interaction-detection subnet to the joint-location heat map and the contact-point heat map. The interaction-detection subnet is trained to identify an interaction based on joint-object contact pairs, where a joint-object contact pair includes a relationship between a human joint location and a contact point. An image search system or other computing system is provided with access to the input image having the human-object interaction metadata.

    REFINING LOCAL PARAMETERIZATIONS FOR APPLYING TWO-DIMENSIONAL IMAGES TO THREE-DIMENSIONAL MODELS

    公开(公告)号:US20190259216A1

    公开(公告)日:2019-08-22

    申请号:US15900864

    申请日:2018-02-21

    Applicant: Adobe Inc.

    Abstract: Certain embodiments involve refining local parameterizations that apply two-dimensional (“2D”) images to three-dimensional (“3D”) models. For instance, a particular parameterization-initialization process is select based on one or more features of a target mesh region. An initial local parameterization for a 2D image is generated from this parameterization-initialization process. A quality metric for the initial local parameterization is computed, and the local parameterization is modified to improve the quality metric. The 3D model is modified by applying image points from the 2D image to the target mesh region in accordance with the modified local parameterization.

    Determining structure and functionality of scanned objects

    公开(公告)号:US10380317B2

    公开(公告)日:2019-08-13

    申请号:US15063183

    申请日:2016-03-07

    Applicant: Adobe Inc.

    Abstract: Methods and systems for generating digital models from objects. In particular, one or more embodiments determine a plurality of correspondences for first and second components of an object. One or more embodiments estimate a joint connecting the first and second components based on the correspondences. One or more embodiments jointly determine a global transformation and one or more joint parameters that map the plurality of components of the object from the first digital scan to the second digital scan. One or more embodiments also updating the correspondences based on the determined global transformation and parameter(s). One or more embodiments re-estimate the joint based on the updated correspondences. One or more embodiments select a candidate joint with a lowest error estimate from a plurality of candidate joints according to determined global transformations and joint parameter(s) for the candidate joints.

    Decimating a three-dimensional mesh via successive self-parameterization

    公开(公告)号:US11257290B2

    公开(公告)日:2022-02-22

    申请号:US16863099

    申请日:2020-04-30

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

    DECIMATING A THREE-DIMENSIONAL MESH VIA SUCCESSIVE SELF-PARAMETERIZATION

    公开(公告)号:US20210343082A1

    公开(公告)日:2021-11-04

    申请号:US16863099

    申请日:2020-04-30

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

    SUBDIVIDING A THREE-DIMENSIONAL MESH UTILIZING A NEURAL NETWORK

    公开(公告)号:US20210343080A1

    公开(公告)日:2021-11-04

    申请号:US16863189

    申请日:2020-04-30

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing one or more neural networks to recursively subdivide a three-dimensional mesh according to local geometries of vertices in the three-dimensional mesh. For example, the disclosed system can determine a local geometry (e.g., a one-ring neighborhood of half-flaps) for each vertex in a three-dimensional mesh. For each subdivision iteration, the disclosed system can then utilize a neural network to determine displacement coordinates for existing vertices in the three-dimensional mesh and coordinates for new vertices added to edges between the existing vertices in the three-dimensional mesh in accordance with the local geometries of the existing vertices. Furthermore, the disclosed system can generate a subdivided three-dimensional mesh based on the determined displacement coordinates for the existing vertices and the determined coordinates for the new vertices.

Patent Agency Ranking