Invention Grant
- Patent Title: Object animation using generative neural networks
-
Application No.: US16276559Application Date: 2019-02-14
-
Publication No.: US10977549B2Publication Date: 2021-04-13
- Inventor: Vladimir Kim , Omid Poursaeed , Jun Saito , Elya Shechtman
- Applicant: Adobe Inc.
- Applicant Address: US CA San Jose
- Assignee: Adobe Inc.
- Current Assignee: Adobe Inc.
- Current Assignee Address: US CA San Jose
- Agency: FIG. 1 Patents
- Main IPC: G06T13/00
- IPC: G06T13/00 ; G06N3/04 ; G06N3/08 ; G06T17/20

Abstract:
In implementations of object animation using generative neural networks, one or more computing devices of a system implement an animation system for reproducing animation of an object in a digital video. A mesh of the object is obtained from a first frame of the digital video and a second frame of the digital video having the object is selected. Features of the object from the second frame are mapped to vertices of the mesh, and the mesh is warped based on the mapping. The warped mesh is rendered as an image by a neural renderer and compared to the object from the second frame to train a neural network. The rendered image is then refined by a generator of a generative adversarial network which includes a discriminator. The discriminator trains the generator to reproduce the object from the second frame as the refined image.
Public/Granted literature
- US20200265294A1 Object Animation Using Generative Neural Networks Public/Granted day:2020-08-20
Information query