Invention Grant
- Patent Title: Face reenactment
-
Application No.: US16251436Application Date: 2019-01-18
-
Publication No.: US10789453B2Publication Date: 2020-09-29
- Inventor: Pavel Savchenkov , Dmitry Matov , Aleksandr Mashrabov , Alexey Pchelnikov
- Applicant: SNAP INC.
- Applicant Address: US CA Santa Monica
- Assignee: Snap Inc.
- Current Assignee: Snap Inc.
- Current Assignee Address: US CA Santa Monica
- Agent Georgiy L. Khayet
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06T11/00 ; G06Q30/02 ; G06N3/04

Abstract:
Provided are systems and a method for photorealistic real-time face reenactment. An example method includes receiving a target video including a target face and a source video including a source face. The method includes determining, based on the target face, a target facial expression. The method includes determining, based on the source face, a source facial expression. The method includes synthesizing, using the parametric face model, an output face. The output face including the target face wherein the target facial expression is modified to imitate the source facial expression. The method includes generating, based on a deep neural network, mouth and eyes regions, and combining the output face, the mouth, and eyes regions to generate a frame of an output video.
Public/Granted literature
- US20200234034A1 SYSTEMS AND METHODS FOR FACE REENACTMENT Public/Granted day:2020-07-23
Information query