公开(公告)号：US20210295020A1

公开(公告)日：2021-09-23

申请号：US17303871

申请日：2021-06-09

Applicant: Snap Inc.

Inventor： Chen Cao ,  Sergey Tulyakov ,  Zhenglin Geng

IPC: G06K9/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.

公开(公告)号：US11798261B2

公开(公告)日：2023-10-24

申请号：US17303871

申请日：2021-06-09

Applicant: Snap Inc.

Inventor： Chen Cao ,  Sergey Tulyakov ,  Zhenglin Geng

IPC: G06V40/16 ,  G06V10/82 ,  G06V10/764

CPC classification number: G06V10/764 ,  G06V10/82 ,  G06V40/161 ,  G06V40/168 ,  G06V40/172 ,  G06V40/175

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.

公开(公告)号：US11055514B1

公开(公告)日：2021-07-06

申请号：US16220859

申请日：2018-12-14

Applicant: Snap Inc.

Inventor： Chen Cao ,  Sergey Tulyakov ,  Zhenglin Geng

IPC: G06K9/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.