公开(公告)号：US20200234480A1

公开(公告)日：2020-07-23

申请号：US16662743

申请日：2019-10-24

Applicant: SNAP INC.

Inventor： Yurii Volkov ,  Pavel Savchenkov ,  Maxim Lukin ,  Ivan Belonogov ,  Nikolai Smirnov ,  Aleksandr Mashrabov

IPC: G06T13/40 ,  G06K9/00 ,  G06T7/70

Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.

公开(公告)号：US11410364B2

公开(公告)日：2022-08-09

申请号：US16662743

申请日：2019-10-24

Applicant: SNAP INC.

Inventor： Yurii Volkov ,  Pavel Savchenkov ,  Maxim Lukin ,  Ivan Belonogov ,  Nikolai Smirnov ,  Aleksandr Mashrabov

IPC: G06T13/40 ,  G06T7/70 ,  G06V40/16

Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.

公开(公告)号：US11157557B2

公开(公告)日：2021-10-26

申请号：US16668893

申请日：2019-10-30

Applicant: SNAP INC.

Inventor： Alexander Mashrabov ,  Evgenii Krokhalev ,  Sofia Savinova ,  Ivan Babanin ,  Ivan Belonogov

IPC: G06F16/78 ,  G06F16/738 ,  G06F40/247 ,  H04L12/58

Abstract: An example method for searching and ranking personalized videos commence with receiving a user request via a communication chat between a user and another user. The user request includes a phrase or emoji. The method performs, based on the user request, a search of a pool of personalized videos to determine a subset of relevant personalized videos. The personalized videos are associated with text messages. The method further includes determining first rankings of the relevant personalized videos. The method then proceed with selecting, based on the first rankings, a pre-determined number of personalized videos from the subset of relevant personalized videos. The method then determines second rankings of the selected personalized videos and present the selected personalized videos within the communication chat in an order based on the second rankings. The personalized videos of the first subpool and the personalized videos of the second subpool are ranked independently.

公开(公告)号：US20200233903A1

公开(公告)日：2020-07-23

申请号：US16668893

申请日：2019-10-30

Applicant: SNAP INC.

Inventor： Alexander Mashrabov ,  Evgenii Krokhalev ,  Sofia Savinova ,  Ivan Babanin ,  Ivan Belonogov

IPC: G06F16/78 ,  G06F17/27 ,  H04L12/58 ,  G06F16/738

Abstract: An example method for searching and ranking personalized videos commence with receiving a user request via a communication chat between a user and another user. The user request includes a phrase or emoji. The method performs, based on the user request, a search of a pool of personalized videos to determine a subset of relevant personalized videos. The personalized videos are associated with text messages. The method further includes determining first rankings of the relevant personalized videos. The method then proceed with selecting, based on the first rankings, a pre-determined number of personalized videos from the subset of relevant personalized videos. The method then determines second rankings of the selected personalized videos and present the selected personalized videos within the communication chat in an order based on the second rankings. The personalized videos of the first subpool and the personalized videos of the second subpool are ranked independently.