公开(公告)号：US10776981B1

公开(公告)日：2020-09-15

申请号：US16551756

申请日：2019-08-27

Applicant: SNAP INC.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G06T7/70 ,  G06T13/40 ,  G06T7/194 ,  G06F3/0482 ,  G06F3/0484 ,  G06T7/20 ,  G06T19/00

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing, by a computer device, a database of motions; receiving, by a computing device, an input image, the input image including a body of a person; receiving, by the computing device, a user input including a motion selected from the database of motions; segmenting, by the computing device, the input image into a body portion and a background portion; generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; and displaying, by the computing device, the generated video; receiving, by a computer device, a further user input including clothes, scene, illumination effect, and additional objects; and, while generating the video, modifying frames of the video based on the further user input.

公开(公告)号：US20200234690A1

公开(公告)日：2020-07-23

申请号：US16509370

申请日：2019-07-11

Applicant: SNAP INC.

Inventor： Pavel Savchenkov ,  Maxim Lukin ,  Aleksandr Mashrabov

IPC: G10L13/04 ,  G06T13/40 ,  G10L13/08 ,  G06K9/00

Abstract: Provided are systems and methods for text and audio-based real-time face reenactment. An example method includes receiving an input text and a target image, the target image including a target face; generating, based on the input text, a sequence of sets of acoustic features representing the input text; determining, based on the sequence of sets of acoustic features, a sequence of sets of scenario data indicating modifications of the target face for pronouncing the input text; generating, based on the sequence of sets of scenario data, a sequence of frames, wherein each of the frames includes the target face modified based on at least one of the sets of scenario data; generating, based on the sequence of frames, an output video; and synthesizing, based on the sequence of sets of acoustic features, an audio data and adding the audio data to the output video.

公开(公告)号：US12212704B2

公开(公告)日：2025-01-28

申请号：US18509589

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04B1/38 ,  G06T11/00 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72439 ,  H04M1/72442

Abstract: Provided are systems and methods for customizing modifiable videos. An example method includes analyzing recent messages associated with a user in a multimedia messaging application to determine a context of the recent messages, determining, based on the context, a property of a modifiable feature, selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos associated with a preset modifiable feature, replacing a property of the preset modifiable feature in relevant modifiable videos of the list of relevant modifiable videos with the property of the modifiable feature, and rendering the list of relevant modifiable videos for viewing by the user, where the rendering includes displaying the modifiable feature in the relevant modifiable videos.

公开(公告)号：US12118031B2

公开(公告)日：2024-10-15

申请号：US16990505

申请日：2020-08-11

Applicant: Snap Inc.

Inventor： Aleksandr Mashrabov ,  Victor Shaburov ,  Grigoriy Tkachenko ,  Jeremy Baker Voss

IPC: G06F16/535 ,  G06F16/538 ,  G06F16/54 ,  G06F16/58 ,  G06V40/16

CPC classification number: G06F16/535 ,  G06F16/538 ,  G06F16/54 ,  G06F16/5866 ,  G06V40/165

Abstract: A personalized preview system to receive a request to access a collection of media items from a user of a user device. Responsive to receiving the request to access the collection of media items, the personalized preview system accesses user profile data associated with the user, wherein the user profile data includes an image. For example, the image may comprise a depiction of a face, wherein the face comprises a set of facial landmarks. Based on the image, the personalized preview system generates one or more media previews based on corresponding media templates and the image, and displays the one or more media previews within a presentation of the collection of media items at a client device of the user.

公开(公告)号：US12026817B2

公开(公告)日：2024-07-02

申请号：US17869799

申请日：2022-07-21

Applicant: Snap Inc.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G09G5/00 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T13/40 ,  G06T19/00

CPC classification number: G06T13/40 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T19/00 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.

公开(公告)号：US20240078838A1

公开(公告)日：2024-03-07

申请号：US18509502

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Pavel Savchenkov ,  Dmitry Matov ,  Aleksandr Mashrabov ,  Alexey Pchelnikov

IPC: G06V40/16 ,  G06N3/04 ,  G06Q30/0251 ,  G06T11/00

CPC classification number: G06V40/161 ,  G06N3/04 ,  G06Q30/0254 ,  G06Q30/0269 ,  G06T11/001 ,  G06V40/174 ,  G06V40/178

Abstract: Provided are systems and methods for face reenactment. An example method includes receiving a target video that includes at least one target frame, where the at least one target frame includes a target face, receiving a scenario including a series of source facial expressions, determining, based on the target face, a target facial expression of the target face, synthesizing, based on a parametric face model and a texture model, an output face including the target face, where the target facial expression of the target face is modified to imitate a source facial expression of the series of source facial expressions, and generating, based on the output face, a frame of an output video. The parametric face model includes a template mesh pre-generated based on historical images of faces of a plurality of individuals, where the template mesh includes a pre-determined number of vertices.

公开(公告)号：US11915355B2

公开(公告)日：2024-02-27

申请号：US17881947

申请日：2022-08-05

Applicant: Snap Inc.

Inventor： Yurii Volkov ,  Pavel Savchenkov ,  Nikolai Smirnov ,  Aleksandr Mashrabov

IPC: G06T13/40 ,  G06T7/70 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06T7/70 ,  G06V40/165 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20132

Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method includes receiving a source frame of a source video, where the source frame includes a head and a face of a source actor, generating source pose parameters corresponding to a pose of the head and a facial expression of the source actor; receiving a target image including a target head and a target face of a target person, determining target identity information associated with the target head and the target face of the target person, replacing source identity information in the source pose parameters with the target identity information to obtain further source pose parameters, and generating an output frame of an output video that includes a modified image of the target face and the target head adopting the pose of the head and the facial expression of the source actor.

公开(公告)号：US11895260B2

公开(公告)日：2024-02-06

申请号：US17522947

申请日：2021-11-10

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04B1/38 ,  H04M1/72439 ,  G06T11/00 ,  G06T11/60 ,  G06T13/80 ,  H04M1/72436 ,  H04M1/72442 ,  H04M1/72427 ,  H04L51/02 ,  H04L51/216

CPC classification number: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

Abstract: A system for customizing modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to analyze recent messages of a user to determine a context of the recent messages; determine, based on the context, a customized feature; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with a preset modifiable feature; replace the preset modifiable feature in the relevant modifiable videos with the customized feature; and render a modifiable video from the list of relevant modifiable videos for viewing by the user, the rendering including displaying the customized feature in the relevant modifiable videos.

公开(公告)号：US20230343012A1

公开(公告)日：2023-10-26

申请号：US18214538

申请日：2023-06-27

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/00 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/0037 ,  G06T15/04 ,  G06T17/20

Abstract: Systems and methods for single image-based body animation are provided. An example method includes receiving an input image including an image of a body of a person, fitting a model to the image of the body of the person, where the model is configured to receive a set of pose parameters corresponding to a pose of the body and generate, based on the set of pose parameters, an output image including an image of the body adopting the pose, receiving a further set of pose parameters corresponding to a further pose of the body, providing the further set of pose parameters to the model to generate the output image of the body adopting the further pose, and generating, based on the output image, a frame of an output video including the output image.

公开(公告)号：US20230110916A1

公开(公告)日：2023-04-13

申请号：US18080779

申请日：2022-12-14

Applicant: Snap Inc.

Inventor： Eugene Krokhalev ,  Aleksandr Mashrabov ,  Pavel Savchenkov

IPC: G06T13/80 ,  G06T7/174 ,  G06V40/16

Abstract: Provided are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes information concerning a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the target image and the information concerning the first face, two-dimensional (2D) deformations of the second face in the target image, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.