公开(公告)号：US10776981B1

公开(公告)日：2020-09-15

申请号：US16551756

申请日：2019-08-27

Applicant: SNAP INC.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G06T7/70 ,  G06T13/40 ,  G06T7/194 ,  G06F3/0482 ,  G06F3/0484 ,  G06T7/20 ,  G06T19/00

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing, by a computer device, a database of motions; receiving, by a computing device, an input image, the input image including a body of a person; receiving, by the computing device, a user input including a motion selected from the database of motions; segmenting, by the computing device, the input image into a body portion and a background portion; generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; and displaying, by the computing device, the generated video; receiving, by a computer device, a further user input including clothes, scene, illumination effect, and additional objects; and, while generating the video, modifying frames of the video based on the further user input.

公开(公告)号：US11727617B2

公开(公告)日：2023-08-15

申请号：US17695902

申请日：2022-03-16

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/00 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T13/40 ,  G06N3/08 ,  G06T3/0037 ,  G06T7/194 ,  G06T15/04 ,  G06T17/20

Abstract: Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.

公开(公告)号：US11410365B2

公开(公告)日：2022-08-09

申请号：US17019875

申请日：2020-09-14

Applicant: Snap Inc.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G06T13/40 ,  G06T7/194 ,  G06T7/70 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/20 ,  G06T19/00

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing a database of motions; receiving an input image including a body of a person; receiving a user input including a motion selected from the database of motions; segmenting the input image into a body portion and a background portion; fitting the body portion to a hair model; generating, based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; where generating the video includes detecting positions of key points associated with a head of the person in a frame of the video, generating an image of hair of the person based on the positions of the key points and the hair model, and inserting the image of the hair in the frame; and displaying the generated video.

公开(公告)号：US12026817B2

公开(公告)日：2024-07-02

申请号：US17869799

申请日：2022-07-21

Applicant: Snap Inc.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G09G5/00 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T13/40 ,  G06T19/00

CPC classification number: G06T13/40 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T19/00 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.

公开(公告)号：US20230343012A1

公开(公告)日：2023-10-26

申请号：US18214538

申请日：2023-06-27

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/00 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/0037 ,  G06T15/04 ,  G06T17/20

Abstract: Systems and methods for single image-based body animation are provided. An example method includes receiving an input image including an image of a body of a person, fitting a model to the image of the body of the person, where the model is configured to receive a set of pose parameters corresponding to a pose of the body and generate, based on the set of pose parameters, an output image including an image of the body adopting the pose, receiving a further set of pose parameters corresponding to a further pose of the body, providing the further set of pose parameters to the model to generate the output image of the body adopting the further pose, and generating, based on the output image, a frame of an output video including the output image.

公开(公告)号：US20220358707A1

公开(公告)日：2022-11-10

申请号：US17869799

申请日：2022-07-21

Applicant: Snap Inc.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G06T13/40 ,  G06T7/194 ,  G06T7/70 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/20 ,  G06T19/00

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.

公开(公告)号：US20220207810A1

公开(公告)日：2022-06-30

申请号：US17695902

申请日：2022-03-16

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/00 ,  G06T15/04 ,  G06T17/20

Abstract: Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.

公开(公告)号：US20240312099A1

公开(公告)日：2024-09-19

申请号：US18673574

申请日：2024-05-24

Applicant: Snap Inc.

Inventor： Sergei Gorbatyuk ,  Nikolai Smirnov ,  Aleksandr Mashrabov ,  Egor Nemchinov

IPC: G06T13/40 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T19/00

CPC classification number: G06T13/40 ,  G06F3/0482 ,  G06F3/04845 ,  G06T7/194 ,  G06T7/20 ,  G06T7/70 ,  G06T19/00 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an image of a body, receiving, via a user interface, a user input including parameters associated with a motion, fitting a portion of the image of the body to a hair model designed to generate a hair image corresponding to the motion, where the portion of the image of the body includes hair, and generating a video featuring the body repeating the motion, where the generation of the video is based on the image of the body, the parameters associated with the motion, and the hair image generated by the hair model.

公开(公告)号：US11308676B2

公开(公告)日：2022-04-19

申请号：US17062309

申请日：2020-10-02

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06N3/08 ,  G06T3/00 ,  G06T15/04 ,  G06T17/20

Abstract: Provided are systems and methods for single image-based body animation. An example method includes receiving an input image that includes a body of a person and segmenting the input image into a body portion and a background portion. The method further includes fitting a model to the body portion. The model is configured to receive a set of pose parameters representing a pose of the body and generate an output image including an image of the body adopting the pose. The method further includes receiving a series of further sets of pose parameters, each representing at least one of further poses of the body. The further sets of pose parameters are generated using a generic model. The method also includes generating a series of output images of the body adopting the further poses and generating an output video based on the series of output images.

公开(公告)号：US20210019929A1

公开(公告)日：2021-01-21

申请号：US17062309

申请日：2020-10-02

Applicant: Snap Inc.

Inventor： Egor Nemchinov ,  Sergei Gorbatyuk ,  Aleksandr Mashrabov ,  Egor Spirin ,  Iaroslav Sokolov ,  Andrei Smirdin ,  Igor Tukh

IPC: G06T13/40 ,  G06T7/194 ,  G06T15/04 ,  G06T3/00 ,  G06N3/08 ,  G06T17/20

Abstract: Provided are systems and methods for single image-based body animation. An example method includes receiving an input image that includes a body of a person and segmenting the input image into a body portion and a background portion. The method further includes fitting a model to the body portion. The model is configured to receive a set of pose parameters representing a pose of the body and generate an output image including an image of the body adopting the pose. The method further includes receiving a series of further sets of pose parameters, each representing at least one of further poses of the body. The further sets of pose parameters are generated using a generic model. The method also includes generating a series of output images of the body adopting the further poses and generating an output video based on the series of output images.