-
1.
公开(公告)号:US10776981B1
公开(公告)日:2020-09-15
申请号:US16551756
申请日:2019-08-27
Applicant: SNAP INC.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T7/70 , G06T13/40 , G06T7/194 , G06F3/0482 , G06F3/0484 , G06T7/20 , G06T19/00
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing, by a computer device, a database of motions; receiving, by a computing device, an input image, the input image including a body of a person; receiving, by the computing device, a user input including a motion selected from the database of motions; segmenting, by the computing device, the input image into a body portion and a background portion; generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; and displaying, by the computing device, the generated video; receiving, by a computer device, a further user input including clothes, scene, illumination effect, and additional objects; and, while generating the video, modifying frames of the video based on the further user input.
-
2.
公开(公告)号:US20220358707A1
公开(公告)日:2022-11-10
申请号:US17869799
申请日:2022-07-21
Applicant: Snap Inc.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T13/40 , G06T7/194 , G06T7/70 , G06F3/0482 , G06F3/04845 , G06T7/20 , G06T19/00
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.
-
3.
公开(公告)号:US11410365B2
公开(公告)日:2022-08-09
申请号:US17019875
申请日:2020-09-14
Applicant: Snap Inc.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T13/40 , G06T7/194 , G06T7/70 , G06F3/0482 , G06F3/04845 , G06T7/20 , G06T19/00
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes providing a database of motions; receiving an input image including a body of a person; receiving a user input including a motion selected from the database of motions; segmenting the input image into a body portion and a background portion; fitting the body portion to a hair model; generating, based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion; where generating the video includes detecting positions of key points associated with a head of the person in a frame of the video, generating an image of hair of the person based on the positions of the key points and the hair model, and inserting the image of the hair in the frame; and displaying the generated video.
-
4.
公开(公告)号:US11410364B2
公开(公告)日:2022-08-09
申请号:US16662743
申请日:2019-10-24
Applicant: SNAP INC.
Inventor: Yurii Volkov , Pavel Savchenkov , Maxim Lukin , Ivan Belonogov , Nikolai Smirnov , Aleksandr Mashrabov
Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.
-
5.
公开(公告)号:US20240312099A1
公开(公告)日:2024-09-19
申请号:US18673574
申请日:2024-05-24
Applicant: Snap Inc.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T13/40 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T19/00
CPC classification number: G06T13/40 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T19/00 , G06T2200/24 , G06T2207/10016 , G06T2207/30196
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an image of a body, receiving, via a user interface, a user input including parameters associated with a motion, fitting a portion of the image of the body to a hair model designed to generate a hair image corresponding to the motion, where the portion of the image of the body includes hair, and generating a video featuring the body repeating the motion, where the generation of the video is based on the image of the body, the parameters associated with the motion, and the hair image generated by the hair model.
-
公开(公告)号:US20220392133A1
公开(公告)日:2022-12-08
申请号:US17881947
申请日:2022-08-05
Applicant: Snap Inc.
Inventor: Yurii Volkov , Pavel Savchenkov , Nikolai Smirnov , Aleksandr Mashrabov
Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method includes receiving a source frame of a source video, where the source frame includes a head and a face of a source actor, generating source pose parameters corresponding to a pose of the head and a facial expression of the source actor; receiving a target image including a target head and a target face of a target person, determining target identity information associated with the target head and the target face of the target person, replacing source identity information in the source pose parameters with the target identity information to obtain further source pose parameters, and generating an output frame of an output video that includes a modified image of the target face and the target head adopting the pose of the head and the facial expression of the source actor.
-
7.
公开(公告)号:US20200234480A1
公开(公告)日:2020-07-23
申请号:US16662743
申请日:2019-10-24
Applicant: SNAP INC.
Inventor: Yurii Volkov , Pavel Savchenkov , Maxim Lukin , Ivan Belonogov , Nikolai Smirnov , Aleksandr Mashrabov
Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.
-
8.
公开(公告)号:US12026817B2
公开(公告)日:2024-07-02
申请号:US17869799
申请日:2022-07-21
Applicant: Snap Inc.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G09G5/00 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T13/40 , G06T19/00
CPC classification number: G06T13/40 , G06F3/0482 , G06F3/04845 , G06T7/194 , G06T7/20 , G06T7/70 , G06T19/00 , G06T2200/24 , G06T2207/10016 , G06T2207/30196
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.
-
公开(公告)号:US11915355B2
公开(公告)日:2024-02-27
申请号:US17881947
申请日:2022-08-05
Applicant: Snap Inc.
Inventor: Yurii Volkov , Pavel Savchenkov , Nikolai Smirnov , Aleksandr Mashrabov
CPC classification number: G06T13/40 , G06T7/70 , G06V40/165 , G06T2207/20081 , G06T2207/20084 , G06T2207/20132
Abstract: Provided are systems and methods for realistic head turns and face animation synthesis. An example method includes receiving a source frame of a source video, where the source frame includes a head and a face of a source actor, generating source pose parameters corresponding to a pose of the head and a facial expression of the source actor; receiving a target image including a target head and a target face of a target person, determining target identity information associated with the target head and the target face of the target person, replacing source identity information in the source pose parameters with the target identity information to obtain further source pose parameters, and generating an output frame of an output video that includes a modified image of the target face and the target head adopting the pose of the head and the facial expression of the source actor.
-
-
-
-
-
-
-
-