-
公开(公告)号:US20240419722A1
公开(公告)日:2024-12-19
申请号:US18818124
申请日:2024-08-28
Applicant: Snap Inc.
Inventor: Aleksandr Mashrabov , Victor Shaburov , Grigoriy Tkachenko , Jeremy Baker Voss
IPC: G06F16/535 , G06F16/538 , G06F16/54 , G06F16/58 , G06V40/16
Abstract: A personalized preview system to receive a request to access a collection of media items from a user of a user device. Responsive to receiving the request to access the collection of media items, the personalized preview system accesses user profile data associated with the user, wherein the user profile data includes an image. For example, the image may comprise a depiction of a face, wherein the face comprises a set of facial landmarks. Based on the image, the personalized preview system generates one or more media previews based on corresponding media templates and the image, and displays the one or more media previews within a presentation of the collection of media items at a client device of the user.
-
公开(公告)号:US12099547B2
公开(公告)日:2024-09-24
申请号:US18139367
申请日:2023-04-26
Applicant: Snap Inc.
Inventor: Jeremy Voss , Victor Shaburov , Aleksandr Mashrabov , Dmitriy Matov , Hanna Rulevska , Dmytro Ishchenko
IPC: G06F16/732 , G06F16/71 , H04L51/10
CPC classification number: G06F16/7328 , G06F16/71 , H04L51/10
Abstract: Systems and methods for searching and ranking videos are provided. An example method includes receiving an input from a user via a multimedia messaging application (MMA), selecting, from a database configured to store videos, a subset of videos based on the input and a predetermined rule, rendering, via the MMA, the subset of videos, determining that the user has viewed a video from the subset of videos, determining whether the user has shared, via the MMA, the viewed video, updating a log based on information concerning the subset of videos and the viewed video, and updating, based on the log, a model of the predetermined rule for selecting the videos. The model is trained based on pairs of first videos and second videos, where the first videos have been viewed and shared by the user and the second videos have been viewed but not shared by the user.
-
公开(公告)号:US11995758B2
公开(公告)日:2024-05-28
申请号:US18080779
申请日:2022-12-14
Applicant: Snap Inc.
Inventor: Eugene Krokhalev , Aleksandr Mashrabov , Pavel Savchenkov
CPC classification number: G06T13/80 , G06T7/174 , G06V40/167 , G06T2207/20084
Abstract: Provided are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes information concerning a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the target image and the information concerning the first face, two-dimensional (2D) deformations of the second face in the target image, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.
-
公开(公告)号:US11869164B2
公开(公告)日:2024-01-09
申请号:US17804008
申请日:2022-05-25
Applicant: Snap Inc.
Inventor: Roman Golobokov , Aleksandr Mashrabov , Dmitry Matov , Jeremy Baker Voss
CPC classification number: G06T19/20 , G06N20/00 , G06T11/60 , G06T13/40 , G06T19/006 , G06V40/165 , H04L51/04 , H04L51/10 , G06T2219/2012 , G06T2219/2024
Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.
-
公开(公告)号:US11741940B2
公开(公告)日:2023-08-29
申请号:US17355834
申请日:2021-06-23
Applicant: Snap Inc.
Inventor: Pavel Savchenkov , Maxim Lukin , Aleksandr Mashrabov
CPC classification number: G10L13/00 , G06T13/40 , G06V10/764 , G06V10/82 , G06V40/171 , G10L13/08
Abstract: Provided are systems and methods for text and audio-based real-time face reenactment. An example method includes receiving an input text and a target image, the target image including a target face; generating, based on the input text, a sequence of sets of acoustic features representing the input text; generating, based on the sequence of sets of acoustic features, a sequence of sets of mouth key points; generating, based on the sequence of sets of mouth key points, a sequence of sets of facial key points; generating, by the computing device and based on the sequence of sets of the facial key points and the target image, a sequence of frames; and generating, based on the sequence of frames, an output video. Each of the frames includes the target face modified based on at least one set of mouth key points of the sequence of sets of mouth key points.
-
16.
公开(公告)号:US20220358707A1
公开(公告)日:2022-11-10
申请号:US17869799
申请日:2022-07-21
Applicant: Snap Inc.
Inventor: Sergei Gorbatyuk , Nikolai Smirnov , Aleksandr Mashrabov , Egor Nemchinov
IPC: G06T13/40 , G06T7/194 , G06T7/70 , G06F3/0482 , G06F3/04845 , G06T7/20 , G06T19/00
Abstract: Provided are systems and methods for animating a single image of a human body and applying effects. An example method includes receiving an input image that includes an image of a body, receiving, through an interface, a user input including parameters associated with a motion, generating, based on the image of the body and the parameters associated with the motion, a video featuring the body repeating the motion, and providing an option to share the parameters associated with the motion with a further user of a further computing device. The method further includes, prior to generating the video, receiving a further user input including a hair animation effect selected from a list of hair animation effects, and while generating the video, applying the hair animation effect to a hair image in frames of the video.
-
公开(公告)号:US20220292794A1
公开(公告)日:2022-09-15
申请号:US17804008
申请日:2022-05-25
Applicant: Snap Inc.
Inventor: Roman Golobokov , Aleksandr Mashrabov , Dmitry Matov , Jeremy Baker Voss
Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.
-
公开(公告)号:US20220284654A1
公开(公告)日:2022-09-08
申请号:US17751796
申请日:2022-05-24
Applicant: Snap Inc.
Inventor: Eugene Krokhalev , Aleksandr Mashrabov , Pavel Savchenkov
Abstract: Disclosed are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes at least one input frame and the at least one input frame includes a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the at least one input frame and the target image, two-dimensional (2D) deformations of the second face in the target image, where the 2D deformations, when applied to the second face, modify the second face to imitate at least a facial expression of the first face, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.
-
公开(公告)号:US20220207810A1
公开(公告)日:2022-06-30
申请号:US17695902
申请日:2022-03-16
Applicant: Snap Inc.
Inventor: Egor Nemchinov , Sergei Gorbatyuk , Aleksandr Mashrabov , Egor Spirin , Iaroslav Sokolov , Andrei Smirdin , Igor Tukh
Abstract: Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.
-
公开(公告)号:US20220148276A1
公开(公告)日:2022-05-12
申请号:US16949700
申请日:2020-11-11
Applicant: Snap Inc.
Inventor: Roman Golobokov , Aleksandr Mashrabov , Dmitry Matov , Jeremy Baker Voss
Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.
-
-
-
-
-
-
-
-
-