公开(公告)号：US20200234508A1

公开(公告)日：2020-07-23

申请号：US16661086

申请日：2019-10-23

Applicant: SNAP INC.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobkov

IPC: G06T19/20 ,  G06K9/00 ,  G06T13/40

Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of facial landmark parameters defining positions of facial landmarks in the frame images. The method may continue with receiving an image of a source face. The method may further include generating an output video. The generation of the output video may include modifying a frame image of the sequence of frame images. Specifically, the image of the source face may be modified to obtain a further image featuring the source face adopting a facial expression corresponding to the facial landmark parameters. The further image may be inserted into the frame image at a position determined by face area parameters corresponding to the frame image.

公开(公告)号：US20250022246A1

公开(公告)日：2025-01-16

申请号：US18904104

申请日：2024-10-02

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

Abstract: Provided are systems and methods for template-based generation of personalized videos. An example method includes receiving a sequence of frame images, face area parameters corresponding to positions of a face area in a frame image of the sequence of frame images, and facial landmark parameters corresponding to the frame image of the sequence of frame images, where the facial landmark parameters are absent from the frame images, receiving an image of a source face, modifying, based on the facial landmark parameters corresponding to the frame image, the image of the source face to obtain a further face image featuring the source face adopting a facial expression corresponding to the facial landmark parameters, and inserting the further face image into the frame image at a position determined by the face area parameters corresponding to the frame image, thereby generating an output frame of an output video.

公开(公告)号：US11694417B2

公开(公告)日：2023-07-04

申请号：US17674876

申请日：2022-02-18

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06T13/40 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172 ,  G06V40/174

Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of skin masks defining positions of a skin area of a part of the at least one body in the frame images. The method may continue with receiving an image of a source face. The method may further include determining color data associated with the source face. The method may include recoloring the skin area of the part of the at least one body in the frame image and inserting the image of the source face into the frame image at a position determined by face area parameters corresponding to the frame image to generate an output frame of an output video.

公开(公告)号：US12141933B2

公开(公告)日：2024-11-12

申请号：US18199989

申请日：2023-05-22

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method includes receiving a sequence of frame images, face area parameters corresponding to positions of a face area in a frame image of the sequence of frame images, and facial landmark parameters corresponding to the frame image of the sequence of frame images, receiving an image of a source face, modifying, based on the facial landmark parameters corresponding to the frame image, the image of the source face to obtain a further face image featuring the source face adopting a facial expression corresponding to the facial landmark parameters, and inserting the further face image into the frame image at a position determined by the face area parameters corresponding to the frame image, thereby generating an output frame of an output video.

公开(公告)号：US12099547B2

公开(公告)日：2024-09-24

申请号：US18139367

申请日：2023-04-26

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Aleksandr Mashrabov ,  Dmitriy Matov ,  Hanna Rulevska ,  Dmytro Ishchenko

IPC: G06F16/732 ,  G06F16/71 ,  H04L51/10

CPC classification number: G06F16/7328 ,  G06F16/71 ,  H04L51/10

Abstract: Systems and methods for searching and ranking videos are provided. An example method includes receiving an input from a user via a multimedia messaging application (MMA), selecting, from a database configured to store videos, a subset of videos based on the input and a predetermined rule, rendering, via the MMA, the subset of videos, determining that the user has viewed a video from the subset of videos, determining whether the user has shared, via the MMA, the viewed video, updating a log based on information concerning the subset of videos and the viewed video, and updating, based on the log, a model of the predetermined rule for selecting the videos. The model is trained based on pairs of first videos and second videos, where the first videos have been viewed and shared by the user and the second videos have been viewed but not shared by the user.

公开(公告)号：US11308677B2

公开(公告)日：2022-04-19

申请号：US16661122

申请日：2019-10-23

Applicant: SNAP INC.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobokov

IPC: G06T13/80 ,  H04L51/04 ,  G11B27/031 ,  H04L51/10 ,  H04M1/72439

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method may commence with receiving a video template. The video template may include a sequence of frame images and preset text parameters defining an animation of a text. The method may continue with generating a configuration file based on the text and the preset text parameters. The configuration file may include text parameters defining rendering the text for each of the frame images. The method may further include receiving an input text and rendering an output video comprising the sequence of frame images featuring the input text rendered according to the text parameters. The rendering may be performed based on the configuration file. The method may continue with sending the output video to a further computing device via a communication chat.

公开(公告)号：US20200234483A1

公开(公告)日：2020-07-23

申请号：US16661122

申请日：2019-10-23

Applicant: SNAP INC.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobkov

IPC: G06T13/80 ,  H04L12/58 ,  G11B27/031

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method may commence with receiving a video template. The video template may include a sequence of frame images and preset text parameters defining an animation of a text. The method may continue with generating a configuration file based on the text and the preset text parameters. The configuration file may include text parameters defining rendering the text for each of the frame images. The method may further include receiving an input text and rendering an output video comprising the sequence of frame images featuring the input text rendered according to the text parameters. The rendering may be performed based on the configuration file. The method may continue with sending the output video to a further computing device via a communication chat.

公开(公告)号：US20240087204A1

公开(公告)日：2024-03-14

申请号：US18509420

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobokov

IPC: G06T13/80 ,  G11B27/031 ,  H04L51/04 ,  H04L51/10

CPC classification number: G06T13/80 ,  G11B27/031 ,  H04L51/04 ,  H04L51/10 ,  H04M1/72439

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method includes receiving an input text, a video template including a sequence of frame images, and at least one parameter for animation of the input text across the sequence of frame images, generating, based on the input text and the at least one parameter for animation, a configuration file including a text style for the input text for a frame in the sequence of frame images, and rendering, based on the configuration file, an output frame of an output video, where the output frame includes the frame in the sequence of frame images and a layer, and where the layer includes the input text stylized based on the text style. The method further includes providing an option enabling a user to change the at least one parameter for animation.

公开(公告)号：US20230334090A1

公开(公告)日：2023-10-19

申请号：US18139367

申请日：2023-04-26

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Aleksandr Mashrabov ,  Dmitriy Matov ,  Hanna Rulevska ,  Dmytro Ishchenko

IPC: G06F16/732 ,  G06F16/71

CPC classification number: G06F16/7328 ,  G06F16/71 ,  H04L51/10

Abstract: Systems and methods for searching and ranking videos are provided. An example method includes receiving an input from a user via a multimedia messaging application (MMA), selecting, from a database configured to store videos, a subset of videos based on the input and a predetermined rule, rendering, via the MMA, the subset of videos, determining that the user has viewed a video from the subset of videos, determining whether the user has shared, via the MMA, the viewed video, updating a log based on information concerning the subset of videos and the viewed video, and updating, based on the log, a model of the predetermined rule for selecting the videos. The model is trained based on pairs of first videos and second videos, where the first videos have been viewed and shared by the user and the second videos have been viewed but not shared by the user.

公开(公告)号：US11669569B2

公开(公告)日：2023-06-06

申请号：US17581350

申请日：2022-01-21

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Aleksandr Mashrabov ,  Dmitriy Matov ,  Hanna Rulevska ,  Dmytro Ishchenko

IPC: G06F16/732 ,  G06F16/71 ,  H04L51/10

CPC classification number: G06F16/7328 ,  G06F16/71 ,  H04L51/10

Abstract: A system for searching and ranking modifiable videos is provided. In one example embodiment, the system includes a at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to implement the following operations upon executing the processor-executable codes: processing a first set of search requests by a first search rule to obtain a first set of first results; processing a second set of search requests by a second search rule to obtain a second set of second results; determining a first metric based, at least partially, on the first set of first results; determining a second metric based at least partially on the second set of second results; selecting, based on the first metric and the second metric, a search rule from the first search rule and the second search rule; and configuring a search engine to apply the search rule.