公开(公告)号：US20250022246A1

公开(公告)日：2025-01-16

申请号：US18904104

申请日：2024-10-02

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

Abstract: Provided are systems and methods for template-based generation of personalized videos. An example method includes receiving a sequence of frame images, face area parameters corresponding to positions of a face area in a frame image of the sequence of frame images, and facial landmark parameters corresponding to the frame image of the sequence of frame images, where the facial landmark parameters are absent from the frame images, receiving an image of a source face, modifying, based on the facial landmark parameters corresponding to the frame image, the image of the source face to obtain a further face image featuring the source face adopting a facial expression corresponding to the facial landmark parameters, and inserting the further face image into the frame image at a position determined by the face area parameters corresponding to the frame image, thereby generating an output frame of an output video.

公开(公告)号：US20240089364A1

公开(公告)日：2024-03-14

申请号：US18509589

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

CPC classification number: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

Abstract: Provided are systems and methods for customizing modifiable videos. An example method includes analyzing recent messages associated with a user in a multimedia messaging application to determine a context of the recent messages, determining, based on the context, a property of a modifiable feature, selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos associated with a preset modifiable feature, replacing a property of the preset modifiable feature in relevant modifiable videos of the list of relevant modifiable videos with the property of the modifiable feature, and rendering the list of relevant modifiable videos for viewing by the user, where the rendering includes displaying the modifiable feature in the relevant modifiable videos.

公开(公告)号：US20230222745A1

公开(公告)日：2023-07-13

申请号：US18123028

申请日：2023-03-17

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  H04W4/02 ,  H04W4/021 ,  G06T15/00 ,  G06F16/95

CPC classification number: G06T19/006 ,  A63F13/213 ,  A63F13/428 ,  G06T19/003 ,  H04W4/02 ,  H04W4/021 ,  G06T15/00 ,  G06F16/95

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

公开(公告)号：US11694417B2

公开(公告)日：2023-07-04

申请号：US17674876

申请日：2022-02-18

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Dmitriy Matov ,  Sofia Savinova ,  Alexey Pchelnikov ,  Roman Golobokov

IPC: G06T19/20 ,  G06T13/40 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06T13/40 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172 ,  G06V40/174

Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of skin masks defining positions of a skin area of a part of the at least one body in the frame images. The method may continue with receiving an image of a source face. The method may further include determining color data associated with the source face. The method may include recoloring the skin area of the part of the at least one body in the frame image and inserting the image of the source face into the frame image at a position determined by face area parameters corresponding to the frame image to generate an output frame of an output video.

公开(公告)号：US20220284637A1

公开(公告)日：2022-09-08

申请号：US17751814

申请日：2022-05-24

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Semenov ,  Diana Maximova ,  Alina Berezhko

IPC: G06T11/00 ,  G06T7/11 ,  G06T7/40

Abstract: Disclosed are systems and methods for customizing soundtracks and hairstyles in modifiable videos of multimedia messaging application. An example method includes determining, by a computing device, that a user has provided an instruction to select automatically, based on parameters of a modifiable video, a selfie image for insertion into the modifiable video, where the selfie image is selected from a set of pre-generated selfie images associated with hairstyles, in response to the determination, selecting, by the computing device and based on the parameters of the modifiable video, the selfie image from the set of pre-generated selfie images, and generating, by the computing device and based on the selfie image of the user and the modifiable video, a personalized video of the user, where the personalized video includes at least a part of the selfie image and at least a part of the modifiable video.

公开(公告)号：US20220150200A1

公开(公告)日：2022-05-12

申请号：US17649159

申请日：2022-01-27

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Victor Shaburov ,  Trevor Stephenson

IPC: H04L51/10 ,  B01J19/12 ,  C25B1/04 ,  C25B15/00

Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

公开(公告)号：US11277364B2

公开(公告)日：2022-03-15

申请号：US17035530

申请日：2020-09-28

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Victor Shaburov ,  Trevor Stephenson

IPC: G06F15/16 ,  H04L51/10 ,  B01J19/12 ,  C25B1/04 ,  C25B15/00 ,  H04L67/146

Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

公开(公告)号：US11044217B2

公开(公告)日：2021-06-22

申请号：US16703559

申请日：2019-12-04

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Oleksandr Pyshchenko ,  Victor Shaburov ,  Trevor Stephenson ,  Aleksei Stoliar

IPC: G06F15/16 ,  H04L12/58 ,  H04L29/08

Abstract: Systems and methods are provided for receiving a first media content item associated with a first interactive object of an interactive message, receiving a second media content item associated with a second interactive object of the interactive message, generating a third media content item based on the first media content item and second media content item, wherein the third media content item comprises combined features of the first media content item and the second media content item, and causing display of the generated third media content item.

公开(公告)号：US10102423B2

公开(公告)日：2018-10-16

申请号：US15199482

申请日：2016-06-30

Applicant: Snap, Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn ,  Oleksandr Pyshchenko ,  Sergei Kotcur

IPC: G06K9/00 ,  G06T7/00 ,  G06T7/40

Abstract: Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.

公开(公告)号：US20180075292A1

公开(公告)日：2018-03-15

申请号：US15816776

申请日：2017-11-17

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  H04N7/15 ,  H04N7/14 ,  G10L25/63 ,  G06Q30/02 ,  G06K9/62 ,  G10L25/57

CPC classification number: G06K9/00315 ,  G06K9/00201 ,  G06K9/00248 ,  G06K9/00261 ,  G06K9/00281 ,  G06K9/6209 ,  G06Q30/0281 ,  G06T7/337 ,  G06T7/344 ,  G06T2207/10016 ,  G06T2207/30201 ,  G10L25/57 ,  G10L25/63 ,  H04N7/147 ,  H04N7/15

Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.