公开(公告)号：US11652956B2

公开(公告)日：2023-05-16

申请号：US17172552

申请日：2021-02-10

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  G06V40/16 ,  G10L25/63 ,  H04N7/15 ,  H04N7/14 ,  G06V10/75 ,  G06V20/64 ,  G06T7/33 ,  G06Q30/02 ,  G10L25/57

CPC classification number: G06V40/176 ,  G06Q30/0281 ,  G06T7/337 ,  G06T7/344 ,  G06V10/7553 ,  G06V20/64 ,  G06V40/165 ,  G06V40/167 ,  G06V40/171 ,  G10L25/63 ,  H04N7/147 ,  H04N7/15 ,  G06T2207/10016 ,  G06T2207/30201 ,  G10L25/57

Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

公开(公告)号：US11631222B2

公开(公告)日：2023-04-18

申请号：US17321706

申请日：2021-05-17

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  H04W4/021 ,  H04W4/02 ,  G06T15/00 ,  G06F16/95

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

公开(公告)号：US20230049489A1

公开(公告)日：2023-02-16

申请号：US17979567

申请日：2022-11-02

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Grigoriy Tkachenko ,  Ivan Semenov

IPC: H04N5/265 ,  G06V40/16 ,  H04L51/10 ,  G11B27/02 ,  G06T7/194 ,  G06T7/40

Abstract: Provided are systems and methods for providing personalized videos featuring multiple persons. An example method includes enabling a communication chat between a user of a computing device and at least one further user of at least one further computing device, receiving a user selection of a video from one or more personalized videos, receiving an image of a source face and a further image of a further source face, modifying the image of the source face to generate an image of a modified source face, modifying the further image of the further source face to generate an image of a modified further source face, replacing, in the video, a target face with the image of the modified source face and at least one further target face with the modified further source face to generate a personalized video, and sending the personalized video to the at least one further user.

公开(公告)号：US11558325B2

公开(公告)日：2023-01-17

申请号：US17330852

申请日：2021-05-26

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Oleksandr Pyshchenko ,  Victor Shaburov ,  Trevor Stephenson ,  Aleksei Stoliar

IPC: G06F15/16 ,  H04L51/10 ,  B01J19/12 ,  C25B1/04 ,  C25B15/00 ,  H04L67/146

Abstract: Systems and methods are provided for receiving a first media content item associated with a first interactive object of an interactive message, receiving a second media content item associated with a second interactive object of the interactive message, generating a third media content item based on the first media content item and second media content item, wherein the third media content item comprises combined features of the first media content item and the second media content item, and causing display of the generated third media content item.

公开(公告)号：US11290682B1

公开(公告)日：2022-03-29

申请号：US16141588

申请日：2018-09-25

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: H04N7/15 ,  G06T7/38 ,  G06T19/00 ,  G06K9/00 ,  G06T5/00 ,  G06K9/46

Abstract: Methods and systems for real-time video processing can be used in video conferencing to modify image quality of background. One example method includes the steps of receiving a video including a sequence of images, identifying at least one object of interest (e.g., a face) in one or more of the images, detecting feature reference points of the at least one object of interest, and tracking the at least one object of interest in the video. The tracking may comprise aligning a virtual face mesh to the at least one object of interest in one or more of the images. Further, a background is identified in the images by separating the at least one object of interest from each image based on the virtual face mesh. The background is then modified in each of the images by blurring, changing a resolution, colors, or other parameters.

公开(公告)号：US20210368039A1

公开(公告)日：2021-11-25

申请号：US16878868

申请日：2020-05-20

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04M1/725 ,  G06T11/60 ,  G06T13/80 ,  H04L12/58

Abstract: A system for customizing text messages in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to analyze recent messages of a user in the MMA to determine a context of the recent messages; determine, based on the context, a customized text message; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with preset text messages; replace the preset text messages in the relevant modifiable videos with the customized message; and render the list of relevant modifiable videos for viewing and selecting by the user, the rendering including displaying the customized text message in the relevant modifiable videos.

公开(公告)号：US11037372B2

公开(公告)日：2021-06-15

申请号：US16745117

申请日：2020-01-16

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  H04W4/021 ,  H04W4/02 ,  G06T15/00

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

公开(公告)号：US10950271B1

公开(公告)日：2021-03-16

申请号：US16298721

申请日：2019-03-11

Applicant: Snap Inc.

Inventor： Elena Shaburova ,  Victor Shaburov

IPC: G11B27/031 ,  G06K9/46 ,  G06K9/52 ,  G06T13/40 ,  G06T17/20 ,  G06T7/90 ,  G06T7/246 ,  G06T7/33 ,  G06T11/60 ,  G06T19/20 ,  H04N5/262 ,  H04N9/79 ,  G06N20/00 ,  G06K9/00 ,  G06T11/00 ,  G06T5/00 ,  G06F3/01

Abstract: A computer implemented method of triggering events in a video, the method comprising: providing a list of objects with their states and corresponding events in video such that each state from the list triggers at least one event of the corresponding events, wherein each object from the list has at least one state triggering at least one event of the corresponding events from the list in video; detecting at least one object from the list that at least partially and at least occasionally is presented in frames of the video; tracking the at least one object and its state; triggering at least one event of the corresponding events from the list in video in case the state of the at least one object matches with one of its states from the list.

公开(公告)号：US10943371B1

公开(公告)日：2021-03-09

申请号：US16836276

申请日：2020-03-31

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Semenov ,  Diana Maximova ,  Alina Berezhko

IPC: G06T11/00 ,  G06T7/11 ,  G06T7/40 ,  H04W4/14

Abstract: A system for customizing soundtracks and hairstyles in modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes a processor and a memory storing processor-executable codes, wherein the processor is configured to receive, via the MMA, a modifiable video and an image of a user including an image of a face and an image of hair; determine that the image of hair is modifiable; modify the image of hair and generate a further image including the modified image of hair and the image of the face; generate, based on the further image and the modifiable video, a personalized video, wherein the personalized video includes a part of the further image of the user and a part of the modifiable video, and add a soundtrack to the personalized video based on predetermined criteria.

公开(公告)号：US20210014183A1

公开(公告)日：2021-01-14

申请号：US17035530

申请日：2020-09-28

Applicant: Snap Inc.

Inventor： Grygoriy Kozhemiak ,  Victor Shaburov ,  Trevor Stephenson

IPC: H04L12/58

Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.