公开(公告)号：US10949655B2

公开(公告)日：2021-03-16

申请号：US16260813

申请日：2019-01-29

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  G10L25/63 ,  H04N7/15 ,  H04N7/14 ,  G06K9/62 ,  G06T7/33 ,  G06Q30/02 ,  G10L25/57

Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

公开(公告)号：US20200236301A1

公开(公告)日：2020-07-23

申请号：US16594690

申请日：2019-10-07

Applicant: SNAP INC.

Inventor： Victor Shaburov ,  Alexander Mashrabov ,  Grigoriy Tkachenko ,  Ivan Semenov

IPC: H04N5/265 ,  G06T7/194 ,  G06K9/00 ,  G06T7/40 ,  G11B27/02 ,  H04L12/58

Abstract: Disclosed are systems and methods for providing personalized videos featuring multiple persons. An example method includes receiving a user selection of a video having at least one frame with at least a target face and at least one further target face and receiving an image of a source face and a further image of a further source face. The method further includes modifying the image of the source face to generate an image of a modified source face and modifying the further image of the further source face to generate an image of a modified further source face. In the at least one frame of the video, the target face is replaced with the image of modified source face and the at least one further face is replaced with the modified further source face to generate a personalized video. The personalized video is sent to at least one further user.

公开(公告)号：US20200234483A1

公开(公告)日：2020-07-23

申请号：US16661122

申请日：2019-10-23

Applicant: SNAP INC.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobkov

IPC: G06T13/80 ,  H04L12/58 ,  G11B27/031

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method may commence with receiving a video template. The video template may include a sequence of frame images and preset text parameters defining an animation of a text. The method may continue with generating a configuration file based on the text and the preset text parameters. The configuration file may include text parameters defining rendering the text for each of the frame images. The method may further include receiving an input text and rendering an output video comprising the sequence of frame images featuring the input text rendered according to the text parameters. The rendering may be performed based on the configuration file. The method may continue with sending the output video to a further computing device via a communication chat.

公开(公告)号：US10565795B2

公开(公告)日：2020-02-18

申请号：US15654429

申请日：2017-07-19

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Eitan Pilipski ,  Dhritiman Sagar ,  Victor Shaburov

IPC: G06T19/00 ,  A63F13/213 ,  A63F13/428 ,  G06T15/00

Abstract: A context based augmented reality system can be used to display augmented reality elements over a live video feed on a client device. The augmented reality elements can be selected based on a number of context inputs generated by the client device. The context inputs can include location data of the client device and location data of nearby physical places that have preconfigured augmented elements. The preconfigured augmented elements can be preconfigured to exhibit a design scheme of the corresponding physical place.

公开(公告)号：US10255488B1

公开(公告)日：2019-04-09

申请号：US15829510

申请日：2017-12-01

Applicant: SNAP INC.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  H04N7/14 ,  G06T7/33 ,  G06Q30/02 ,  H04N7/15 ,  G10L25/63 ,  G06K9/62 ,  G10L25/57

Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotions

公开(公告)号：US10235562B2

公开(公告)日：2019-03-19

申请号：US15816776

申请日：2017-11-17

Applicant: Snap Inc.

Inventor： Victor Shaburov ,  Yurii Monastyrshyn

IPC: G06K9/00 ,  G10L25/63 ,  H04N7/15 ,  H04N7/14 ,  G06K9/62 ,  G06T7/33 ,  G06Q30/02 ,  G10L25/57

Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

公开(公告)号：US12212704B2

公开(公告)日：2025-01-28

申请号：US18509589

申请日：2023-11-15

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04B1/38 ,  G06T11/00 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72439 ,  H04M1/72442

Abstract: Provided are systems and methods for customizing modifiable videos. An example method includes analyzing recent messages associated with a user in a multimedia messaging application to determine a context of the recent messages, determining, based on the context, a property of a modifiable feature, selecting, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos associated with a preset modifiable feature, replacing a property of the preset modifiable feature in relevant modifiable videos of the list of relevant modifiable videos with the property of the modifiable feature, and rendering the list of relevant modifiable videos for viewing by the user, where the rendering includes displaying the modifiable feature in the relevant modifiable videos.

公开(公告)号：US12118031B2

公开(公告)日：2024-10-15

申请号：US16990505

申请日：2020-08-11

Applicant: Snap Inc.

Inventor： Aleksandr Mashrabov ,  Victor Shaburov ,  Grigoriy Tkachenko ,  Jeremy Baker Voss

IPC: G06F16/535 ,  G06F16/538 ,  G06F16/54 ,  G06F16/58 ,  G06V40/16

CPC classification number: G06F16/535 ,  G06F16/538 ,  G06F16/54 ,  G06F16/5866 ,  G06V40/165

Abstract: A personalized preview system to receive a request to access a collection of media items from a user of a user device. Responsive to receiving the request to access the collection of media items, the personalized preview system accesses user profile data associated with the user, wherein the user profile data includes an image. For example, the image may comprise a depiction of a face, wherein the face comprises a set of facial landmarks. Based on the image, the personalized preview system generates one or more media previews based on corresponding media templates and the image, and displays the one or more media previews within a presentation of the collection of media items at a client device of the user.

公开(公告)号：US11895260B2

公开(公告)日：2024-02-06

申请号：US17522947

申请日：2021-11-10

Applicant: Snap Inc.

Inventor： Jeremy Voss ,  Victor Shaburov ,  Ivan Babanin ,  Aleksandr Mashrabov ,  Roman Golobokov

IPC: H04B1/38 ,  H04M1/72439 ,  G06T11/00 ,  G06T11/60 ,  G06T13/80 ,  H04M1/72436 ,  H04M1/72442 ,  H04M1/72427 ,  H04L51/02 ,  H04L51/216

CPC classification number: H04M1/72439 ,  G06T11/60 ,  G06T13/80 ,  H04L51/02 ,  H04L51/216 ,  H04M1/72427 ,  H04M1/72436 ,  H04M1/72442

Abstract: A system for customizing modifiable videos of a multimedia messaging application (MMA) is provided. In one example embodiment, the system includes at least one processor and a memory storing processor-executable codes, wherein the at least one processor is configured to analyze recent messages of a user to determine a context of the recent messages; determine, based on the context, a customized feature; select, based on the context, a list of relevant modifiable videos from a database configured to store modifiable videos, the modifiable videos being associated with a preset modifiable feature; replace the preset modifiable feature in the relevant modifiable videos with the customized feature; and render a modifiable video from the list of relevant modifiable videos for viewing by the user, the rendering including displaying the customized feature in the relevant modifiable videos.

公开(公告)号：US11842433B2

公开(公告)日：2023-12-12

申请号：US17697559

申请日：2022-03-17

Applicant: Snap Inc.

Inventor： Alexander Mashrabov ,  Victor Shaburov ,  Sofia Savinova ,  Dmitriy Matov ,  Andrew Osipov ,  Ivan Semenov ,  Roman Golobokov

IPC: G06T13/80 ,  H04L51/04 ,  G11B27/031 ,  H04L51/10 ,  H04M1/72439

CPC classification number: G06T13/80 ,  G11B27/031 ,  H04L51/04 ,  H04L51/10 ,  H04M1/72439

Abstract: Described are systems and methods for generating personalized videos with customized text messages. An example method commences with receiving an input text and a video template. The video template includes a sequence of frame images and text parameters defining an animation of the input text for the sequence of frame images. The method continues with rendering an output video. The output video includes the sequence of frame images featuring the input text rendered according to the text parameters. The method further includes providing a user with an option to change at least one text parameter of the text parameters. The method continues with dynamically changing, by the at least one computing resource, the input text according to the at least one text parameter. The method further includes providing, by the at least one computing resource, the output video to at least one further computing resource via a communication chat.