GENERATING INTERACTIVE MESSAGES WITH ASYNCHRONOUS MEDIA CONTENT

    公开(公告)号:US20210014183A1

    公开(公告)日:2021-01-14

    申请号:US17035530

    申请日:2020-09-28

    Applicant: Snap Inc.

    Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

    Generating interactive messages with asynchronous media content

    公开(公告)号:US10834040B2

    公开(公告)日:2020-11-10

    申请号:US16654796

    申请日:2019-10-16

    Applicant: Snap Inc.

    Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

    Object modeling and replacement in a video stream

    公开(公告)号:US10810418B1

    公开(公告)日:2020-10-20

    申请号:US16122630

    申请日:2018-09-05

    Applicant: Snap Inc.

    Abstract: Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.

    SYSTEMS AND METHODS FOR PROVIDING PERSONALIZED VIDEOS

    公开(公告)号:US20200236297A1

    公开(公告)日:2020-07-23

    申请号:US16594771

    申请日:2019-10-07

    Applicant: SNAP INC.

    Abstract: Disclosed are systems and methods for providing personalized videos. An example method includes storing one or more preprocessed videos. The one or more preprocessed videos may include at least one frame with at least a target face. The method may continue with receiving an image of a source face, for example, by receiving a user selection of a further image and segmenting the further image into portions including the source face and a background. The method may then proceed with modifying the one or more preprocessed videos to generate one or more personalized videos. The modification may include modifying the image of the source face to generate an image of a modified source face. The modified source face may adopt a facial expression of the target face. The modification may further include replacing the at least one target face with the image of the modified source face.

    SYSTEMS AND METHODS FOR TEMPLATE-BASED GENERATION OF PERSONALIZED VIDEOS

    公开(公告)号:US20200234508A1

    公开(公告)日:2020-07-23

    申请号:US16661086

    申请日:2019-10-23

    Applicant: SNAP INC.

    Abstract: Disclosed are systems and methods for template-based generation of personalized videos. An example method may commence with receiving video configuration data including a sequence of frame images, a sequence of face area parameters defining positions of a face area in the frame images, and a sequence of facial landmark parameters defining positions of facial landmarks in the frame images. The method may continue with receiving an image of a source face. The method may further include generating an output video. The generation of the output video may include modifying a frame image of the sequence of frame images. Specifically, the image of the source face may be modified to obtain a further image featuring the source face adopting a facial expression corresponding to the facial landmark parameters. The further image may be inserted into the frame image at a position determined by face area parameters corresponding to the frame image.

    GENERATING INTERACTIVE MESSAGES WITH ASYNCHRONOUS MEDIA CONTENT

    公开(公告)号:US20200053034A1

    公开(公告)日:2020-02-13

    申请号:US16654796

    申请日:2019-10-16

    Applicant: Snap Inc.

    Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

    Method for real-time video processing involving retouching of an object in the video

    公开(公告)号:US10438631B2

    公开(公告)日:2019-10-08

    申请号:US14314334

    申请日:2014-06-25

    Applicant: Snap Inc.

    Abstract: A method for real time video processing for retouching an object in a video is presented The method includes providing an object in the video steam, where the object is at least partially and at least occasionally presented in frames of the video. The method sets a degree of retouching and generates a list of at least one element of the object selected based on a request of retouching and the degree of retouching. The method detects the at least one element of the object in the video and parameters of the at least one element and calculates new parameters of the at least one element according to the degree of retouching. Characteristic points are detected for each of the at least one element of the object and a mesh is generated based on the characteristic points for each of the at least one element of the object. The at least one element of the object in the video is tracked by aligning the mesh for each of the at least one element with a position of the corresponding each of the at least one element. The frames of the video are transformed such that the at least one element of the object is modified by the application of the new parameters to the at least one element of the object using the mesh.

    EMOTION RECOGNITION IN VIDEO CONFERENCING
    88.
    发明申请

    公开(公告)号:US20190156112A1

    公开(公告)日:2019-05-23

    申请号:US16260813

    申请日:2019-01-29

    Applicant: Snap Inc.

    Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

Patent Agency Ranking