Binarization of a video stream
    1.
    发明授权

    公开(公告)号:US11450085B2

    公开(公告)日:2022-09-20

    申请号:US17024074

    申请日:2020-09-17

    Applicant: Snap Inc.

    Abstract: Systems, devices, media, and methods are presented for receiving a set of images in a video stream, receiving input that selects an image capture mode icon from a plurality of image capture mode icons; selecting a blur operation from a plurality of blur operations based on the image capture mode icon selected by the input; and modifying the video stream based on the selected blur operation.

    EMOTION RECOGNITION IN VIDEO CONFERENCING

    公开(公告)号:US20210192193A1

    公开(公告)日:2021-06-24

    申请号:US17172552

    申请日:2021-02-10

    Applicant: Snap Inc.

    Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

    Emotion recognition in video
    3.
    发明授权

    公开(公告)号:US10963679B1

    公开(公告)日:2021-03-30

    申请号:US16299472

    申请日:2019-03-12

    Applicant: SNAP INC.

    Abstract: Methods and systems for recognizing emotions in video are disclosed. One example method includes the steps of receiving a video including images, detecting a face of the individual in the images, mapping the detected face to a model including at least two separated points in space corresponding to detectable emotions, each of the at least two separated points in space representing a plurality of example faces corresponding to one of the detectable emotions, determining the emotion of the individual from the detectable emotions based on a proximity of the detected face to the at least two separated points in space.

    DEVICE CONTROL USING AUDIO DATA
    4.
    发明申请

    公开(公告)号:US20190354344A1

    公开(公告)日:2019-11-21

    申请号:US15981295

    申请日:2018-05-16

    Applicant: Snap Inc.

    Abstract: An audio control system can control interactions with an application or device using keywords spoken by a user of the device. The audio control system can use machine learning models (e.g., a neural network model) trained to recognize one or more keywords. Which machine learning model is activated can depend on the active location in the application or device. Responsive to detecting keywords, different actions are performed by the device, such as navigation to a pre-specified area of the application.

    AUGMENTED REALITY USER INTERFACE CONTROL
    5.
    发明申请

    公开(公告)号:US20190196663A1

    公开(公告)日:2019-06-27

    申请号:US15853264

    申请日:2017-12-22

    Applicant: Snap Inc.

    Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

    REAL TIME PAINTING OF A VIDEO STREAM

    公开(公告)号:US20250159101A1

    公开(公告)日:2025-05-15

    申请号:US19021581

    申请日:2025-01-15

    Applicant: Snap Inc.

    Abstract: Systems, devices, media, and methods are presented for generating graphical representations within frames of a video stream in real time. The systems and methods receive a frame depicting a portion of a face, identify user input, identify positions on the portion of the face corresponding to the user input. The systems and methods generate a graphical representation of the user input linked to positions on the portion of the face and render the graphical representation within frames of the video stream in real time.

    Triggering changes to real-time special effects included in a live streaming video

    公开(公告)号:US11711414B2

    公开(公告)日:2023-07-25

    申请号:US17538545

    申请日:2021-11-30

    Applicant: Snap Inc.

    CPC classification number: H04L65/762 H04L65/61

    Abstract: Method for triggering changes to real-time special effects included in a live streaming video starts with a processor transmitting in real-time a video stream captured by a camera via a network. The processor causes a live streaming interface that includes the video stream to be displayed on the plurality of client devices. The processor receives a trigger to apply one of a plurality of special effects to the video stream and determines a first special effect of the plurality of special effects is associated with the trigger. The processor applies in real-time the first special effect to the video stream to generate a video stream having the first special effect and transmits in real-time the video stream having the first special effect via the network. The processor causes the live streaming interface that includes the video stream having the first special effect to be displayed on the plurality of client devices. Other embodiments are disclosed.

    DEVICE CONTROL USING AUDIO DATA
    8.
    发明申请

    公开(公告)号:US20220365748A1

    公开(公告)日:2022-11-17

    申请号:US17876842

    申请日:2022-07-29

    Applicant: Snap Inc.

    Abstract: An audio control system can control interactions with an application or device using keywords spoken by a user of the device. The audio control system can use machine learning models (e.g., a neural network model) trained to recognize one or more keywords. Which machine learning model is activated can depend on the active location in the application or device. Responsive to detecting keywords, different actions are performed by the device, such as navigation to a pre-specified area of the application.

    Triggering changes to real-time special effects included in a live streaming video

    公开(公告)号:US11212331B1

    公开(公告)日:2021-12-28

    申请号:US16264515

    申请日:2019-01-31

    Applicant: Snap Inc.

    Abstract: Method for triggering changes to real-time special effects included in a live streaming video starts with a processor transmitting in real-time a video stream captured by a camera via a network. The processor causes a live streaming interface that includes the video stream to be displayed on the plurality of client devices. The processor receives a trigger to apply one of a plurality of special effects to the video stream and determines a first special effect of the plurality of special effects is associated with the trigger. The processor applies in real-time the first special effect to the video stream to generate a video stream having the first special effect and transmits in real-time the video stream having the first special effect via the network. The processor causes the live streaming interface that includes the video stream having the first special effect to be displayed on the plurality of client devices. Other embodiments are disclosed.

    Emotion recognition in video conferencing

    公开(公告)号:US10949655B2

    公开(公告)日:2021-03-16

    申请号:US16260813

    申请日:2019-01-29

    Applicant: Snap Inc.

    Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.

Patent Agency Ranking