-
公开(公告)号:US10812766B1
公开(公告)日:2020-10-20
申请号:US16039051
申请日:2018-07-18
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn
Abstract: Systems, devices, media, and methods are presented for receiving a set of images in a video stream, converting one or more images of the set of images to a set of single channel images, generating a set of approximation images from the set of single channel images, and generating a set of binarized images by thresholding the set of approximation images.
-
公开(公告)号:US10255488B1
公开(公告)日:2019-04-09
申请号:US15829510
申请日:2017-12-01
Applicant: SNAP INC.
Inventor: Victor Shaburov , Yurii Monastyrshyn
Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotions
-
公开(公告)号:US10235562B2
公开(公告)日:2019-03-19
申请号:US15816776
申请日:2017-11-17
Applicant: Snap Inc.
Inventor: Victor Shaburov , Yurii Monastyrshyn
Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.
-
公开(公告)号:US11676412B2
公开(公告)日:2023-06-13
申请号:US17022350
申请日:2020-09-16
Applicant: Snap Inc.
Inventor: Victor Shaburov , Yurii Monastyrshyn , Oleksandr Pyshchenko , Sergei Kotcur
IPC: G06K9/00 , G06V40/10 , A63F13/837 , A63F13/213 , A63F13/22 , G06T7/73 , G06T7/90 , A63F13/655 , A63F13/428 , A63F13/52 , G06T7/77
CPC classification number: G06V40/11 , A63F13/213 , A63F13/22 , A63F13/428 , A63F13/52 , A63F13/655 , A63F13/837 , G06T7/73 , G06T7/77 , G06T7/90 , G06T2207/10024 , G06T2207/20072 , G06T2207/30196
Abstract: Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.
-
公开(公告)号:US11543929B2
公开(公告)日:2023-01-03
申请号:US17301529
申请日:2021-04-06
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.
-
公开(公告)号:US11487501B2
公开(公告)日:2022-11-01
申请号:US15981295
申请日:2018-05-16
Applicant: Snap Inc.
Inventor: Xin Chen , Yurii Monastyrshyn , Fedir Poliakov , Shubham Vij
Abstract: An audio control system can control interactions with an application or device using keywords spoken by a user of the device. The audio control system can use machine learning models (e.g., a neural network model) trained to recognize one or more keywords. Which machine learning model is activated can depend on the active location in the application or device. Responsive to detecting keywords, different actions are performed by the device, such as navigation to a pre-specified area of the application.
-
公开(公告)号:US11212482B2
公开(公告)日:2021-12-28
申请号:US16789121
申请日:2020-02-12
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn , Illia Tulupov
Abstract: Systems, devices, media, and methods are presented for generating graphical representations within frames of a video stream in real time. The systems and methods receive a frame depicting a portion of a face, identify user input, identify positions on the portion of the face corresponding to the user input. The systems and methods generate a graphical representation of the user input linked to positions on the portion of the face and render the graphical representation within frames of the video stream in real time.
-
公开(公告)号:US20210223919A1
公开(公告)日:2021-07-22
申请号:US17301529
申请日:2021-04-06
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn , Oleksandr Pyshchenko
IPC: G06F3/0481 , G06F3/01 , G06K9/32 , G06K9/00 , G06T19/00
Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.
-
公开(公告)号:US20200186747A1
公开(公告)日:2020-06-11
申请号:US16789121
申请日:2020-02-12
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn , lllia Tulupov
Abstract: Systems, devices, media, and methods are presented for generating graphical representations within frames of a video stream in real time. The systems and methods receive a frame depicting a portion of a face, identify user input, identify positions on the portion of the face corresponding to the user input. The systems and methods generate a graphical representation of the user input linked to positions on the portion of the face and render the graphical representation within frames of the video stream in real time.
-
公开(公告)号:US10430016B2
公开(公告)日:2019-10-01
申请号:US15853264
申请日:2017-12-22
Applicant: Snap Inc.
Inventor: Yurii Monastyrshyn , Oleksandr Pyschchenko
Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.
-
-
-
-
-
-
-
-
-