-
公开(公告)号：US20230319126A1
公开(公告)日：2023-10-05
申请号：US18329954
申请日：2023-06-06
Applicant: Snap Inc.
Inventor： Artem Gaiduchenko , Artem Yerofieiev , Bohdan Pozharskyi , Gabriel Lupin , Oleksii Kholovchuk , Travis Chen , Yurii Monastyrshyn , Denys Makoviichuk
CPC classification number: H04L65/762 , H04L65/61
Abstract: Method for triggering changes to real-time special effects included in a live streaming video starts with a processor transmitting in real-time a video stream captured by a camera via a network. The processor causes a live streaming interface that includes the video stream to be displayed on the plurality of client devices. The processor receives a trigger to apply one of a plurality of special effects to the video stream and determines a first special effect of the plurality of special effects is associated with the trigger. The processor applies in real-time the first special effect to the video stream to generate a video stream having the first special effect and transmits in real-time the video stream having the first special effect via the network. The processor causes the live streaming interface that includes the video stream having the first special effect to be displayed on the plurality of client devices. Other embodiments are disclosed.
-
公开(公告)号：US11750770B2
公开(公告)日：2023-09-05
申请号：US17530094
申请日：2021-11-18
Applicant: Snap Inc.
Inventor： Yurii Monastyrshyn , Illia Tulupov
CPC classification number: H04N5/77 , G06F3/04883 , G06T3/40 , G06V40/165 , H04N21/44008 , H04N21/84 , G06T2207/30201
Abstract: Systems, devices, media, and methods are presented for generating graphical representations within frames of a video stream in real time. The systems and methods receive a frame depicting a portion of a face, identify user input, identify positions on the portion of the face corresponding to the user input. The systems and methods generate a graphical representation of the user input linked to positions on the portion of the face and render the graphical representation within frames of the video stream in real time.
-
公开(公告)号：US11652956B2
公开(公告)日：2023-05-16
申请号：US17172552
申请日：2021-02-10
Applicant: Snap Inc.
Inventor： Victor Shaburov , Yurii Monastyrshyn
IPC: G06K9/00 , G06V40/16 , G10L25/63 , H04N7/15 , H04N7/14 , G06V10/75 , G06V20/64 , G06T7/33 , G06Q30/02 , G10L25/57
CPC classification number: G06V40/176 , G06Q30/0281 , G06T7/337 , G06T7/344 , G06V10/7553 , G06V20/64 , G06V40/165 , G06V40/167 , G06V40/171 , G10L25/63 , H04N7/147 , H04N7/15 , G06T2207/10016 , G06T2207/30201 , G10L25/57
Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry, annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.
-
公开(公告)号：US11290682B1
公开(公告)日：2022-03-29
申请号：US16141588
申请日：2018-09-25
Applicant: Snap Inc.
Inventor： Victor Shaburov , Yurii Monastyrshyn
Abstract: Methods and systems for real-time video processing can be used in video conferencing to modify image quality of background. One example method includes the steps of receiving a video including a sequence of images, identifying at least one object of interest (e.g., a face) in one or more of the images, detecting feature reference points of the at least one object of interest, and tracking the at least one object of interest in the video. The tracking may comprise aligning a virtual face mesh to the at least one object of interest in one or more of the images. Further, a background is identified in the images by separating the at least one object of interest from each image based on the virtual face mesh. The background is then modified in each of the images by blurring, changing a resolution, colors, or other parameters.
-
公开(公告)号：US10996811B2
公开(公告)日：2021-05-04
申请号：US16547045
申请日：2019-08-21
Applicant: Snap Inc.
Inventor： Yurii Monastyrshyn , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.
-
Patent Agency Ranking
36.发明授权公开(公告)号：US10991395B1
公开(公告)日：2021-04-27
申请号：US16277750
申请日：2019-02-15
Applicant: Snap Inc.
Inventor： Elena Shaburova , Yurii Monastyrshyn
IPC: G06K9/00 , G11B27/031 , G06K9/46 , G06K9/52 , G06T13/40 , G06T17/20 , G06T11/00 , G06T5/00 , G06T7/90 , G06T7/246 , G06T7/33 , G06F3/01 , G06T11/60 , H04N5/262 , H04N9/79 , G06T19/20 , G06N20/00
Abstract: A computer-implemented method for real time video processing for changing a color of an object in a video, the method being performed in connection with a computerized system comprising a processing unit and a memory, the method comprising: providing an object in the video that at least partially and at least occasionally is presented in frames of the video; detecting the object in the video, wherein said detection comprises detecting feature reference points of the object; tracking the detected object in the video, wherein the tracking comprises creating a mesh that is based on the detected feature reference points of the object and aligning the mesh to the object in each frame; generating a set of node points on the created mesh based on a request for changing color, the set of node points defining an area the color of which is to be changed; and transforming the frames of the video in such way that the object's color is changed within the defined area when the object is presented in frames of the video.
-
公开(公告)号：US10810418B1
公开(公告)日：2020-10-20
申请号：US16122630
申请日：2018-09-05
Applicant: Snap Inc.
Inventor： Victor Shaburov , Yurii Monastyrshyn , Oleksandr Pyshchenko , Sergei Kotcur
IPC: G06K9/00 , G06T7/90 , G06T7/73 , A63F13/22 , A63F13/213 , A63F13/655 , A63F13/837 , A63F13/428 , A63F13/52
Abstract: Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.
-
公开(公告)号：US10609324B2
公开(公告)日：2020-03-31
申请号：US15213186
申请日：2016-07-18
Applicant: Snap, Inc.
Inventor： Yurii Monastyrshyn , Illia Tulupov
Abstract: Systems, devices, media, and methods are presented for generating graphical representations within frames of a video stream in real time. The systems and methods receive a frames depicting a portion of a face, identify user input, identify positions on the portion of the face corresponding to the user input. The systems and methods generate a graphical representation of the user input linked to positions on the portion of the face and render the graphical representation within frames of the video stream in real time.
-
公开(公告)号：US20190156112A1
公开(公告)日：2019-05-23
申请号：US16260813
申请日：2019-01-29
Applicant: Snap Inc.
Inventor： Victor Shaburov , Yurii Monastyrshyn
Abstract: Methods and systems for videoconferencing include recognition of emotions related to one videoconference participant such as a customer. This ultimately enables another videoconference participant, such as a service provider or supervisor, to handle angry annoyed, or distressed customers. One example method includes the steps of receiving a video that includes a sequence of images, detecting at least one object of interest (e.g., a face), locating feature reference points of the at least one object of interest, aligning a virtual face mesh to the at least one object of interest based on the feature reference points, finding over the sequence of images at least one deformation of the virtual face mesh that reflect face mimics, determining that the at least one deformation refers to a facial emotion selected from a plurality of reference facial emotions, and generating a communication bearing data associated with the facial emotion.
-
公开(公告)号：US10051253B1
公开(公告)日：2018-08-14
申请号：US14973816
申请日：2015-12-18
Applicant: Snap Inc.
Inventor： Yurii Monastyrshyn
Abstract: Systems, devices, media, and methods are presented for receiving a set of images in a video stream, converting one or more images of the set of images to a set of single channel images, generating a set of approximation images from the set of single channel images, and generating a set of binarized images by thresholding the set of approximation images.
-
-
-
-
-
-
-
-
-
Search Results
40
records
(took 0.027 seconds)
