-
公开(公告)号:US11989938B2
公开(公告)日:2024-05-21
申请号:US18312479
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US11676381B2
公开(公告)日:2023-06-13
申请号:US17248393
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US11551425B2
公开(公告)日:2023-01-10
申请号:US17115096
申请日:2020-12-08
Applicant: Snap Inc.
Inventor: Fedir Poliakov , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a set of images within a video stream and identify at least a portion of a face in a first subset of images. The systems and methods determine face characteristics by analyzing the portion of the face in the first subset of images. The systems and methods apply a graphical representation of glasses to the face based on the face characteristics and cause presentation of a modified video stream including the portion of the face with the graphical representation of the glasses in a second subset of images of the set of images while receiving the video stream.
-
公开(公告)号:US20220365748A1
公开(公告)日:2022-11-17
申请号:US17876842
申请日:2022-07-29
Applicant: Snap Inc.
Inventor: Xin Chen , Yurii Monastyrshyn , Fedir Poliakov , Shubham Vij
Abstract: An audio control system can control interactions with an application or device using keywords spoken by a user of the device. The audio control system can use machine learning models (e.g., a neural network model) trained to recognize one or more keywords. Which machine learning model is activated can depend on the active location in the application or device. Responsive to detecting keywords, different actions are performed by the device, such as navigation to a pre-specified area of the application.
-
公开(公告)号:US11367194B1
公开(公告)日:2022-06-21
申请号:US16795017
申请日:2020-02-19
Applicant: Snap Inc.
Inventor: Fedir Poliakov
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, binarizing an area of interest within one or more image, identifying an initial pupil location and an initial iris radius, and determining a final pupil location and a final iris radius. Some embodiments enable the client device to perform one or more operations within a user interface based on the image segmentation.
-
公开(公告)号:US10891797B1
公开(公告)日:2021-01-12
申请号:US16561610
申请日:2019-09-05
Applicant: Snap Inc.
Inventor: Fedir Poliakov , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a set of images within a video stream and identify at least a portion of a face in a first subset of images. The systems and methods determine face characteristics by analyzing the portion of the face in the first subset of images. The systems and methods apply a graphical representation of glasses to the face based on the face characteristics and cause presentation of a modified video stream including the portion of the face with the graphical representation of the glasses in a second subset of images of the set of images while receiving the video stream.
-
公开(公告)号:US10776663B1
公开(公告)日:2020-09-15
申请号:US16521956
申请日:2019-07-25
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: G06K9/62 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06K9/68 , G06K9/74 , H04N5/76 , H04N5/445 , H04N7/14
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US10607347B1
公开(公告)日:2020-03-31
申请号:US16130684
申请日:2018-09-13
Applicant: Snap Inc.
Inventor: Fedir Poliakov
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, binarizing an area of interest within one or more image, identifying an initial pupil location and an initial iris radius, and determining a final pupil location and a final iris radius. Some embodiments enable the client device to perform one or more operations within a user interface based on the image segmentation.
-
公开(公告)号:US10515454B2
公开(公告)日:2019-12-24
申请号:US16232737
申请日:2018-12-26
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T7/20 , G06K9/46 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US20190206061A1
公开(公告)日:2019-07-04
申请号:US16232737
申请日:2018-12-26
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06T7/20 , G06K9/00 , G06T7/90 , G06K9/46 , G06T3/40 , G06T11/00 , G06T7/73 , G06T7/136 , G06T7/11 , G06T5/00
CPC classification number: G06T7/20 , G06K9/00248 , G06K9/00281 , G06K9/4642 , G06K9/4652 , G06K2009/4666 , G06T3/40 , G06T5/008 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90 , G06T11/001 , G06T2207/10016 , G06T2207/30201
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
-
-
-
-
-
-
-
-