-
公开(公告)号:US10445938B1
公开(公告)日:2019-10-15
申请号:US15801814
申请日:2017-11-02
Applicant: Snap Inc.
Inventor: Fedir Poliakov , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a set of images within a video stream and identify at least a portion of a face in a first subset of images. The systems and methods determine face characteristics by analyzing the portion of the face in the first subset of images. The systems and methods apply a graphical representation of glasses to the face based on the face characteristics and cause presentation of a modified video stream including the portion of the face with the graphical representation of the glasses in a second subset of images of the set of images while receiving the video stream.
-
公开(公告)号:US20190087660A1
公开(公告)日:2019-03-21
申请号:US15706096
申请日:2017-09-15
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US12106483B2
公开(公告)日:2024-10-01
申请号:US18241179
申请日:2023-08-31
Applicant: Snap Inc.
Inventor: Fedir Poliakov
IPC: G06T7/00 , G06T7/11 , G06T7/136 , G06T7/62 , G06T7/66 , G06T7/73 , G06T7/90 , G06V10/20 , G06V10/28 , G06V40/16 , G06V40/18 , G06V40/19
CPC classification number: G06T7/11 , G06T7/136 , G06T7/62 , G06T7/66 , G06T7/73 , G06T7/90 , G06V10/255 , G06V10/28 , G06V40/162 , G06V40/19 , G06V40/193 , G06V40/197 , G06T2207/10024 , G06T2207/30041
Abstract: Systems, devices, media, and methods are presented for gaze-based control of device operations. One method includes receiving a video stream from an imaging device, the video stream depicting one or more eyes, determining a gaze direction for the one or more eyes depicted in the video stream, detecting a change in the gaze direction of the one or more eyes, and triggering an operation in a client device based on the change in the gaze direction.
-
公开(公告)号:US20240249522A1
公开(公告)日:2024-07-25
申请号:US18624757
申请日:2024-04-02
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20230252610A1
公开(公告)日:2023-08-10
申请号:US18305187
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06T5/00 , G06T11/00 , G06T3/40 , G06T7/20 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90 , G06V40/16
CPC classification number: G06T5/008 , G06T3/40 , G06T7/11 , G06T7/20 , G06T7/73 , G06T7/90 , G06T7/136 , G06T11/001 , G06V40/165 , G06V40/171 , G06T2207/10016 , G06T2207/30201
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US11663706B2
公开(公告)日:2023-05-30
申请号:US17319381
申请日:2021-05-13
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T7/20 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90 , G06V10/50 , G06V10/56 , G06V40/16 , G06V10/46
CPC classification number: G06T7/20 , G06T3/40 , G06T5/008 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90 , G06T11/001 , G06V10/50 , G06V10/56 , G06V40/165 , G06V40/171 , G06T2207/10016 , G06T2207/30201 , G06V10/467
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US11645843B2
公开(公告)日:2023-05-09
申请号:US17248393
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20220207840A1
公开(公告)日:2022-06-30
申请号:US17646431
申请日:2021-12-29
Applicant: Snap Inc.
Inventor: Omer Cansizoglu , Chintan Doshi , Yuechuan Li , Stanislav Minakov , Fedir Poliakov , Justin Wilder
Abstract: The subject technology sends captured image data and metadata to a first set of computing processes for processing. The subject technology receives, asynchronously from a second set of computing processes, second metadata. The subject technology detects a signal indicating a command to stop image data capturing. The subject technology, in response to the detected signal, generating a composite AR content item based on the metadata and the captured image data. The subject technology provides the composite AR content item for rendering for display on an eyewear device.
-
公开(公告)号:US20210216776A1
公开(公告)日:2021-07-15
申请号:US17248393
申请日:2021-01-22
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20210090347A1
公开(公告)日:2021-03-25
申请号:US17115096
申请日:2020-12-08
Applicant: Snap Inc.
Inventor: Fedir Poliakov , Oleksandr Pyshchenko
Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a set of images within a video stream and identify at least a portion of a face in a first subset of images. The systems and methods determine face characteristics by analyzing the portion of the face in the first subset of images. The systems and methods apply a graphical representation of glasses to the face based on the face characteristics and cause presentation of a modified video stream including the portion of the face with the graphical representation of the glasses in a second subset of images of the set of images while receiving the video stream.
-
-
-
-
-
-
-
-
-