-
公开(公告)号:US11961213B2
公开(公告)日:2024-04-16
申请号:US18305187
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/20 , G06T7/73 , G06T7/90 , G06T11/00 , G06V10/50 , G06V10/56 , G06V40/16 , G06V10/46
CPC classification number: G06T5/008 , G06T3/40 , G06T7/11 , G06T7/136 , G06T7/20 , G06T7/73 , G06T7/90 , G06T11/001 , G06V10/50 , G06V10/56 , G06V40/165 , G06V40/171 , G06T2207/10016 , G06T2207/30201 , G06V10/467
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US20230362331A1
公开(公告)日:2023-11-09
申请号:US18221702
申请日:2023-07-13
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: H04N7/14 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06V30/242 , G06V10/82 , G06F18/214 , G06F18/24 , G06V30/19
CPC classification number: H04N7/147 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06V30/242 , G06V10/82 , G06F18/214 , G06F18/24765 , G06V30/19173 , H04N7/141 , G06T2207/10024 , G06T2207/10016 , G06T2207/20024 , G06T2207/20221 , G06T2207/30201 , G06T2207/20081 , G06T2207/20084 , H04N5/44504
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US20230274543A1
公开(公告)日:2023-08-31
申请号:US18312479
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T7/248 , G06V20/46 , G06T1/20 , G06T2207/20081 , G06T2200/28 , G06T2207/10016
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US11487501B2
公开(公告)日:2022-11-01
申请号:US15981295
申请日:2018-05-16
Applicant: Snap Inc.
Inventor: Xin Chen , Yurii Monastyrshyn , Fedir Poliakov , Shubham Vij
Abstract: An audio control system can control interactions with an application or device using keywords spoken by a user of the device. The audio control system can use machine learning models (e.g., a neural network model) trained to recognize one or more keywords. Which machine learning model is activated can depend on the active location in the application or device. Responsive to detecting keywords, different actions are performed by the device, such as navigation to a pre-specified area of the application.
-
公开(公告)号:US20220101536A1
公开(公告)日:2022-03-31
申请号:US17319381
申请日:2021-05-13
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06T7/20 , G06K9/00 , G06K9/46 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US11216949B1
公开(公告)日:2022-01-04
申请号:US16708584
申请日:2019-12-10
Applicant: Snap Inc.
Inventor: Fedir Poliakov
Abstract: Systems, devices, media, and methods are presented for gaze-based control of device operations. One method includes receiving a video stream from an imaging device, the video stream depicting one or more eyes, determining a gaze direction for the one or more eyes depicted in the video stream, detecting a change in the gaze direction of the one or more eyes, and triggering an operation in a client device based on the change in the gaze direction.
-
公开(公告)号:US11030753B2
公开(公告)日:2021-06-08
申请号:US16698463
申请日:2019-11-27
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T7/20 , G06K9/46 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US10929673B2
公开(公告)日:2021-02-23
申请号:US16654898
申请日:2019-10-16
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20210027100A1
公开(公告)日:2021-01-28
申请号:US16992968
申请日:2020-08-13
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US10474900B2
公开(公告)日:2019-11-12
申请号:US15706096
申请日:2017-09-15
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
-
-
-
-
-
-
-
-