-
公开(公告)号：US11645843B2
公开(公告)日：2023-05-09
申请号：US17248393
申请日：2021-01-22
Applicant: Snap Inc.
Inventor： Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号：US20210216776A1
公开(公告)日：2021-07-15
申请号：US17248393
申请日：2021-01-22
Applicant: Snap Inc.
Inventor： Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号：US11030721B2
公开(公告)日：2021-06-08
申请号：US16392138
申请日：2019-04-23
Applicant: Snap Inc.
Inventor： Shah Tanmay Anilkumar , Samuel Edward Hare , Guohui Wang
Abstract: Systems and methods are provided for initiating transfer of image data corresponding to at least one predetermined level of an image pyramid comprising higher resolution to a graphic processing unit (GPU) of the computing device, calculating, by the central processing unit (CPU) of the computing device, optical flow of at least one predetermined coarse level of the image pyramid, transferring, by the CPU of the computing device, the calculated optical flow of the at least one predetermined coarse level of the image pyramid to the GPU, calculating, by the GPU of the computing device, the optical flow of the at least one predetermined level of the image pyramid comprising higher resolution, and outputting, by the GPU of the computing device, the optical flow of the image data.
-
公开(公告)号：US10713754B1
公开(公告)日：2020-07-14
申请号：US15908461
申请日：2018-02-28
Applicant: Snap Inc.
Inventor： Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号：US20240372963A1
公开(公告)日：2024-11-07
申请号：US18772971
申请日：2024-07-15
Applicant: Snap inc.
Inventor： Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Paliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: H04N7/14 , G06F18/214 , G06F18/24 , G06N3/04 , G06N3/08 , G06T7/11 , G06T7/194 , G06V10/82 , G06V30/19 , G06V30/242 , H04N5/445 , H04N5/76
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
Patent Agency Ranking
公开(公告)号：US11989938B2
公开(公告)日：2024-05-21
申请号：US18312479
申请日：2023-05-04
Applicant: Snap Inc.
Inventor： Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号：US20240062335A1
公开(公告)日：2024-02-22
申请号：US18499866
申请日：2023-11-01
Applicant: Snap Inc.
Inventor： Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
CPC classification number: G06T3/4046 , G06N3/08 , G06N3/04 , G06T1/20 , G06T11/60 , G06N3/063 , G06T2207/20081
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号：US11676381B2
公开(公告)日：2023-06-13
申请号：US17248393
申请日：2021-01-22
Applicant: Snap Inc.
Inventor： Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T1/20 , G06T7/248 , G06V20/46 , G06T2200/28 , G06T2207/10016 , G06T2207/20081
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号：US20220230277A1
公开(公告)日：2022-07-21
申请号：US17714764
申请日：2022-04-06
Applicant: Snap Inc.
Inventor： Guohui Wang , Sumant Milind Hanumante , Ning Xu , Yuncheng Li
Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
-
公开(公告)号：US11087513B1
公开(公告)日：2021-08-10
申请号：US16186164
申请日：2018-11-09
Applicant: Snap Inc.
Inventor： Kun Duan , Nan Hu , Linjie Luo , Chongyang Ma , Guohui Wang
Abstract: Systems and methods are provided for receiving an image from a camera of a mobile device, analyzing the image to determine a subject of the image, segmenting the subject of the image to generate a mask indicating an area of the image comprising the subject of the image, applying a bokeh effect to a background region of the image to generate a processed background region, generating an output image comprising the subject of the image and the processed background region, and causing the generated output image to display on a display of the mobile device.
-
-
-
-
-
-
-
-
-
Search Results
32
records
(took 0.033 seconds)
