-
公开(公告)号:US12159215B2
公开(公告)日:2024-12-03
申请号:US18489730
申请日:2023-10-18
Applicant: Snap Inc.
Inventor: Linjie Yang , Jianchao Yang , Xuehan Xiong , Yanran Wang
Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.
-
公开(公告)号:US20230362331A1
公开(公告)日:2023-11-09
申请号:US18221702
申请日:2023-07-13
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: H04N7/14 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06V30/242 , G06V10/82 , G06F18/214 , G06F18/24 , G06V30/19
CPC classification number: H04N7/147 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06V30/242 , G06V10/82 , G06F18/214 , G06F18/24765 , G06V30/19173 , H04N7/141 , G06T2207/10024 , G06T2207/10016 , G06T2207/20024 , G06T2207/20221 , G06T2207/30201 , G06T2207/20081 , G06T2207/20084 , H04N5/44504
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US20230274543A1
公开(公告)日:2023-08-31
申请号:US18312479
申请日:2023-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
CPC classification number: G06V20/40 , G06T7/248 , G06V20/46 , G06T1/20 , G06T2207/20081 , G06T2200/28 , G06T2207/10016
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20230063920A1
公开(公告)日:2023-03-02
申请号:US18049098
申请日:2022-10-24
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
IPC: H04L51/10 , G06F16/22 , G06F16/51 , G06F16/583 , G06N20/00 , G06F16/9535 , G06F16/954 , G06F16/2457 , G06F16/951 , G06N3/04 , G06N3/08 , G06V20/00 , H04L51/52
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.
-
公开(公告)号:US11527267B2
公开(公告)日:2022-12-13
申请号:US17303817
申请日:2021-06-08
Applicant: Snap Inc.
Inventor: Jia Li , Nathan Litke , Jose Jesus (Joseph) Paredes , Rahul Bhupendra Sheth , Daniel Szeto , Ning Xu , Jianchao Yang
IPC: H04N21/218 , H04N21/2343 , H04N21/431 , H04N21/44 , H04N21/4402 , H04N21/4728 , H04N21/63 , G11B27/10 , G11B27/031
Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.
-
公开(公告)号:US11200459B1
公开(公告)日:2021-12-14
申请号:US16156882
申请日:2018-10-10
Applicant: Snap Inc.
Inventor: Jianchao Yang , Ning Xu , Jian Ren
Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.
-
公开(公告)号:US11197123B2
公开(公告)日:2021-12-07
申请号:US17034663
申请日:2020-09-28
Applicant: Snap Inc.
Inventor: Nicholas Richard Allen , Sheldon Chang , Maria Pavlovskaia , Amer Shahnawaz , Jianchao Yang
Abstract: Systems and methods are provided for receiving, at a first computing device, a user-provided request to activate a new media collection, sending, by the first computing device, the request to a server computer to activate the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, a user-provided selection of the plurality of content messages for inclusion in the new media collection, sending, to the server computer, an indication of the selection of the content messages for inclusion in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed responsive to a request from at least a second computing device to view the new media collection.
-
公开(公告)号:US11023514B2
公开(公告)日:2021-06-01
申请号:US15054827
申请日:2016-02-26
Applicant: Snap, Inc.
Inventor: Nicholas Richard Allen , Sheldon Chang , Maria Pavlovskaia , Amer Shahnawaz , Jianchao Yang
IPC: G06F16/435 , G06F16/438 , G06F16/2457
Abstract: Systems and methods are provided for receiving, at a server computer, a plurality of content messages from a plurality of content sources, each content message comprising media content and associated with a predetermined media collection, for each of the plurality of content messages received, analyzing each of the plurality of content messages to determine a quality score for each of the plurality of content messages, and storing each of the plurality of content messages in a database along with the quality score for each of the plurality of content messages. The systems and methods further provided for receiving, from an operator device, a threshold percentage for the media collection, determining a subset of the plurality of content messages associated with the media collection to be made available to the operator device based on the threshold percentage received from the operator device and the quality score for each of the plurality of content messages, and causing only the subset of the plurality of content messages associated with media collection to be displayed on the operator device for the media collection.
-
公开(公告)号:US10929673B2
公开(公告)日:2021-02-23
申请号:US16654898
申请日:2019-10-16
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20210027100A1
公开(公告)日:2021-01-28
申请号:US16992968
申请日:2020-08-13
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
-
-
-
-
-
-
-
-