公开(公告)号：US10285001B2

公开(公告)日：2019-05-07

申请号：US15054869

申请日：2016-02-26

Applicant: Snap, Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04L12/58 ,  H04W4/02 ,  H04L29/08 ,  H04W4/021 ,  H04L12/18

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending the request to a server computer for activation of the new media collection, receiving confirmation that the new media collection was activated, receiving a plurality of content messages associated with the new media collection, receiving from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US20240372963A1

公开(公告)日：2024-11-07

申请号：US18772971

申请日：2024-07-15

Applicant: Snap inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Paliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: H04N7/14 ,  G06F18/214 ,  G06F18/24 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19 ,  G06V30/242 ,  H04N5/445 ,  H04N5/76

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US11989938B2

公开(公告)日：2024-05-21

申请号：US18312479

申请日：2023-05-04

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang ,  Shah Tanmay Anilkumar

IPC: G06V20/40 ,  G06T1/20 ,  G06T7/246

CPC classification number: G06V20/40 ,  G06T1/20 ,  G06T7/248 ,  G06V20/46 ,  G06T2200/28 ,  G06T2207/10016 ,  G06T2207/20081

Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.

公开(公告)号：US11895068B2

公开(公告)日：2024-02-06

申请号：US17372981

申请日：2021-07-12

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L51/10 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08 ,  G06V20/00 ,  H04L51/52 ,  G06T7/00 ,  H04L67/01 ,  H04L67/55

CPC classification number: H04L51/10 ,  G06F16/22 ,  G06F16/24578 ,  G06F16/51 ,  G06F16/5854 ,  G06F16/951 ,  G06F16/954 ,  G06F16/9535 ,  G06N3/04 ,  G06N3/08 ,  G06N20/00 ,  G06V20/35 ,  H04L51/52 ,  G06T7/0002 ,  G06T2207/20084 ,  G06T2207/30168 ,  H04L67/01 ,  H04L67/55

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US11847528B2

公开(公告)日：2023-12-19

申请号：US18090577

申请日：2022-12-29

Applicant: Snap Inc.

Inventor： Linjie Yang ,  Jianchao Yang ,  Xuehan Xiong ,  Yanran Wang

IPC: G06T7/00 ,  G06N3/045 ,  G06N3/08 ,  G06T7/10 ,  G06F17/18 ,  H04L51/52

CPC classification number: G06N3/045 ,  G06F17/18 ,  G06N3/08 ,  G06T7/10 ,  H04L51/52

Abstract: A modulated segmentation system can use a modulator network to emphasize spatial prior data of an object to track the object across multiple images. The modulated segmentation system can use a segmentation network that receives spatial prior data as intermediate data that improves segmentation accuracy. The segmentation network can further receive visual guide information from a visual guide network to increase tracking accuracy via segmentation.

公开(公告)号：US11676381B2

公开(公告)日：2023-06-13

申请号：US17248393

申请日：2021-01-22

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang ,  Shah Tanmay Anilkumar

IPC: G06V20/40 ,  G06T7/246 ,  G06T1/20

CPC classification number: G06V20/40 ,  G06T1/20 ,  G06T7/248 ,  G06V20/46 ,  G06T2200/28 ,  G06T2207/10016 ,  G06T2207/20081

Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.

公开(公告)号：US11557324B2

公开(公告)日：2023-01-17

申请号：US17303817

申请日：2021-06-08

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: H04N21/218 ,  H04N21/2343 ,  H04N21/431 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/4728 ,  H04N21/63 ,  G11B27/10 ,  G11B27/031

Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

公开(公告)号：US20220172003A1

公开(公告)日：2022-06-02

申请号：US17547548

申请日：2021-12-10

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Ning Xu ,  Jian Ren

IPC: G06K9/62

Abstract: Disclosed herein are arrangements that facilitate the transfer of knowledge from models for a source data-processing domain to models for a target data-processing domain. A convolutional neural network space for a source domain is factored into a first classification space and a first reconstruction space. The first classification space stores class information and the first reconstruction space stores domain-specific information. A convolutional neural network space for a target domain is factored into a second classification space and a second reconstruction space. The second classification space stores class information and the second reconstruction space stores domain-specific information. Distribution of the first classification space and the second classification space is aligned.

公开(公告)号：US20220060848A1

公开(公告)日：2022-02-24

申请号：US17517888

申请日：2021-11-03

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/58 ,  H04L29/08 ,  H04L12/18

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending, by the first computing device, the request to a server computer for activation of the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US11159743B2

公开(公告)日：2021-10-26

申请号：US16722721

申请日：2019-12-20

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: H04N5/93 ,  H04N5/262 ,  G06K9/00 ,  G06K9/62

Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.