公开(公告)号：US20220358738A1

公开(公告)日：2022-11-10

申请号：US17722955

申请日：2022-04-18

Applicant: Snap Inc.

Inventor： Jia Li ,  Linjie Luo ,  Rahul Bhupendra Sheth ,  Ning Xu ,  Jianchao Yang

IPC: G06T19/20 ,  G06T7/246 ,  H04L51/52 ,  G06T19/00

Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

公开(公告)号：US11088977B1

公开(公告)日：2021-08-10

申请号：US16505694

申请日：2019-07-08

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F15/16 ,  H04L12/58 ,  G06K9/00 ,  G06F16/51 ,  G06F16/22 ,  G06F16/583 ,  G06T7/00

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US11081141B2

公开(公告)日：2021-08-03

申请号：US16743563

申请日：2020-01-15

Applicant: Snap Inc.

Inventor： Jia Li ,  Nathan Litke ,  Jose Jesus (Joseph) Paredes ,  Rahul Bhupendra Sheth ,  Daniel Szeto ,  Ning Xu ,  Jianchao Yang

IPC: H04N21/218 ,  H04N21/2343 ,  H04N21/431 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/4728 ,  H04N21/63 ,  G11B27/10 ,  G11B27/031

Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

公开(公告)号：US20210216776A1

公开(公告)日：2021-07-15

申请号：US17248393

申请日：2021-01-22

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang ,  Shah Tanmay Anilkumar

IPC: G06K9/00 ,  G06T7/246 ,  G06T1/20

Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.

公开(公告)号：US20210191966A1

公开(公告)日：2021-06-24

申请号：US17249509

申请日：2021-03-03

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: G06F16/435 ,  G06F16/438 ,  G06F16/2457

Abstract: Systems and methods are provided for receiving, at a server computer, a plurality of content messages from a plurality of content sources, each content message comprising media content and associated with a predetermined media collection, for each of the plurality of content messages received, analyzing each of the plurality of content messages to determine a quality score for each of the plurality of content messages, and storing each of the plurality of content messages in a database along with the quality score for each of the plurality of content messages. The systems and methods further provided for receiving, from an operator device, a threshold percentage for the media collection, determining a subset of the plurality of content messages associated with the media collection to be made available to the operator device based on the threshold percentage received from the operator device and the quality score for each of the plurality of content messages, and causing only the subset of the plurality of content messages associated with media collection to be displayed on the operator device for the media collection.

公开(公告)号：US20210073613A1

公开(公告)日：2021-03-11

申请号：US16949994

申请日：2020-11-23

Applicant: Snap Inc.

Inventor： Yingzhen Yang ,  Jianchao Yang ,  Ning Xu

IPC: G06N3/04 ,  G06T5/20 ,  G06T7/10

Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.

公开(公告)号：US20210021551A1

公开(公告)日：2021-01-21

申请号：US16918343

申请日：2020-07-01

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L12/58 ,  G06K9/00 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.

公开(公告)号：US20210014636A1

公开(公告)日：2021-01-14

申请号：US17034663

申请日：2020-09-28

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/58 ,  H04L29/08 ,  H04L12/18

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending, by the first computing device, the request to a server computer for activation of the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US20190268716A1

公开(公告)日：2019-08-29

申请号：US16293300

申请日：2019-03-05

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/18 ,  H04L12/58 ,  H04L29/08

Abstract: Systems and methods are provided for receiving, at a first computing device, a request from a user to activate a new media collection, sending, by the first computing device, the request to a server computer for activation of the new media collection, receiving, by the first computing device, confirmation that the new media collection was activated, receiving, at the first computing device, a plurality of content messages associated with the new media collection, receiving, at the first computing device, from the user, a selection of the plurality of content messages to be included in the new media collection, sending, to the server computer, an indication of the selection of the content messages to be included in the new media collection, wherein the server computer causes the selection of content messages to be included in the new media collection and displayed in response to a request from at least a second computing device to view the new media collection.

公开(公告)号：US10346723B2

公开(公告)日：2019-07-09

申请号：US15340675

申请日：2016-11-01

Applicant: SNAP INC.

Inventor： Wei Han ,  Jianchao Yang ,  Ning Zhang ,  Jia Li

IPC: G06K9/62 ,  G06K9/66 ,  G06K9/46 ,  G06K9/52 ,  G06T3/40 ,  G06N3/04 ,  G06N3/08

Abstract: Systems, devices, media, and methods are presented for identifying and categorically labeling objects within a set of images. The systems and methods receive an image depicting an object of interest, detect at least a portion of the object of interest within the image using a multilayer object model, determine context information, and identify the object of interest included in two or more bounding boxes.