公开(公告)号：US20220027405A1

公开(公告)日：2022-01-27

申请号：US17397354

申请日：2021-08-09

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F16/55 ,  G06T7/00 ,  G06K9/00 ,  H04L12/58 ,  G06F16/51

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US10748347B1

公开(公告)日：2020-08-18

申请号：US16045431

申请日：2018-07-25

Applicant: Snap Inc.

Inventor： Jia Li ,  Linjie Luo ,  Rahul Bhupendra Sheth ,  Ning Xu ,  Jianchao Yang

IPC: G06T19/20 ,  G06T7/246 ,  G06T19/00 ,  H04L12/58

Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

公开(公告)号：US10733255B1

公开(公告)日：2020-08-04

申请号：US15251976

申请日：2016-08-30

Applicant: Snap, Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F17/00 ,  G06F16/954 ,  G06N3/08 ,  G06N3/04 ,  G06F16/51 ,  G06F16/951 ,  G06F16/2457 ,  H04L29/06 ,  H04L12/58

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.

公开(公告)号：US10387514B1

公开(公告)日：2019-08-20

申请号：US15251983

申请日：2016-08-30

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06N20/00 ,  H04L12/58 ,  H04L29/06 ,  H04L29/08 ,  G06F16/954 ,  G06F16/9535

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US20190236450A1

公开(公告)日：2019-08-01

申请号：US16230909

申请日：2018-12-21

Applicant: Snap Inc.

Inventor： Yanen Li ,  Kuan Liu ,  Ning Xu

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/08 ,  G06N3/04

Abstract: Multimodal data sets of a given entity (e.g., a user) can be processed using a plurality of different machine learning schemes, such as a recurrent neural network and a fully connected neural network. Representations generated by the networks can be combined in an additive layer and further in a multiplicative layer that emphasizes informative modalities and tolerates less informative modalities.

公开(公告)号：US12174921B2

公开(公告)日：2024-12-24

申请号：US18244543

申请日：2023-09-11

Applicant: Snap Inc.

Inventor： Jianfei Yu ,  Luis Carlos Dos Santos Marujo ,  Venkata Satya Pradeep Karuturi ,  Leonardo Ribas Machado das Neves ,  Ning Xu ,  William Brendel

IPC: G06F40/30 ,  G06F18/2431 ,  G06F40/284 ,  G06N3/045 ,  G06N3/08 ,  G06N20/20 ,  G06F40/279 ,  G06F40/289 ,  G06F40/295 ,  G10L15/06 ,  G10L15/16 ,  G10L15/18 ,  G10L25/30

Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.

公开(公告)号：US12033078B2

公开(公告)日：2024-07-09

申请号：US18230499

申请日：2023-08-04

Applicant: Snap Inc.

Inventor： Yuncheng Li ,  Zhou Ren ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G06N3/08 ,  G06F18/214 ,  G06F18/2431 ,  G06T7/33 ,  G06T7/55 ,  G06V10/44 ,  G06V10/82 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64

CPC classification number: G06N3/08 ,  G06F18/214 ,  G06F18/2431 ,  G06T7/344 ,  G06T7/55 ,  G06V10/454 ,  G06V10/82 ,  G06V20/20 ,  G06V20/41 ,  G06V20/64

Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.

公开(公告)号：US11893489B2

公开(公告)日：2024-02-06

申请号：US17972459

申请日：2022-10-24

Applicant: Snap Inc.

Inventor： Shibi He ,  Yanen Li ,  Ning Xu

IPC: G06F18/24 ,  G06F18/20 ,  G06N3/08 ,  G06N3/045

CPC classification number: G06N3/08 ,  G06F18/24 ,  G06F18/295 ,  G06N3/045

Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.

公开(公告)号：US11704893B2

公开(公告)日：2023-07-18

申请号：US17465001

申请日：2021-09-02

Applicant: Snap Inc.

Inventor： Zhou Ren ,  Yuncheng Li ,  Ning Xu ,  Enxu Yan ,  Tan Yu

IPC: G06V10/54 ,  G06V10/44 ,  G11B27/10 ,  H04N9/87 ,  G06V20/40 ,  G06V10/764 ,  G06V10/82

CPC classification number: G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/41 ,  G06V20/46 ,  G11B27/102 ,  H04N9/87

Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.

公开(公告)号：US20230063920A1

公开(公告)日：2023-03-02

申请号：US18049098

申请日：2022-10-24

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L51/10 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08 ,  G06V20/00 ,  H04L51/52

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system communicates at least a portion of a first content collection to a first client device, and receives a first selection communication in response, the first selection communication identifying a first piece of content of the first plurality of pieces of content. The server analyzes analyzing the first piece of content to identify a set of context values for the first piece of content, and accesses accessing a second content collection comprising pieces of content sharing at least a portion of the set of context values of the first piece of content. In various embodiments, different content values, image processing operations, and content selection operations are used to curate the content collections.