公开(公告)号：US10726059B1

公开(公告)日：2020-07-28

申请号：US16448900

申请日：2019-06-21

Applicant: Snap Inc.

Inventor： Zhou Ren ,  Xiaoyu Wang ,  Ning Zhang ,  Xutao Lv ,  Jia Li

IPC: G06K9/00 ,  G06F16/338 ,  G06F16/33 ,  G06K9/72 ,  G06K9/46 ,  G06K9/66 ,  G06N5/02

Abstract: An image captioning system and method is provided for generating a caption for an image. The image captioning system utilizes a policy network and a value network to generate the caption. The policy network serves as a local guidance and the value network serves as a global and lookahead guidance.

公开(公告)号：US10382373B1

公开(公告)日：2019-08-13

申请号：US15253492

申请日：2016-08-31

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F15/16 ,  H04L12/58 ,  G06K9/00 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06T7/00

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US10366543B1

公开(公告)日：2019-07-30

申请号：US16136849

申请日：2018-09-20

Applicant: Snap Inc.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T19/00 ,  G06K9/00 ,  G06T7/73 ,  G06F3/0481 ,  G06F3/01 ,  G06T7/246 ,  G06T19/20 ,  G06T13/80 ,  G06K9/78 ,  G06T7/20

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

公开(公告)号：US10198671B1

公开(公告)日：2019-02-05

申请号：US15348501

申请日：2016-11-10

Applicant: SNAP INC.

Inventor： Linjie Yang ,  Kevin Dechau Tang ,  Jianchao Yang ,  Jia Li

IPC: G06K9/62 ,  G06T11/60 ,  G06T7/00

Abstract: A dense captioning system and method is provided for processing an image to produce a feature map of the image, analyzing the feature map to generate proposed bounding boxes for a plurality of visual concepts within the image, analyzing the feature map to determine a plurality of region features of the image, and analyzing the feature map to determine a context feature for the image. For each region feature of the plurality of region features of the image, the dense captioning system further provides for analyzing the region feature to determine a detection score for the region feature, calculating a caption for a bounding box for a visual concept in the image using the region feature and the context feature, and localizing the visual concept by adjusting the bounding box around the visual concept based on the caption to generate an adjusted bounding box for the visual concept.

公开(公告)号：US09836890B2

公开(公告)日：2017-12-05

申请号：US15591887

申请日：2017-05-10

Applicant: SNAP INC.

Inventor： Nathan Jurgenson ,  Linjie Luo ,  Jonathan M Rodriguez, II ,  Rahul Sheth ,  Jia Li ,  Xutao Lv

IPC: G06T19/00 ,  G06T7/73 ,  G06F3/01 ,  G06K9/00 ,  G06K9/78 ,  G06T7/246 ,  G06T19/20 ,  G06T13/80 ,  G06T7/20 ,  G06F3/0481

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/04815 ,  G06K9/00624 ,  G06K9/00664 ,  G06K9/00671 ,  G06K9/78 ,  G06K2209/21 ,  G06T7/20 ,  G06T7/246 ,  G06T7/73 ,  G06T13/80 ,  G06T19/20 ,  G06T2200/04 ,  G06T2207/30244 ,  G06T2219/2004

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.