公开(公告)号：US11100326B1

公开(公告)日：2021-08-24

申请号：US16653561

申请日：2019-10-15

Applicant: Snap Inc.

Inventor： Kirk Ouimet ,  Yunchao Gong

IPC: G06K9/00 ,  G06K9/64 ,  G06T11/60 ,  G06T7/55 ,  H04L12/58

Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.

公开(公告)号：US20210019575A1

公开(公告)日：2021-01-21

申请号：US15929483

申请日：2020-05-05

Applicant: Snap Inc.

Inventor： Kirk Ouimet ,  Rong Yan ,  Yantao Zheng

IPC: G06K9/62 ,  G06T1/00 ,  G06N3/08 ,  G06F16/58 ,  G06N3/04 ,  G06F16/9038 ,  H04N5/232

Abstract: Systems, methods, devices, server computers, storage media, and instructions for prioritized device action triggered by device scan data are described. In one embodiment, a mobile device performs a method that involves executing a messaging application with an image capture interface and a scanning input. An associated scanning mode comprises capture of scan data from a plurality of input/output modules of the first client device, analyzes the scan data to identify one or more scan data patterns by matching at least a portion of the scan data against a set of data patterns, and selects a priority system action based on the results of the matching of the portion of the scan data against the set of data patterns. In some embodiments, the priority system action is selected based on a priority ranking for identified scan data types.

公开(公告)号：US10803120B1

公开(公告)日：2020-10-13

申请号：US15610290

申请日：2017-05-31

Applicant: Snap Inc.

Inventor： Yu Hu ,  Caleb Ogden ,  Kirk Ouimet ,  Ike Z. Adler

IPC: G06F16/00 ,  G06F16/68 ,  G06F16/638 ,  G06F16/9537 ,  H04L29/08

Abstract: A messaging server system receives audio data packages from a plurality of client devices. Each audio data package includes audio content captured by a respective client device from the plurality of client devices, and location data describing a location of the respective client device when the audio content was captured. The messaging server system identifies, based on the location data included in the audio data packages, a subset of the audio data packages that include audio content captured within a predetermined geographic area. The messaging server system generates, based on the subset of the audio data packages, a playlist of audio content items for the predetermined geographic area, and provides the playlist of audio content items to at least a first client device.

公开(公告)号：US10789736B1

公开(公告)日：2020-09-29

申请号：US16738712

申请日：2020-01-09

Applicant: Snap Inc.

Inventor： Chongyang Ma ,  Xing Mei ,  Nan Hu ,  Kirk Ouimet

IPC: G06T11/00 ,  G06T7/11 ,  G06T11/60 ,  G06T5/00 ,  G06T7/277 ,  H04L12/58

Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.

公开(公告)号：US20200285923A1

公开(公告)日：2020-09-10

申请号：US16881670

申请日：2020-05-22

Applicant: Snap Inc.

Inventor： Evan Spiegel ,  Kirk Ouimet

IPC: G06K19/06 ,  G06T7/33

Abstract: Systems and methods for using facial patterns for information access via optical harcodes are provided. In example embodiments, a computer accesses an image. The computer determines, using facial recognition, that the accessed image includes a face. The computer determines, using the face, an orientation of the image. The computer decodes, based on the determined orientation of the image, data encoded within the geometric shape. The computer may then access a resource based on the decoded data. In some aspects, a graphical output may be presented on a display device indicating the accessed resource.

公开(公告)号：US20200236076A1

公开(公告)日：2020-07-23

申请号：US16838868

申请日：2020-04-02

Applicant: Snap Inc.

Inventor： Manny Jerrold Adler ,  Jonathan Brody ,  Nathan Kenneth Boyd ,  Glenne Christiaansen ,  Kirk Ouimet ,  Kameron Sheffield ,  Haibo Zhao ,  Zhuangtian Zhao

IPC: H04L12/58

Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.

公开(公告)号：US10380394B1

公开(公告)日：2019-08-13

申请号：US15893165

申请日：2018-02-09

Applicant: Snap Inc.

Inventor： Nathan Kenneth Boyd ,  Christopher Jonathan Luc ,  Kirk Ouimet ,  Rahul Bhupendra Sheth

IPC: G06K7/14 ,  G06K19/06 ,  H04L12/58 ,  H04L29/08 ,  H04L29/06 ,  G06T11/60 ,  G06F3/0484 ,  G06F16/58

Abstract: Systems and methods for presenting an augmented reality within a custom graphic are provided. In example embodiments, one or more hardware processors may receive an image, identify candidate shape features in the image, identify a custom graphic by comparing the candidate shape features with a reference shape feature of the custom graphic, identify an optical barcode based on the identified custom graphic, identify an augmented reality based on the optical barcode, and transmit the augmented reality to the client device.

公开(公告)号：US10296638B1

公开(公告)日：2019-05-21

申请号：US15839454

申请日：2017-12-12

Applicant: Snap Inc.

Inventor： Xin Chen ,  Jaewook Chung ,  Yu Hu ,  Jinhua Jiang ,  Xing Mei ,  Kirk Ouimet ,  Ning Xu

IPC: G06F17/30

Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.

公开(公告)号：US10262250B1

公开(公告)日：2019-04-16

申请号：US15886597

申请日：2018-02-01

Applicant: Snap Inc.

Inventor： Evan Spiegel ,  Kirk Ouimet

IPC: G06K9/00 ,  G06K19/06 ,  G06T7/33

Abstract: Systems and methods for using facial patterns for information access via optical barcodes are provided. In example embodiments, a computer accesses an image. The computer determines, using facial recognition, that the accessed image includes a face. The computer determines, using the face, an orientation of the image. The computer decodes, based on the determined orientation of the image, data encoded within the geometric shape. The computer may then access a resource based on the decoded data. In some aspects, a graphical output may be presented on a display device indicating the accessed resource.

公开(公告)号：US09922226B1

公开(公告)日：2018-03-20

申请号：US15262942

申请日：2016-09-12

Applicant: SNAP INC.

Inventor： Nathan Kenneth Boyd ,  Christopher Jonathan Luc ,  Kirk Ouimet ,  Rahul Bhupendra Sheth

IPC: G06K7/10 ,  G06K7/14 ,  G06K19/06 ,  G06F17/30 ,  G06F3/0484 ,  G06T11/60 ,  H04L29/06 ,  H04L29/08 ,  H04L12/58

CPC classification number: G06K7/1456 ,  G06F3/04842 ,  G06F17/30268 ,  G06F17/30879 ,  G06K7/1417 ,  G06K7/1443 ,  G06K7/1447 ,  G06K19/06037 ,  G06K19/06103 ,  G06K19/06112 ,  G06T11/60 ,  H04L51/04 ,  H04L51/32 ,  H04L67/306 ,  H04W4/80

Abstract: Systems and methods for presenting an augmented reality within a custom graphic are provided. In example embodiments, a server receives a scanned image from a client device, the scanned image including a custom graphic and an optical barcode. The server identifies an augmented reality and a user interface item based on the optical barcode. The server transmits the augmented reality to the client device for display, at the client device, within a custom graphic of the scanned image. The server receives an indication that the scanned image was selected at the client device. The server transmits, to the client device, the user interface item for display at the client device.