公开(公告)号：US10565743B1

公开(公告)日：2020-02-18

申请号：US15820090

申请日：2017-11-21

Applicant: Snap Inc.

Inventor： Chongyang Ma ,  Xing Mei ,  Nan Hu ,  Kirk Ouimet

IPC: G06T11/00 ,  G06T7/11 ,  H04L12/58 ,  G06T5/00 ,  G06T11/60 ,  G06T7/277

Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.

公开(公告)号：US10430987B1

公开(公告)日：2019-10-01

申请号：US15850989

申请日：2017-12-21

Applicant: Snap Inc.

Inventor： Nan Hu ,  Xing Mei ,  Chongyang Ma ,  Kun Duan

IPC: G06T11/40 ,  G09G5/377 ,  G06T11/60 ,  H04L12/58 ,  G06Q50/00 ,  G06T7/149

Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.

公开(公告)号：US11323634B2

公开(公告)日：2022-05-03

申请号：US16921289

申请日：2020-07-06

Applicant: Snap Inc.

Inventor： Chongyang Ma ,  Kun Duan ,  Xing Mei ,  Nan Hu

IPC: H04N5/262 ,  G06T7/11 ,  H04N1/60 ,  G06T5/20 ,  G06T13/80

Abstract: Disclosed are systems, methods, and computer-readable storage media to enhance an image on a mobile computing device. In some aspects, a user interface on the mobile computing device provides a plurality of image filters, each of the image filters associated with a different replacement sky type. Upon application of one of the plurality of image filters to an image, the mobile computing device is configured to identify a sky portion of the image, modify a color mapping of a non-sky portion of the image, and replace the sky portion of the image with replacement sky data corresponding to the applied image filter.

公开(公告)号：US20210097741A1

公开(公告)日：2021-04-01

申请号：US17118156

申请日：2020-12-10

Applicant: Snap Inc.

Inventor： Nan Hu ,  Xing Mei ,  Chongyang Ma ,  Kun Duan

IPC: G06T11/60 ,  H04L12/58 ,  G06Q50/00 ,  G06T7/149

Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.

公开(公告)号：US20200311426A1

公开(公告)日：2020-10-01

申请号：US16814221

申请日：2020-03-10

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Hao Hu ,  Yanjia Li ,  Xing Mei ,  Kevin Dechau Tang

IPC: G06K9/00 ,  G06T11/00 ,  G06F3/0488 ,  G06T7/60 ,  G06F16/51 ,  G06F16/538

Abstract: Method for receiving an input onto a graphical user interface at a client device, capturing an image frame at the client device, the image frame comprising a depiction of an object, identifying the object within the image frame, accessing media content associated with the object within a media repository in response to identifying the object, and causing presentation of the media content within the image frame at the client device.

公开(公告)号：US10789736B1

公开(公告)日：2020-09-29

申请号：US16738712

申请日：2020-01-09

Applicant: Snap Inc.

Inventor： Chongyang Ma ,  Xing Mei ,  Nan Hu ,  Kirk Ouimet

IPC: G06T11/00 ,  G06T7/11 ,  G06T11/60 ,  G06T5/00 ,  G06T7/277 ,  H04L12/58

Abstract: Disclosed are systems, methods, and computer-readable storage media to modify image content. One aspect includes identifying, by one or more electronic hardware processors, an image and content within the image, determining, by the one or more electronic hardware processors, a sky region of the image, determining, by the one or more electronic hardware processors, whether the content within the image is located within the sky region of the image, and in response to the content being within the sky region of the image, modifying, by the one or more electronic hardware processors, the content based on fractal Brownian motion.

公开(公告)号：US10672168B1

公开(公告)日：2020-06-02

申请号：US16529475

申请日：2019-08-01

Applicant: Snap Inc.

Inventor： Nan Hu ,  Xing Mei ,  Chongyang Ma ,  Kun Duan

IPC: G06T11/00 ,  G06T11/60 ,  G06Q50/00 ,  H04L12/58 ,  G06T7/149

Abstract: Various embodiments provide for systems, methods, and computer-readable storage media for annotating a digital image with a texture fill. An annotation system may receive a user input defining a border separating a first portion of a target digital image from a second portion of the target digital image. The annotation system may then generate a contour mask, such as a binary mask, for the target digital image based on the user-defined border. The annotation system may then apply a media overlay to the target image based on the contour mask. In particular, the contour mask can define portions of the target digital image such that the annotation system will apply a media overlay to at least one of those portions while not applying the media overlay to remaining portions of the target digital image.

公开(公告)号：US10296638B1

公开(公告)日：2019-05-21

申请号：US15839454

申请日：2017-12-12

Applicant: Snap Inc.

Inventor： Xin Chen ,  Jaewook Chung ,  Yu Hu ,  Jinhua Jiang ,  Xing Mei ,  Kirk Ouimet ,  Ning Xu

IPC: G06F17/30

Abstract: Systems and methods provide for capturing a plurality of segments of an audio stream and, for each segment of the plurality of segments of the audio stream: performing feature extraction on an audio signal of the segment using a feature extraction machine learning model that analyzes the audio signal to generate a feature vector for the segment and generating a prediction value for the segment for whether there is music in the segment using the extracted feature vector and a music detector machine learning model. The systems and methods further provide for generating a probability value that there is music in the audio stream based on the prediction value for each of the plurality of segments and causing the audio stream to be identified based on determining that the probability value that there is music in the audio stream meets a predetermined threshold.