公开(公告)号：US11763130B2

公开(公告)日：2023-09-19

申请号：US16949994

申请日：2020-11-23

Applicant: Snap Inc.

Inventor： Yingzhen Yang ,  Jianchao Yang ,  Ning Xu

IPC: G06K9/00 ,  G06N3/04 ,  G06T7/10 ,  G06T5/20

CPC classification number: G06N3/04 ,  G06T5/20 ,  G06T7/10

Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.

公开(公告)号：US11743426B2

公开(公告)日：2023-08-29

申请号：US16992968

申请日：2020-08-13

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06T7/194 ,  G06V10/82 ,  H04N7/14 ,  G06T7/11 ,  G06N3/08 ,  G06N3/04 ,  G06V30/242 ,  G06F18/214 ,  G06F18/24 ,  G06V30/19 ,  H04N5/445 ,  H04N5/76

CPC classification number: H04N7/147 ,  G06F18/214 ,  G06F18/24765 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19173 ,  G06V30/242 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2207/30201 ,  H04N5/44504 ,  H04N5/76 ,  H04N7/141

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can he assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented. using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US20230135808A1

公开(公告)日：2023-05-04

申请号：US18090654

申请日：2022-12-29

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04W4/021 ,  H04L12/18 ,  H04L51/52 ,  H04L67/52

Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that the new media collection is accessible and activating the new media collection for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further cause a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.

公开(公告)号：US11637797B2

公开(公告)日：2023-04-25

申请号：US17397354

申请日：2021-08-09

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F15/16 ,  H04L51/10 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08 ,  G06V20/00 ,  H04L51/52 ,  G06T7/00 ,  H04L67/01 ,  H04L67/55

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US11611846B2

公开(公告)日：2023-03-21

申请号：US17517888

申请日：2021-11-03

Applicant: Snap Inc.

Inventor： Nicholas Richard Allen ,  Sheldon Chang ,  Maria Pavlovskaia ,  Amer Shahnawaz ,  Jianchao Yang

IPC: H04L12/58 ,  H04W4/02 ,  H04L29/04 ,  H04W4/021 ,  H04L12/18 ,  H04L51/52 ,  H04L67/52

Abstract: Systems and methods are provided for receiving input increasing a default predetermined window of time that a new media collection is accessible, sending a request to a server computer for activation of the new media collection including the input, and receiving confirmation that the new media collection was activated for the increased predetermined window of time and a geographic boundary size for where media content originates. The systems and methods further provide for causing a plurality of content messages comprising media content originating in the geographical boundary size to be included in the new media collection and displayed in response to a request from a computing device to view the new media collection based on determining the request occurs within the increased predetermined window of time that the new media collection is accessible.

公开(公告)号：US20220172448A1

公开(公告)日：2022-06-02

申请号：US17651524

申请日：2022-02-17

Applicant: Snap Inc.

Inventor： Travis Chen ,  Samuel Edward Hare ,  Yuncheng Li ,  Tony Mathew ,  Jonathan Solichin ,  Jianchao Yang ,  Ning Zhang

IPC: G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  G06T7/73 ,  G06V10/20 ,  G06V20/20 ,  G06V20/40

Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.

公开(公告)号：US20220038402A1

公开(公告)日：2022-02-03

申请号：US17372981

申请日：2021-07-12

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: H04L12/58 ,  G06K9/00 ,  G06F16/22 ,  G06F16/51 ,  G06F16/583 ,  G06N20/00 ,  G06F16/9535 ,  G06F16/954 ,  G06F16/2457 ,  G06F16/951 ,  G06N3/04 ,  G06N3/08

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a plurality of content communications from a plurality of client devices, each content communication comprising an associated piece of content and a corresponding metadata. Each content communication is processed to determine associated context values for each piece of content, each associated context value comprising at least one content value generated by machine vision processing of the associated piece of content. A first content collection is automatically generated based on context values, and a set of user accounts are associated with the collection. An identifier associated with the first content collection is published to user devices associated with user accounts. In various additional embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US20220027405A1

公开(公告)日：2022-01-27

申请号：US17397354

申请日：2021-08-09

Applicant: Snap Inc.

Inventor： Jianchao Yang ,  Yuke Zhu ,  Ning Xu ,  Kevin Dechau Tang ,  Jia Li

IPC: G06F16/55 ,  G06T7/00 ,  G06K9/00 ,  H04L12/58 ,  G06F16/51

Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.

公开(公告)号：US10748347B1

公开(公告)日：2020-08-18

申请号：US16045431

申请日：2018-07-25

Applicant: Snap Inc.

Inventor： Jia Li ,  Linjie Luo ,  Rahul Bhupendra Sheth ,  Ning Xu ,  Jianchao Yang

IPC: G06T19/20 ,  G06T7/246 ,  G06T19/00 ,  H04L12/58

Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

公开(公告)号：US20200258313A1

公开(公告)日：2020-08-13

申请号：US15929374

申请日：2020-04-29

Applicant: Snap Inc.

Inventor： Travis Chen ,  Samuel Edward Hare ,  Yuncheng Li ,  Tony Mathew ,  Jonathan Solichin ,  Jianchao Yang ,  Ning Zhang

IPC: G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  G06T7/73 ,  G06K9/32 ,  G06K9/00

Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.