-
公开(公告)号:US12057136B2
公开(公告)日:2024-08-06
申请号:US18071865
申请日:2022-11-30
Applicant: Snap Inc.
CPC classification number: G10L25/30 , G06F18/24 , G06N3/045 , G06V10/764 , G06V10/82 , G06V20/00 , H04S7/40
Abstract: An acoustic environment identification system is disclosed that can use neural networks to accurately identify environments. The acoustic environment identification system can use one or more convolutional neural networks to generate audio feature data. A recursive neural network can process the audio feature data to generate characterization data. The characterization data can be modified using a weighting system that weights signature data items. Classification neural networks can be used to generate a classification of an environment.
-
公开(公告)号:US11727660B2
公开(公告)日:2023-08-15
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
CPC classification number: G06T19/20 , G06T7/248 , G06T19/006 , H04L51/52 , G06T2207/20104
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US11715223B2
公开(公告)日:2023-08-01
申请号:US17589459
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Kun Duan , Daniel Ron , Chongyang Ma , Ning Xu , Shenlong Wang , Sumant Milind Hanumante , Dhritiman Sagar
CPC classification number: G06T7/536 , G06T11/60 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084
Abstract: An active depth detection system can generate a depth map from an image and user interaction data, such as a pair of clicks. The active depth detection system can be implemented as a recurrent neural network that can receive the user interaction data as runtime inputs after training. The active depth detection system can store the generated depth map for further processing, such as image manipulation or real-world object detection.
-
公开(公告)号:US20230120887A1
公开(公告)日:2023-04-20
申请号:US18059928
申请日:2022-11-29
Applicant: Snap Inc.
Inventor: Jianfei Yu , Luis Carlos Dos Santos Marujo , Venkata Satya Pradeep Karuturi , Leonardo Ribas Machado das Neves , Ning Xu , William Brendel
Abstract: Sentiment classification can be implemented by an entity-level multimodal sentiment classification neural network. The neural network can include left, right, and target entity subnetworks. The neural network can further include an image network that generates representation data that is combined and weighted with data output by the left, right, and target entity subnetworks to output a sentiment classification for an entity included in a network post.
-
公开(公告)号:US20230053009A1
公开(公告)日:2023-02-16
申请号:US17972459
申请日:2022-10-24
Applicant: Snap Inc.
Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.
-
公开(公告)号:US20230034794A1
公开(公告)日:2023-02-02
申请号:US17878591
申请日:2022-08-01
Applicant: Snap Inc.
Inventor: Yuncheng Li , Zhou Ren , Ning Xu , Enxu Yan , Tan Yu
Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.
-
公开(公告)号:US20220358738A1
公开(公告)日:2022-11-10
申请号:US17722955
申请日:2022-04-18
Applicant: Snap Inc.
Inventor: Jia Li , Linjie Luo , Rahul Bhupendra Sheth , Ning Xu , Jianchao Yang
Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.
-
公开(公告)号:US11088977B1
公开(公告)日:2021-08-10
申请号:US16505694
申请日:2019-07-08
Applicant: Snap Inc.
Inventor: Jianchao Yang , Yuke Zhu , Ning Xu , Kevin Dechau Tang , Jia Li
Abstract: Systems, devices, methods, media, and instructions for automated image processing and content curation are described. In one embodiment a server computer system receives a content message from a first content source, and analyzes the content message to determine one or more quality scores and one or more content values associated with the content message. The server computer system analyzes the content message with a plurality of content collections of the database to identify a match between at least one of the one or more content values and a topic associated with at least a first content collection of the one or more content collections and automatically adds the content message to the first content collection based at least in part on the match. In various embodiments, different content values, image processing operations, and content selection operations are used to curate content collections.
-
公开(公告)号:US11081141B2
公开(公告)日:2021-08-03
申请号:US16743563
申请日:2020-01-15
Applicant: Snap Inc.
Inventor: Jia Li , Nathan Litke , Jose Jesus (Joseph) Paredes , Rahul Bhupendra Sheth , Daniel Szeto , Ning Xu , Jianchao Yang
IPC: H04N21/218 , H04N21/2343 , H04N21/431 , H04N21/44 , H04N21/4402 , H04N21/4728 , H04N21/63 , G11B27/10 , G11B27/031
Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.
-
公开(公告)号:US20210073613A1
公开(公告)日:2021-03-11
申请号:US16949994
申请日:2020-11-23
Applicant: Snap Inc.
Inventor: Yingzhen Yang , Jianchao Yang , Ning Xu
Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.
-
-
-
-
-
-
-
-
-