Data retrieval using reinforced co-learning for semi-supervised ranking

    公开(公告)号:US11544553B1

    公开(公告)日:2023-01-03

    申请号:US16448749

    申请日:2019-06-21

    Applicant: Snap Inc.

    Abstract: A computer-implement method comprises: training a classifier with labeled data from a dataset; classifying, by the trained classifier, unlabeled data from the dataset; providing, by the classifier to a policy gradient, a reward signal for each data/query pair; transferring, by the classifier to a ranker, learning; training, by the policy gradient, the ranker; ranking data from the dataset based on a query; and retrieving data from the ranked data in response to the query.

    Sequence-of-sequences model for 3D object recognition

    公开(公告)号:US11410439B2

    公开(公告)日:2022-08-09

    申请号:US16870138

    申请日:2020-05-08

    Applicant: Snap Inc.

    Abstract: Systems and methods are disclosed for capturing multiple sequences of views of a three-dimensional object using a plurality of virtual cameras. The systems and methods generate aligned sequences from the multiple sequences based on an arrangement of the plurality of virtual cameras in relation to the three-dimensional object. Using a convolutional network, the systems and methods classify the three-dimensional object based on the aligned sequences and identify the three-dimensional object using the classification.

    Local augmented reality persistent sticker objects

    公开(公告)号:US11308706B2

    公开(公告)日:2022-04-19

    申请号:US16927273

    申请日:2020-07-13

    Applicant: Snap Inc.

    Abstract: Systems and methods for local augmented reality (AR) tracking of an AR object are disclosed. In one example embodiment a device captures a series of video image frames. A user input is received at the device associating a first portion of a first image of the video image frames with an AR sticker object and a target. A first target template is generated to track the target across frames of the video image frames. In some embodiments, global tracking based on a determination that the target is outside a boundary area is used. The global tracking comprises using a global tracking template for tracking movement in the video image frames captured following the determination that the target is outside the boundary area. When the global tracking determines that the target is within the boundary area, local tracking is resumed along with presentation of the AR sticker object on an output display of the device.

    SEGMENT ACTION DETECTION
    25.
    发明申请

    公开(公告)号:US20210407548A1

    公开(公告)日:2021-12-30

    申请号:US17465001

    申请日:2021-09-02

    Applicant: Snap Inc.

    Abstract: Aspects of the present disclosure involve a system comprising a storage medium storing a program and method for receiving a video comprising a plurality of video segments; selecting a target action sequence that includes a sequence of action phases; receiving features of each of the video segments; computing, based on the received features, for each of the plurality of video segments, a plurality of action phase confidence scores indicating a likelihood that a given video segment includes a given action phase of the sequence of action phases; identifying a set of consecutive video segments of the plurality of video segments that corresponds to the target action sequence, wherein video segments in the set of consecutive video segments are arranged according to the sequence of action phases; and generating a display of the video that includes the set of consecutive video segments and skips other video segments in the video.

    PROCESSING AND FORMATTING VIDEO FOR INTERACTIVE PRESENTATION

    公开(公告)号:US20210295874A1

    公开(公告)日:2021-09-23

    申请号:US17303817

    申请日:2021-06-08

    Applicant: Snap Inc.

    Abstract: Systems and methods are described for determining a first media item related to an event, of a plurality of stored media items each comprising video content related to the event, that was captured in a device orientation corresponding to a first device orientation detected for the first computing device; providing, to the first computing device, the first media item to be displayed on the first computing device; in response to a detected change to a second device orientation for the first computing device, determining a second media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and providing, to the first computing device, the second media item to be displayed on the first computing device.

    Processing and formatting video for interactive presentation

    公开(公告)号:US11122218B2

    公开(公告)日:2021-09-14

    申请号:US16722721

    申请日:2019-12-20

    Applicant: Snap Inc.

    Abstract: Systems and methods are described for determining that the user interaction with a display of a computing device during display of a video comprising a sequence of frames indicates a region of interest in a current frame of the sequence of frames of the displayed video. For each frame of the sequence of frames after the current frame, the frame is cropped to generate a cropped frame comprising a portion of the frame including the region of interest in the frame, the cropped frame is enlarged based on a display size corresponding to an angle or orientation of the computing device during display of the video, and the enlarged cropped frame replaces the frame such that the enlarged cropped frame is displayed in the sequence of frames of the video on the display of the computing device instead of the frame.

    Systems and methods for content tagging

    公开(公告)号:US10157333B1

    公开(公告)日:2018-12-18

    申请号:US15247697

    申请日:2016-08-25

    Applicant: Snap Inc.

    Abstract: Systems, methods, devices, media, and computer readable instructions are described for local image tagging in a resource constrained environment. One embodiment involves processing image data using a deep convolutional neural network (DCNN) comprising at least a first subgraph and a second subgraph, the first subgraph comprising at least a first layer and a second layer, processing, the image data using at least the first layer of the first subgraph to generate first intermediate output data; processing, by the mobile device, the first intermediate output data using at least the second layer of the first subgraph to generate first subgraph output data, and in response to a determination that each layer reliant on the first intermediate data have completed processing, deleting the first intermediate data from the mobile device. Additional embodiments involve convolving entire pixel resolutions of the image data against kernels in different layers if the DCNN.

    Compact neural networks using condensed filters

    公开(公告)号:US12136026B2

    公开(公告)日:2024-11-05

    申请号:US18222649

    申请日:2023-07-17

    Applicant: Snap Inc.

    Abstract: A compact neural network system can generate multiple individual filters from a compound filter. Each convolutional layer of a convolutional neural network can include a compound filters used to generate individual filters for that layer. The individual filters overlap in the compound filter and can be extracted using a sampling operation. The extracted individual filters can share weights with nearby filters thereby reducing the overall size of the convolutional neural network.

Patent Agency Ranking