公开(公告)号：US20240355063A1

公开(公告)日：2024-10-24

申请号：US18304078

申请日：2023-04-20

Applicant: Snap Inc.

Inventor： Zhenpeng Zhou ,  Patrick Poirson ,  Maksim Gusarov ,  Chen Wang ,  Oleg Tovstyi

IPC: G06T19/00 ,  G06T1/00 ,  G06V10/74 ,  H04N5/262

CPC classification number: G06T19/006 ,  G06T1/0021 ,  G06V10/761 ,  H04N5/2621

Abstract: An input video item that includes a target visual augmentation is accessed. A machine learning model uses the input video item to generate an embedding. The embedding may comprise a vector representation of a visual effect of the target visual augmentation. The machine learning model is trained, in an unsupervised training phase, to minimize loss between training video representations generated within each of a plurality of training sets. Each training set comprises a plurality of different training video items that each include a predefined visual augmentation. Based on the generation of the embedding of the input video item, the target visual augmentation is mapped to an augmentation identifier.

公开(公告)号：US20240087286A1

公开(公告)日：2024-03-14

申请号：US17939256

申请日：2022-09-07

Applicant: Snap Inc.

Inventor： Huseyin Coskun ,  Alireza Zareian ,  Joshua Moore ,  Chen Wang

IPC: G06V10/762 ,  G06T5/50 ,  G06V10/82

CPC classification number: G06V10/762 ,  G06T5/50 ,  G06V10/82 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20224

Abstract: Systems and methods are provided for clustering videos. The system accesses a plurality of content items, the plurality of content items comprising a first set of RGB video frames and a second set of optical flow frames corresponding to the first set of RGB video frames. The system processes the first set of RGB video frames by a first machine learning model to generate a first optimal assignment for the first set of RGB video frames, the first optimal assignment representing initial clustering of the first set of RGB video frames. The system generates an updated first optimal assignment for the first set of RGB video frames based on the first optimal assignment for the first set of RGB video frames and a second optimal assignment of the second set of optical flow frames, the second optimal assignment representing initial clustering of the second set of optical flow frames.