公开(公告)号：US20240087286A1

公开(公告)日：2024-03-14

申请号：US17939256

申请日：2022-09-07

Applicant: Snap Inc.

Inventor： Huseyin Coskun ,  Alireza Zareian ,  Joshua Moore ,  Chen Wang

IPC: G06V10/762 ,  G06T5/50 ,  G06V10/82

CPC classification number: G06V10/762 ,  G06T5/50 ,  G06V10/82 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20224

Abstract: Systems and methods are provided for clustering videos. The system accesses a plurality of content items, the plurality of content items comprising a first set of RGB video frames and a second set of optical flow frames corresponding to the first set of RGB video frames. The system processes the first set of RGB video frames by a first machine learning model to generate a first optimal assignment for the first set of RGB video frames, the first optimal assignment representing initial clustering of the first set of RGB video frames. The system generates an updated first optimal assignment for the first set of RGB video frames based on the first optimal assignment for the first set of RGB video frames and a second optimal assignment of the second set of optical flow frames, the second optimal assignment representing initial clustering of the second set of optical flow frames.