EMBEDDINGS REPRESENTING VISUAL AUGMENTATIONS

    公开(公告)号:US20240355063A1

    公开(公告)日:2024-10-24

    申请号:US18304078

    申请日:2023-04-20

    申请人: Snap Inc.

    摘要: An input video item that includes a target visual augmentation is accessed. A machine learning model uses the input video item to generate an embedding. The embedding may comprise a vector representation of a visual effect of the target visual augmentation. The machine learning model is trained, in an unsupervised training phase, to minimize loss between training video representations generated within each of a plurality of training sets. Each training set comprises a plurality of different training video items that each include a predefined visual augmentation. Based on the generation of the embedding of the input video item, the target visual augmentation is mapped to an augmentation identifier.

    RECOMMENDING CONTENT USING MULTIMODAL MEMORY EMBEDDINGS

    公开(公告)号:US20240354641A1

    公开(公告)日:2024-10-24

    申请号:US18613645

    申请日:2024-03-22

    申请人: Snap Inc.

    IPC分类号: G06N20/00

    CPC分类号: G06N20/00

    摘要: Described is a system for gathering interaction data from use of one or more interaction functions by a first user, wherein the interaction data includes data in different modalities and generating a multimodal memory for the interaction data by applying the interaction data to a first machine learning model. The system also identifies a prompt for the first user and processes a combination of data associated with the prompt and the multimodal memory using a second machine learning model to generate recommended content for the first user. The system then proceeds to apply the recommended content to a first interaction client of the first user.