公开(公告)号：US12254049B2

公开(公告)日：2025-03-18

申请号：US18054420

申请日：2022-11-10

Applicant: Snap Inc.

Inventor： Kevin Sarabia Dela Rosa ,  Adel Elmalaha ,  Kwot Sin Lee ,  Patrick Poirson

IPC: G06F16/83 ,  G06F16/903 ,  G06F16/9035 ,  G06F16/907 ,  G06T19/00 ,  G06V10/74

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving an image from a client device; applying a machine learning model to the image to generate an embedding query vector, the machine learning model being trained to encode a plurality of images and text into a common embedding space; searching, based on the embedding query vector, a database of augmented reality (AR) experiences to identify a subset of AR experiences associated with one or more embeddings that correspond to the embedding query vector; and transmitting to the client device the subset of AR experiences associated with the one or more embeddings that correspond to the embedding query vector.

公开(公告)号：US20240160673A1

公开(公告)日：2024-05-16

申请号：US18054420

申请日：2022-11-10

Applicant: Snap Inc.

Inventor： Kevin Sarabia Dela Rosa ,  Adel Elmalaha ,  Kwot Sin Lee ,  Patrick Poirson

IPC: G06F16/907 ,  G06F16/903 ,  G06F16/9035 ,  G06T19/00 ,  G06V10/74

CPC classification number: G06F16/907 ,  G06F16/90335 ,  G06F16/9035 ,  G06T19/006 ,  G06V10/761

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving an image from a client device; applying a machine learning model to the image to generate an embedding query vector, the machine learning model being trained to encode a plurality of images and text into a common embedding space; searching, based on the embedding query vector, a database of augmented reality (AR) experiences to identify a subset of AR experiences associated with one or more embeddings that correspond to the embedding query vector; and transmitting to the client device the subset of AR experiences associated with the one or more embeddings that correspond to the embedding query vector.