公开(公告)号：US20240355010A1

公开(公告)日：2024-10-24

申请号：US18529550

申请日：2023-12-05

Applicant: Snap Inc.

Inventor： Bohdan Ahafonov ,  Matthew Hallberg ,  Sergei Korolev ,  William Miles Miller ,  Daria Skrypnyk ,  Aleksei Stoliar

IPC: G06T11/00 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22

CPC classification number: G06T11/001 ,  G06T7/11 ,  G06T11/40 ,  G06T11/60 ,  G06V20/20 ,  G10L15/08 ,  G10L15/22 ,  G06T2210/16 ,  G10L2015/088

Abstract: Methods and systems are disclosed for generating an extended reality (XR) try-on experience. The methods and systems store, in a multimodal memory, interaction data representing use of one or more interaction functions including data in different modalities. The methods and systems detect an object depicted in an image captured by an interaction client and generate, by a machine learning model, a prompt based on the object depicted in the image and the interaction data in the multimodal memory. The methods and systems generate an artificial texture based on the prompt and modify a texture of the object depicted in the image using the artificial texture that has been generated based on the prompt.