公开(公告)号：US20240394843A1

公开(公告)日：2024-11-28

申请号：US18434411

申请日：2024-02-06

Applicant: Snap Inc.

Inventor： Pavlo Chemerys ,  Colin Eles ,  Ju Hu ,  Qing Jin ,  Yanyu Li ,  Ergeta Muca ,  Jian Ren ,  Dhritiman Sagar ,  Aleksei Stoliar ,  Sergey Tulyakov ,  Huan Wang

IPC: G06T5/60 ,  G06T5/70

Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, the first latent diffusion machine learning model trained to perform a first number of denoising steps, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first images, processing the noise data via the second latent diffusion machine learning model to generate one or more second images, and modify a parameter of the second latent diffusion machine learning model based on a comparison of the one or more first images with the one or more second images.

公开(公告)号：US20240394933A1

公开(公告)日：2024-11-28

申请号：US18596452

申请日：2024-03-05

Applicant: Snap Inc.

Inventor： Pavlo Chemerys ,  Colin Eles ,  Ju Hu ,  Qing Jin ,  Yanyu Li ,  Ergeta Muca ,  Jian Ren ,  Dhritiman Sagar ,  Aleksei Stoliar ,  Sergey Tulyakov ,  Huan Wang

IPC: G06T11/00

Abstract: Described is a system for improving machine learning models by accessing a first latent diffusion machine learning model, accessing a second latent diffusion machine learning model that was derived from the first latent diffusion machine learning model, the second latent diffusion machine learning model trained to perform a second number of denoising steps, generating noise data, processing the noise data via the first latent diffusion machine learning model to generate one or more first latent features, processing the noise data via the second latent diffusion machine learning model to generate one or more second latent features, and inputting the one or more first latent features and the one or more second latent features into a loss function. The system then modifies a parameter of the second latent diffusion machine learning model based on the output of the loss function.

公开(公告)号：US20240395028A1

公开(公告)日：2024-11-28

申请号：US18400677

申请日：2023-12-29

Applicant: Snap Inc.

Inventor： Pavlo Chemerys ,  Colin Eles ,  Ju Hu ,  Qing Jin ,  Yanyu Li ,  Ergeta Muca ,  Jian Ren ,  Dhritiman Sagar ,  Aleksei Stoliar ,  Sergey Tulyakov ,  Huan Wang

IPC: G06V10/82 ,  G06N3/0455

Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying an autoencoder for a latent diffusion machine learning model, the latent diffusion machine learning model is trained to receive text as input and output an image based on the received text. The system identifies a number of channels in a decoder of the autoencoder, the decoder being configured to receive latent features as input and output images. The system further identifies a performance characteristic of the decoder and changes the node topology of the decoder based on the performance characteristic to generate an updated decoder. The system retrains the latent diffusion machine learning model using the updated decoder by inputting latent features to the updated decoder, receiving an outputted image from the updated decoder, and updating one or more weights of the decoder based on an assessment of the outputted image.

公开(公告)号：US20240394932A1

公开(公告)日：2024-11-28

申请号：US18400873

申请日：2023-12-29

Applicant: Snap Inc.

Inventor： Pavlo Chemerys ,  Colin Eles ,  Ju Hu ,  Qing Jin ,  Yanyu Li ,  Ergeta Muca ,  Jian Ren ,  Dhgritiman Sagar ,  Aleksei Stoliar ,  Sergey Tulyakov ,  Huan Wang

IPC: G06T11/00 ,  G06N20/00 ,  G06T5/70 ,  G10L15/18 ,  G10L15/22

Abstract: Described is a system for improving machine learning models. In some cases, the system improves such models by identifying a performance characteristic for machine learning model blocks in an iterative denoising process of a machine learning model, connecting a prior machine learning model block with a subsequent machine learning model block of the machine learning model blocks within the machine learning model based on the identified performance characteristic, identifying a prompt of a user, the prompt indicative of an intent of the user for generative images, and analyzing data corresponding to the prompt using the machine learning model to generate one or more images, the machine learning model trained to generate images based on data corresponding to prompts.