公开(公告)号：US20240265505A1

公开(公告)日：2024-08-08

申请号：US18165141

申请日：2023-02-06

Applicant: ADOBE INC.

Inventor： Cusuh Ham ,  Tobias Hinz ,  Jingwan Lu ,  Krishna Kumar Singh ,  Zhifei Zhang

IPC: G06T5/00

CPC classification number: G06T5/70 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure obtain a noise image and guidance information for generating an image. A diffusion model generates an intermediate noise prediction for the image based on the noise image. A conditioning network generates noise modulation parameters. The intermediate noise prediction and the noise modulation parameters are combined to obtain a modified intermediate noise prediction. The diffusion model generates the image based on the modified intermediate noise prediction, wherein the image depicts a scene based on the guidance information.