公开(公告)号：US20250014233A1

公开(公告)日：2025-01-09

申请号：US18347366

申请日：2023-07-05

Applicant: Lemon Inc.

Inventor： Jiachun Pan ,  Hanshu Yan ,  Jiashi Feng ,  Jun Hao Liew

IPC: G06T11/00 ,  G06T5/00

Abstract: Methods of customizing generation of objects using diffusion models are provided. One or more parameters (e.g., a conditioning signal, network weights, or an initial or starting noise) of the diffusion model can be optimized by a backpropagation process, which can be performed by solving an augmented adjoint ordinary differential equation (ODE) based on an adjoint sensitivity method. The customized diffusion model can generate stylized objects, generate objects with specific visual effect(s), and provide adversary examples to audit security of an object generation system.

公开(公告)号：US20240144544A1

公开(公告)日：2024-05-02

申请号：US18050349

申请日：2022-10-27

Applicant: Lemon Inc.

Inventor： Jun Hao Liew ,  Hanshu Yan ,  Daquan Zhou ,  Jiashi Feng

IPC: G06T11/00 ,  G06F40/40 ,  G06T5/00 ,  G06T5/20

CPC classification number: G06T11/00 ,  G06F40/40 ,  G06T5/002 ,  G06T5/20 ,  G06T2207/20084

Abstract: Generating an object using a diffusion model includes obtaining a first input and a second input, and synthesizing an output object from the first input and the second input. The synthesizing of the output object includes generating a layout of the output object from the first input, injecting the second input as a content conditioner to the layout of the output object, and de-noising the layout of the output object injected with the content conditioner to generate a content of the output object.