公开(公告)号：US20240265628A1

公开(公告)日：2024-08-08

申请号：US18165619

申请日：2023-02-07

Applicant: Lemon Inc.

Inventor： Hongyi XU ,  Sizhe AN ,  Yichun SHI ,  Guoxian SONG ,  Linjie LUO

IPC: G06T17/00 ,  G06T3/40 ,  G06T7/194 ,  G06T7/70 ,  G06T11/00 ,  G06T15/10 ,  G06T19/20

CPC classification number: G06T17/00 ,  G06T3/4053 ,  G06T7/194 ,  G06T7/70 ,  G06T11/00 ,  G06T15/10 ,  G06T19/20 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T2210/12 ,  G06T2210/22 ,  G06T2219/2004 ,  G06T2219/2016

Abstract: A three-dimensional generative adversarial network includes a generator, a discriminator, and a renderer. The generator is configured to receive an intermediate latent code mapped from a latent code and a camera pose, generate two-dimensional backgrounds for a set of images, and generate, based on the intermediate latent code, multi-grid representation features. The renderer is configured to synthesize images based on the camera pose, a camera pose offset, and the multi-grid representation features; the camera pose offset being mapped from the latent code and the camera pose; and render a foreground mask. The discriminator is configured to supervise a training of the foreground mask with an up-sampled image and a super-resolved image.