公开(公告)号：US20240265621A1

公开(公告)日：2024-08-08

申请号：US18165794

申请日：2023-02-07

Applicant: Lemon Inc.

Inventor： Hongyi Xu ,  Guoxian Song ,  Zihang Jiang ,  Jianfeng Zhang ,  Yichun Shi ,  Jing Liu ,  Wanchun Ma ,  Jiashi Feng ,  Linjie Luo

IPC: G06T15/08 ,  G06T3/40 ,  G06V40/16

CPC classification number: G06T15/08 ,  G06T3/4046 ,  G06T3/4053 ,  G06V40/176

Abstract: Technologies are described and recited herein for producing controllable synthesized images include a geometry guided 3D GAN framework for high-quality 3D head synthesis with full control on camera poses, facial expressions, head shape, articulated neck and jaw poses; and a semantic SDF (signed distance function) formulation that defines volumetric correspondence from observation space to canonical space, allowing full disentanglement of control parameters in 3D GAN training.

公开(公告)号：US20240273871A1

公开(公告)日：2024-08-15

申请号：US18168867

申请日：2023-02-14

Applicant: Lemon Inc.

Inventor： Guoxian Song ,  Hongyi Xu ,  Jing Liu ,  Tiancheng Zhi ,  Yichun Shi ,  Jianfeng Zhang ,  Zihang Jiang ,  Jiashi Feng ,  Shen Sang ,  Linjie Luo

IPC: G06V10/77 ,  G06V10/28 ,  G06V10/44

CPC classification number: G06V10/7715 ,  G06V10/28 ,  G06V10/454

Abstract: A method for generating a multi-dimensional stylized image. The method includes providing input data into a latent space for a style conditioned multi-dimensional generator of a multi-dimensional generative model and generating the multi-dimensional stylized image from the input data by the style conditioned multi-dimensional generator. The method further includes synthesizing content for the multi-dimensional stylized image using a latent code and corresponding camera pose from the latent space to formulate an intermediate code to modulate synthesis convolution layers to generate feature images as multi-planar representations and synthesizing stylized feature images of the feature images for generating the multi-dimensional stylized image of the input data. The style conditioned multi-dimensional generator is tuned using a guided transfer learning process using a style prior generator.