公开(公告)号：US20240273871A1

公开(公告)日：2024-08-15

申请号：US18168867

申请日：2023-02-14

Applicant: Lemon Inc.

Inventor： Guoxian Song ,  Hongyi Xu ,  Jing Liu ,  Tiancheng Zhi ,  Yichun Shi ,  Jianfeng Zhang ,  Zihang Jiang ,  Jiashi Feng ,  Shen Sang ,  Linjie Luo

IPC: G06V10/77 ,  G06V10/28 ,  G06V10/44

CPC classification number: G06V10/7715 ,  G06V10/28 ,  G06V10/454

Abstract: A method for generating a multi-dimensional stylized image. The method includes providing input data into a latent space for a style conditioned multi-dimensional generator of a multi-dimensional generative model and generating the multi-dimensional stylized image from the input data by the style conditioned multi-dimensional generator. The method further includes synthesizing content for the multi-dimensional stylized image using a latent code and corresponding camera pose from the latent space to formulate an intermediate code to modulate synthesis convolution layers to generate feature images as multi-planar representations and synthesizing stylized feature images of the feature images for generating the multi-dimensional stylized image of the input data. The style conditioned multi-dimensional generator is tuned using a guided transfer learning process using a style prior generator.

公开(公告)号：US20240265621A1

公开(公告)日：2024-08-08

申请号：US18165794

申请日：2023-02-07

Applicant: Lemon Inc.

Inventor： Hongyi Xu ,  Guoxian Song ,  Zihang Jiang ,  Jianfeng Zhang ,  Yichun Shi ,  Jing Liu ,  Wanchun Ma ,  Jiashi Feng ,  Linjie Luo

IPC: G06T15/08 ,  G06T3/40 ,  G06V40/16

CPC classification number: G06T15/08 ,  G06T3/4046 ,  G06T3/4053 ,  G06V40/176

Abstract: Technologies are described and recited herein for producing controllable synthesized images include a geometry guided 3D GAN framework for high-quality 3D head synthesis with full control on camera poses, facial expressions, head shape, articulated neck and jaw poses; and a semantic SDF (signed distance function) formulation that defines volumetric correspondence from observation space to canonical space, allowing full disentanglement of control parameters in 3D GAN training.

公开(公告)号：US20240096041A1

公开(公告)日：2024-03-21

申请号：US17932645

申请日：2022-09-15

Applicant: Lemon Inc. ,  Beijing Zitiao Network Technology Co., Ltd.

Inventor： Hongyi Xu ,  Tao Hu ,  Linjie Luo

IPC: G06T19/20 ,  G06T7/73 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T7/75 ,  G06T15/04 ,  G06T17/20 ,  G06T2207/20084 ,  G06T2210/16 ,  G06T2219/2004

Abstract: Systems and methods are provided that include a processor executing an avatar generation program to obtain driving view(s), calculate a skeletal pose of the user, and generate a coarse human mesh based on a template mesh and the skeletal pose of the user. The program further constructs a texture map based on the driving view(s) and the coarse human mesh, extracts a plurality of image features from the texture map, the image features being aligned to a UV map, and constructs a UV positional map based on the coarse human mesh. The program further extracts a plurality of pose features from the UV positional map, the pose features being aligned to the UV map, generates a plurality of pose-image features based on the UV map-aligned image features and UV map-aligned pose features, and renders an avatar based on the plurality of pose-image features.

公开(公告)号：US12051168B2

公开(公告)日：2024-07-30

申请号：US17932645

申请日：2022-09-15

Applicant: Lemon Inc. ,  Beijing Zitiao Network Technology Co., Ltd.

Inventor： Hongyi Xu ,  Tao Hu ,  Linjie Luo

IPC: G06T19/20 ,  G06T7/73 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T7/75 ,  G06T15/04 ,  G06T17/20 ,  G06T2207/20084 ,  G06T2210/16 ,  G06T2219/2004

Abstract: Systems and methods are provided that include a processor executing an avatar generation program to obtain driving view(s), calculate a skeletal pose of the user, and generate a coarse human mesh based on a template mesh and the skeletal pose of the user. The program further constructs a texture map based on the driving view(s) and the coarse human mesh, extracts a plurality of image features from the texture map, the image features being aligned to a UV map, and constructs a UV positional map based on the coarse human mesh. The program further extracts a plurality of pose features from the UV positional map, the pose features being aligned to the UV map, generates a plurality of pose-image features based on the UV map-aligned image features and UV map-aligned pose features, and renders an avatar based on the plurality of pose-image features.