公开(公告)号：US11869132B2

公开(公告)日：2024-01-09

申请号：US17537343

申请日：2021-11-29

Applicant: Adobe Inc. ,  UCL Business Ltd.

Inventor： Vladimir Kim ,  Noam Aigerman ,  Niloy J. Mitra ,  Luca Morreale

IPC: G06T17/20 ,  G06T15/04 ,  G06N3/08 ,  G06N3/045

CPC classification number: G06T15/04 ,  G06N3/045 ,  G06N3/08 ,  G06T17/20

Abstract: Certain aspects and features of this disclosure relate to neural network based 3D object surface mapping. In one example, a first representation of a first surface of a first 3D object and a second representation of a second surface of a second 3D object are produced. A surface mapping function is generated for mapping the first surface to the second surface. The surface mapping function is defined the representations and by a neural network model configured to map a first 2D representation of the first surface to a second 2D representation of the second surface. One or more features of the a first 3D mesh on the first surface can be applied to a second 3D mesh on the second surface using the surface mapping function to produce a modified second surface, which can be rendered through a user interface.

公开(公告)号：US12165260B2

公开(公告)日：2024-12-10

申请号：US17715646

申请日：2022-04-07

Applicant: Adobe Inc. ,  University College London

Inventor： Duygu Ceylan Aksit ,  Yangtuanfeng Wang ,  Niloy J. Mitra ,  Meng Zhang

IPC: G06T15/04 ,  G06T7/70 ,  G06T17/20 ,  G06V10/75

Abstract: Systems and methods are described for rendering garments. The system includes a first machine learning model trained to generate coarse garment templates of a garment and a second machine learning model trained to render garment images. The first machine learning model generates a coarse garment template based on position data. The system produces a neural texture for the garment, the neural texture comprising a multi-dimensional feature map characterizing detail of the garment. The system provides the coarse garment template and the neural texture to the second machine learning model trained to render garment images. The second machine learning model generates a rendered garment image of the garment based on the coarse garment template of the garment and the neural texture.

公开(公告)号：US20250095172A1

公开(公告)日：2025-03-20

申请号：US18369958

申请日：2023-09-19

Applicant: Adobe Inc.

Inventor： Sanjeev Muralikrishnan ,  Chun-Hao Huang ,  Duygu Ceylan Aksit ,  Niloy J. Mitra

IPC: G06T7/38 ,  G06T7/73 ,  G06T17/10

Abstract: In some examples, a computing system access a set of registered three-dimensional (3D) digital shapes. The set of registered 3D digital shapes are registered to a shape template. The computing system determines a linear model for an estimate of the shape space using a first subset of the set of registered 3D digital shapes. The computing system then determines a nonlinear deformation model for the shape space using a second subset of the set of registered 3D digital shapes. An unregistered shape can be registered to the shape space using the linear model and the nonlinear deformation model. The registration can be added to the set of registered 3D digital shapes to update the estimate of the shape space if a shape distance between the registration and the unregistered shape is below a threshold value.

公开(公告)号：US20230326137A1

公开(公告)日：2023-10-12

申请号：US17715646

申请日：2022-04-07

Applicant: Adobe Inc. ,  University College London

Inventor： Duygu Ceylan Aksit ,  Yangtuanfeng Wang ,  Niloy J. Mitra ,  Meng Zhang

IPC: G06T17/20 ,  G06T15/04 ,  G06T7/70 ,  G06V10/75

CPC classification number: G06T17/20 ,  G06T15/04 ,  G06T7/70 ,  G06V10/7515 ,  G06T2207/20084 ,  G06T2207/20081 ,  G06T2210/16

Abstract: Systems and methods are described for rendering garments. The system includes a first machine learning model trained to generate coarse garment templates of a garment and a second machine learning model trained to render garment images. The first machine learning model generates a coarse garment template based on position data. The system produces a neural texture for the garment, the neural texture comprising a multi-dimensional feature map characterizing detail of the garment. The system provides the coarse garment template and the neural texture to the second machine learning model trained to render garment images. The second machine learning model generates a rendered garment image of the garment based on the coarse garment template of the garment and the neural texture.

公开(公告)号：US20230169714A1

公开(公告)日：2023-06-01

申请号：US17537343

申请日：2021-11-29

Applicant: Adobe Inc. ,  University College London

Inventor： Vladimir Kim ,  Noam Aigerman ,  Niloy J. Mitra ,  Luca Morreale

IPC: G06T15/04 ,  G06T17/20 ,  G06N3/04 ,  G06N3/08

CPC classification number: G06T15/04 ,  G06T17/20 ,  G06N3/0454 ,  G06N3/08

Abstract: Certain aspects and features of this disclosure relate to neural network based 3D object surface mapping. In one example, a first representation of a first surface of a first 3D object and a second representation of a second surface of a second 3D object are produced. A surface mapping function is generated for mapping the first surface to the second surface. The surface mapping function is defined the representations and by a neural network model configured to map a first 2D representation of the first surface to a second 2D representation of the second surface. One or more features of the a first 3D mesh on the first surface can be applied to a second 3D mesh on the second surface using the surface mapping function to produce a modified second surface, which can be rendered through a user interface.