-
公开(公告)号:US20240020916A1
公开(公告)日:2024-01-18
申请号:US17864901
申请日:2022-07-14
Applicant: Adobe Inc.
Inventor: Valentin DESCHAINTRE , Yiwei HU , Paul GUERRERO , Milos HASAN
Abstract: Embodiments are disclosed for optimizing a material graph for replicating a material of the target image. Embodiments include receiving a target image and a material graph to be optimized for replicating a material of the target image. Embodiments include identifying a non-differentiable node of the material graph, the non-differentiable node including a set of input parameters. Embodiments include selecting a differentiable proxy from a library of the selected differentiable proxy is trained to replicate an output of the identified non-differentiable node. Embodiments include generating an optimized input parameters for the identified non-differentiable node using the corresponding trained neural network and the target image. Embodiments include replacing the set of input parameters of the non-differentiable node of the material graph with the optimized input parameters. Embodiments include generating an output material by the material graph to represent the target image using the optimized input parameters for the non-differentiable node.
-
公开(公告)号:US20240177399A1
公开(公告)日:2024-05-30
申请号:US18426084
申请日:2024-01-29
Applicant: Adobe Inc.
Inventor: Zexiang XU , Yannick HOLD-GEOFFROY , Milos HASAN , Kalyan SUNKAVALLI , Fanbo XIANG
Abstract: Embodiments are disclosed for neural texture mapping. In some embodiments, a method of neural texture mapping includes obtaining a plurality of images of an object, determining volumetric representation of a scene of the object using a first neural network, mapping 3D points of the scene to a 2D texture space using a second neural network, and determining radiance values for each 2D point in the 2D texture space from a plurality of viewpoints using a second neural network to generate a 3D appearance representation of the object.
-
公开(公告)号:US20240062455A1
公开(公告)日:2024-02-22
申请号:US17889168
申请日:2022-08-16
Applicant: Adobe Inc.
Inventor: Ankit PHOGAT , Xin SUN , Vineet BATRA , Sumit DHINGRA , Nathan A. CARR , Milos HASAN
CPC classification number: G06T15/10 , G06T17/205 , G06T11/20
Abstract: Embodiments are disclosed for performing 3-D vectorization. The method includes obtaining a three-dimensional rendered image and a camera position. The method further includes obtaining a triangle mesh representing the three-dimensional rendered image. The method further involves creating a reduced triangle mesh by removing one or more triangles from the triangle mesh. The method further involves subdividing each triangle of the reduced triangle mesh into one or more subdivided triangles. The method further involves performing a mapping of each pixel of the three-dimensional rendered image to the reduced triangle mesh. The method further involves assigning a color value to each vertex of the reduced triangle mesh. The method further involves sorting each triangle of the reduced triangle mesh using a depth value of each triangle. The method further involves generating a two-dimensional triangle mesh using the sorted triangles of the reduced triangle mesh.
-
公开(公告)号:US20220198738A1
公开(公告)日:2022-06-23
申请号:US17559867
申请日:2021-12-22
Applicant: Adobe Inc.
Inventor: Zexiang XU , Yannick HOLD-GEOFFROY , Milos HASAN , Kalyan SUNKAVALLI , Fanbo XIANG
Abstract: Embodiments are disclosed for neural texture mapping. In some embodiments, a method of neural texture mapping includes obtaining a plurality of images of an object, determining volumetric representation of a scene of the object using a first neural network, mapping 3D points of the scene to a 2D texture space using a second neural network, and determining radiance values for each 2D point in the 2D texture space from a plurality of viewpoints using a second neural network to generate a 3D appearance representation of the object.
-
-
-