-
公开(公告)号：US20240161540A1
公开(公告)日：2024-05-16
申请号：US18505017
申请日：2023-11-08
CPC分类号： G06V40/171 , G06T7/11 , G06T7/20 , G06T17/00 , G06T2207/30201 , G06V2201/07
摘要： One or more embodiments comprise a computer-implemented method that includes receiving an input image including one or more facial representations and a set of points on a 3D canonical shape, wherein the set of points are selectable at runtime, extracting a set of features from the input image that represent at least one facial representation included in the one or more facial representations, and determining a set of landmarks on the at least one facial representation based on the set of features and the set of points, wherein each landmark in the set of landmarks is associated with at least one point in the set of points.
-
公开(公告)号：US20230237725A1
公开(公告)日：2023-07-27
申请号：US18159651
申请日：2023-01-25
发明人： Gaspard ZOSS , Baran GÖZCÜ , Barbara SOLENTHALER , Lingchen YANG , Byungsoo KIM
CPC分类号： G06T13/40 , G06T17/20 , G06T19/20 , G06T2210/36 , G06T2219/2021
摘要： One embodiment of the present invention sets forth a technique for generating actuation values based on a target shape such that the actuation values cause a simulator to output a simulated soft body that matches the target shape. The technique includes inputting a latent code that represents a target shape and a point on a geometric mesh into a first machine learning model. The technique further includes generating, via execution of the first machine learning model, one or more simulator control values that specify a deformation of the geometric mesh, where each of the simulator control values is based on the latent code and corresponds to the input point, and generating, via execution of the simulator, a simulated soft body based on the one or more simulator control values and the geometric mesh. The technique further includes causing the simulated soft body to be outputted to a computing device.
-
公开(公告)号：US20230154101A1
公开(公告)日：2023-05-18
申请号：US17983246
申请日：2022-11-08
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Daoye WANG , Gaspard ZOSS
CPC分类号： G06T15/06 , G06T15/04 , G06T7/62 , G06T2207/20081 , G06T2207/20084
摘要： Techniques are disclosed for generating photorealistic images of objects, such as heads, from multiple viewpoints. In some embodiments, a morphable radiance field (MoRF) model that generates images of heads includes an identity model that maps an identifier (ID) code associated with a head into two codes: a deformation ID code encoding a geometric deformation from a canonical head geometry, and a canonical ID code encoding a canonical appearance within a shape-normalized space. The MoRF model also includes a deformation field model that maps a world space position to a shape-normalized space position based on the deformation ID code. Further, the MoRF model includes a canonical neural radiance field (NeRF) model that includes a density multi-layer perceptron (MLP) branch, a diffuse MLP branch, and a specular MLP branch that output densities, diffuse colors, and specular colors, respectively. The MoRF model can be used to render images of heads from various viewpoints.
-
公开(公告)号：US20240346733A1
公开(公告)日：2024-10-17
申请号：US18628602
申请日：2024-04-05
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Sebastian Klaus WEISS , Gaspard ZOSS
摘要： The present invention sets forth a technique for simulating wrinkles under dynamic facial expression. This technique includes sampling a plurality of nodes from a three-dimensional (3D) representation of a facial structure, wherein each node represents a pore in the facial structure. The technique also generates one or more edges, with each of the one or more edges connecting a node of the plurality of nodes to a different node selected from the plurality of nodes. The technique further generates a wrinkle graph comprising the plurality of nodes, the one or more edges, and a plurality of edge weights associated with the edges included in the wrinkle graph. The technique may also modify the 3D representation of the facial structure based on the wrinkle graph and one or more dynamic expressions associated with the 3D representation.
-
公开(公告)号：US20240161391A1
公开(公告)日：2024-05-16
申请号：US18505009
申请日：2023-11-08
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Yingyan XU , Gaspard ZOSS
CPC分类号： G06T15/506 , G06T7/90 , G06T19/20 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2210/21 , G06T2219/2012
摘要： The present invention sets forth a technique for generating two-dimensional (2D) renderings of a three-dimensional (3D) scene from an arbitrary camera position under arbitrary lighting conditions. This technique includes determining, based on a plurality of 2D representations of a 3D scene, a radiance field function for a neural radiance field (NeRF) model. This technique further includes determining, based on a plurality of 2D representations of a 3D scene, a radiance field function for a “one light at a time” (OLAT) model. The technique further includes rendering a 2D representation of the scene based on a given camera position and illumination data. The technique further includes computing a rendering loss based on the difference between the rendered 2D representation and an associated one of the plurality of 2D representations of the scene. The technique further includes modifying at least one of the NeRF and OLAT models based on the rendering loss.
-
公开(公告)号：US20220005268A1
公开(公告)日：2022-01-06
申请号：US16921871
申请日：2020-07-06
发明人： Aurel GRUBER , Marco FRATARCANGELI , Derek Edward BRADLEY , Gaspard ZOSS , Dominik Thabo BEELER
摘要： Techniques are disclosed for creating digital faces. In some examples, an anatomical face model is generated from a data set including captured facial geometries of different individuals and associated bone geometries. A model generator segments each of the captured facial geometries into patches, compresses the segmented geometry associated with each patch to determine local deformation subspaces of the anatomical face model, and determines corresponding compressed anatomical subspaces of the anatomical face model. A sculpting application determines, based on sculpting input from a user, constraints for an optimization to determine parameter values associated with the anatomical face model. The parameter values can be used, along with the anatomical face model, to generate facial geometry that reflects the sculpting input.
-
公开(公告)号：US20230252714A1
公开(公告)日：2023-08-10
申请号：US17669053
申请日：2022-02-10
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Christopher Andreas OTTO , Agon SERIFI , Gaspard ZOSS
CPC分类号： G06T15/04 , G06T7/97 , G06T15/205 , G06V40/169
摘要： One embodiment of the present invention sets forth a technique for performing shape and appearance reconstruction. The technique includes generating a first set of renderings associated with an object based on a set of parameters that represent a reconstruction of the object in a first target image. The technique also includes producing, via a neural network, a first set of corrections associated with at least a portion of the set of parameters based on the first target image and the first set of renderings. The technique further includes generating an updated reconstruction of the object based on the first set of corrections.
-
公开(公告)号：US20220301348A1
公开(公告)日：2022-09-22
申请号：US17697774
申请日：2022-03-17
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Simone FOTI , Paulo Fabiano URNAU GOTARDO , Gaspard ZOSS
摘要： Embodiment of the present invention sets forth techniques for performing face reconstruction. The techniques include generating an identity mesh based on an identity encoding that represents an identity associated with a face in one or more images. The techniques also include generating an expression mesh based on an expression encoding that represents an expression associated with the face in the one or more images. The techniques also include generating, by a machine learning model, an output mesh of the face based on the identity mesh and the expression mesh.
-
9.发明申请公开(公告)号：US20220237751A1
公开(公告)日：2022-07-28
申请号：US17536777
申请日：2021-11-29
发明人： Derek Edward BRADLEY , Prashanth CHANDRAN , Paulo Fabiano URNAU GOTARDO , Jeremy RIVIERE , Sebastian Valentin WINBERG , Gaspard ZOSS
摘要： Techniques are disclosed for generating photorealistic images of head portraits. A rendering application renders a set of images that include the skin of a face and corresponding masks indicating pixels associated with the skin in the images. An inpainting application performs a neural projection technique to optimize a set of parameters that, when input into a generator model, produces a set of projection images, each of which includes a head portrait in which (1) skin regions resemble the skin regions of the face in a corresponding rendered image; and (2) non-skin regions match the non-skin regions in the other projection images when the rendered set of images are standalone images, or transition smoothly between consecutive projection images in the case when the rendered set of images are frames of a video. The rendered images can then be blended with corresponding projection images to generate composite images that are photorealistic.
-
公开(公告)号：US20230196665A1
公开(公告)日：2023-06-22
申请号：US18081597
申请日：2022-12-14
发明人： Paulo Fabiano URNAU GOTARDO , Derek Edward BRADLEY , Gaspard ZOSS , Jeremy RIVIERE , Prashanth CHANDRAN , Yingyan XU
IPC分类号： G06T15/50 , H04N13/254 , G06T15/04
CPC分类号： G06T15/506 , H04N13/254 , G06T15/04
摘要： Various embodiments include a system for rendering an object, such as human skin or a human head, from captured appearance data comprising a plurality of texels. The system includes a processor executing a texture space indirect illumination module. The system determines texture coordinates of a vector originating from a first texel where the vector intersects a second texel. The system renders the second texel from the viewpoint of the first texel based on appearance data at the second texel. Based on the rendering of the second texel, the system determines an indirect lighting intensity incident to the first texel from the second texel. The system updates appearance data at the first texel based on a direct lighting intensity and the indirect lighting intensity. The system renders the first texel based on the updated appearance data at the first texel.
-
-
-
-
-
-
-
-
-
搜索结果
19 条记录 (耗时 0.016 秒)
