-
公开(公告)号:US12112445B2
公开(公告)日:2024-10-08
申请号:US17467792
申请日:2021-09-07
申请人: Nvidia Corporation
发明人: Kangxue Yin , Jun Gao , Masha Shugrina , Sameh Khamis , Sanja Fidler
CPC分类号: G06T19/20 , G06N3/045 , G06T3/02 , G06T3/18 , G06T7/11 , G06T15/04 , G06T17/20 , G06T2200/04 , G06T2207/20084 , G06T2219/2021
摘要: Generation of three-dimensional (3D) object models may be challenging for users without a sufficient skill set for content creation and may also be resource intensive. One or more style transfer networks may be used for part-aware style transformation of both geometric features and textural components of a source asset to a target asset. The source asset may be segmented into particular parts and then ellipsoid approximations may be warped according to correspondence of the particular parts to the target assets. Moreover, a texture associated with the target asset may be used to warp or adjust a source texture, where the new texture can be applied to the warped parts.
-
2.
公开(公告)号:US20240296623A1
公开(公告)日:2024-09-05
申请号:US18169825
申请日:2023-02-15
申请人: Nvidia Corporation
发明人: Jiahui Huang , Francis Williams , Zan Gojcic , Matan Atzmon , Or Litany , Sanja Fidler
CPC分类号: G06T17/20 , G06T15/08 , G06T2210/56
摘要: Approaches presented herein provide for the reconstruction of implicit multi-dimensional shapes. In one embodiment, oriented point cloud data representative of an object can be obtained using a physical scanning process. The point cloud data can be provided as input to a trained density model that can infer density functions for various points. The points can be mapped to a voxel hierarchy, allowing density functions to be determined for those voxels at the various levels that are associated with at least one point of the input point cloud. Contribution weights can be determined for the various density functions for the sparse voxel hierarchy, and the weighted density functions combined to obtain a density field. The density field can be evaluated to generate a geometric mesh where points having a zero, or near-zero, value are determined to contribute to the surface of the object.
-
公开(公告)号:US20240296205A1
公开(公告)日:2024-09-05
申请号:US18656298
申请日:2024-05-06
申请人: Nvidia Corporation
发明人: David Acuna Marrero , Guojun Zhang , Marc Law , Sanja Fidler
IPC分类号: G06F18/214 , G06F18/21 , G06F18/241 , G06N3/045 , G06N3/08 , G06V10/40
CPC分类号: G06F18/2148 , G06F18/217 , G06F18/241 , G06N3/045 , G06N3/08 , G06V10/40
摘要: Approaches presented herein provide for unsupervised domain transfer learning. In particular, three neural networks can be trained together using at least labeled data from a first domain and unlabeled data from a second domain. Features of the data are extracted using a feature extraction network. A first classifier network uses these features to classify the data, while a second classifier network uses these features to determine the relevant domain. A combined loss function is used to optimize the networks, with a goal of the feature extraction network extracting features that the first classifier network is able to use to accurately classify the data, but prevent the second classifier from determining the domain for the image. Such optimization enables object classification to be performed with high accuracy for either domain, even though there may have been little to no labeled training data for the second domain.
-
公开(公告)号:US20240095986A1
公开(公告)日:2024-03-21
申请号:US17748739
申请日:2022-05-19
申请人: NVIDIA Corporation
CPC分类号: G06T13/00 , G06F40/20 , G10L15/063 , G10L15/16 , G10L15/1815 , G10L15/22 , G10L2015/223
摘要: Apparatuses, systems, and techniques to generate animations. In at least one embodiment, one or more neural networks control motion of one or more animated objects based, at least in part, on natural language inputs.
-
公开(公告)号:US20230410397A1
公开(公告)日:2023-12-21
申请号:US17842481
申请日:2022-06-16
申请人: Nvidia Corporation
发明人: Tingwu Wang , Yunrong Guo , Cheng Xie , Xue Bin Peng , Sanja Fidler
摘要: Apparatuses, systems, and techniques are presented to generate images representing realistic motion or activity. In at least one embodiment, one or more neural networks are used to generate one or more images of one or more characters performing one or more actions based, at least in part, upon one or more physical capabilities of the one or more characters.
-
公开(公告)号:US11847538B2
公开(公告)日:2023-12-19
申请号:US17317698
申请日:2021-05-11
申请人: NVIDIA Corporation
发明人: Tianshi Cao , Alex Bie , Karsten Julian Kreis , Sanja Fidler , Arash Vahdat
IPC分类号: G06N20/00 , G06F18/214 , G06F21/62 , G06N3/08 , G06V20/56
CPC分类号: G06N20/00 , G06F18/214 , G06F21/6218 , G06N3/08 , G06V20/56
摘要: Apparatuses, systems, and techniques to train a generative model based at least in part on a private dataset. In at least one embodiment, the generative model is trained based at least in part on a differentially private Sinkhorn algorithm, for example, using backpropagation with gradient descent to determine a gradient of a set of parameters of the generative models and modifying the set of parameters based at least in part on the gradient.
-
公开(公告)号:US11816790B2
公开(公告)日:2023-11-14
申请号:US17117425
申请日:2020-12-10
申请人: Nvidia Corporation
发明人: Jeevan Devaranjan , Sanja Fidler , Amlan Kar
IPC分类号: G06T17/00 , A63F13/52 , G06F16/51 , G06F16/54 , G06N3/08 , G06N5/025 , G06T15/20 , G06N7/01 , G06V10/25 , G06V10/774 , G06V20/20 , G06V20/40 , G06F18/214
CPC分类号: G06T17/00 , A63F13/52 , G06F16/51 , G06F16/54 , G06N3/08 , G06N5/025 , G06N7/01 , G06T15/205 , G06V10/25 , G06V10/774 , G06V20/20 , G06F18/2148 , G06F18/2155 , G06T2210/61 , G06V20/40
摘要: A rule set or scene grammar can be used to generate a scene graph that represents the structure and visual parameters of objects in a scene. A renderer can take this scene graph as input and, with a library of content for assets identified in the scene graph, can generate a synthetic image of a scene that has the desired scene structure without the need for manual placement of any of the objects in the scene. Images or environments synthesized in this way can be used to, for example, generate training data for real world navigational applications, as well as to generate virtual worlds for games or virtual reality experiences.
-
公开(公告)号:US20230342941A1
公开(公告)日:2023-10-26
申请号:US18333166
申请日:2023-06-12
申请人: Nvidia Corporation
IPC分类号: G06T7/12 , G06V20/56 , G06F18/25 , G06V10/764 , G06V10/80 , G06V10/82 , G06V10/44 , G06V10/20
CPC分类号: G06T7/12 , G06V20/56 , G06F18/253 , G06V10/764 , G06V10/806 , G06V10/82 , G06V10/454 , G06V10/255 , G06T2207/30252 , G06T2207/20084 , G06T2207/20081
摘要: Various types of image analysis benefit from a multi-stream architecture that allows the analysis to consider shape data. A shape stream can process image data in parallel with a primary stream, where data from layers of a network in the primary stream is provided as input to a network of the shape stream. The shape data can be fused with the primary analysis data to produce more accurate output, such as to produce accurate boundary information when the shape data is used with semantic segmentation data produced by the primary stream. A gate structure can be used to connect the intermediate layers of the primary and shape streams, using higher level activations to gate lower level activations in the shape stream. Such a gate structure can help focus the shape stream on the relevant information and reduces any additional weight of the shape stream.
-
公开(公告)号:US20220392162A1
公开(公告)日:2022-12-08
申请号:US17718172
申请日:2022-04-11
申请人: NVIDIA Corporation
发明人: Tianchang Shen , Jun Gao , Kangxue Yin , Ming-Yu Liu , Sanja Fidler
摘要: In various examples, a deep three-dimensional (3D) conditional generative model is implemented that can synthesize high resolution 3D shapes using simple guides—such as coarse voxels, point clouds, etc.—by marrying implicit and explicit 3D representations into a hybrid 3D representation. The present approach may directly optimize for the reconstructed surface, allowing for the synthesis of finer geometric details with fewer artifacts. The systems and methods described herein may use a deformable tetrahedral grid that encodes a discretized signed distance function (SDF) and a differentiable marching tetrahedral layer that converts the implicit SDF representation to an explicit surface mesh representation. This combination allows joint optimization of the surface geometry and topology as well as generation of the hierarchy of subdivisions using reconstruction and adversarial losses defined explicitly on the surface mesh.
-
公开(公告)号:US20220391781A1
公开(公告)日:2022-12-08
申请号:US17827446
申请日:2022-05-27
申请人: NVIDIA Corporation
发明人: Or Litany , Haggai Maron , David Jesus Acuna Marrero , Jan Kautz , Sanja Fidler , Gal Chechik
摘要: A method performed by a server is provided. The method comprises sending copies of a set of parameters of a hyper network (HN) to at least one client device, receiving from each client device in the at least one client device, a corresponding set of updated parameters of the HN, and determining a next set of parameters of the HN based on the corresponding sets of updated parameters received from the at least one client device. Each client device generates the corresponding set of updated parameters based on a local model architecture of the client device.
-
-
-
-
-
-
-
-
-