-
公开(公告)号:US20220130013A1
公开(公告)日:2022-04-28
申请号:US17080503
申请日:2020-10-26
Applicant: Nvidia Corporation
Inventor: Robert Pottorff , Shiqiu Liu , Andrew Tao , Bryan Catanzaro
Abstract: Apparatuses, systems, and techniques are presented to train one or more neural networks. In at least one embodiment, one or more neural networks are trained based, at least in part, on two or more versions of an image, wherein each of the two or more versions of the image are to be synthetically generated independently.
-
公开(公告)号:US20220038653A1
公开(公告)日:2022-02-03
申请号:US16944066
申请日:2020-07-30
Applicant: NVIDIA Corporation
Inventor: Fitsum Reda , Karan Sapra , Robert Thomas Pottorff , Shiqiu Liu , Andrew Tao , Bryan Christopher Catanzaro
IPC: H04N7/01
Abstract: Apparatuses, systems, and techniques to generate interpolated video frames. In at least one embodiment, an interpolated video frame is generated based, at least in part, on one of a plurality of possible motions of one or more objects from a first video frame to a second video frame.
-
公开(公告)号:US20200058103A1
公开(公告)日:2020-02-20
申请号:US16530854
申请日:2019-08-02
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Jacopo Pantaleoni
Abstract: This disclosure presents a method to denoise a ray traced scene where the ray tracing uses a minimal number of rays. The method can use temporal reprojections to compute a weighted average to the scene data. A spatial filter can be run on the scene data, using the temporal reprojection count to reduce the size of the utilized spatial filter radius. In some aspects, additional temporal filters can be applied to the scene data. In some aspects, global illumination temporal reprojection history counts can be used to modify the spatial filter radius. In some aspects, caustic photon tracing can be conducted to compute a logarithmic cost, which can then be utilized to reduce the denoising radius used by the spatial filter. The modified and adjusted scene data can be sent to a rendering process to complete the rendering to generate a final scene.
-
公开(公告)号:US20190287294A1
公开(公告)日:2019-09-19
申请号:US16355214
申请日:2019-03-15
Applicant: NVIDIA Corporation
Inventor: Shiqiu Liu , Christopher Ryan Wyman , Jon Hasselgren , Jacob Munkberg , Ignacio Llamas
Abstract: Disclosed approaches may leverage the actual spatial and reflective properties of a virtual environment—such as the size, shape, and orientation of a bidirectional reflectance distribution function (BRDF) lobe of a light path and its position relative to a reflection surface, a virtual screen, and a virtual camera—to produce, for a pixel, an anisotropic kernel filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface. In order to accomplish this, geometry may be computed that corresponds to a projection of a reflection of the BRDF lobe below the surface along a view vector to the pixel. Using this approach, the dimensions of the anisotropic filter kernel may correspond to the BRDF lobe to accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface.
-
公开(公告)号:US11688042B2
公开(公告)日:2023-06-27
申请号:US17376939
申请日:2021-07-15
Applicant: NVIDIA CORPORATION
Inventor: Shiqiu Liu , Jacopo Pantaleoni
CPC classification number: G06T5/002 , G06T1/20 , G06T5/20 , G06T5/40 , G06T15/06 , G06T15/50 , G06T2207/20182
Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
-
公开(公告)号:US20220327765A1
公开(公告)日:2022-10-13
申请号:US17852132
申请日:2022-06-28
Applicant: NVIDIA Corporation
Inventor: Shiqiu Liu , Christopher Ryan Wyman , Jon Hasselgren , Jacob Munkberg , Ignacio Llamas
Abstract: Disclosed approaches may leverage the actual spatial and reflective properties of a virtual environment—such as the size, shape, and orientation of a bidirectional reflectance distribution function (BRDF) lobe of a light path and its position relative to a reflection surface, a virtual screen, and a virtual camera—to produce, for a pixel, an anisotropic kernel filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface. In order to accomplish this, geometry may be computed that corresponds to a projection of a reflection of the BRDF lobe below the surface along a view vector to the pixel. Using this approach, the dimensions of the anisotropic filter kernel may correspond to the BRDF lobe to accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface.
-
公开(公告)号:US20220148256A1
公开(公告)日:2022-05-12
申请号:US17095556
申请日:2020-11-11
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Robert Pottorff , Andrew Tao , Bryan Catanzaro
Abstract: Apparatuses, systems, and techniques are presented to reconstruct one or more images. In at least one embodiment, one or more neural networks are used to determine one or more blending weights for one or more images based, at least in part, upon one or more pixel value masks for the one or more images.
-
公开(公告)号:US20220114702A1
公开(公告)日:2022-04-14
申请号:US17406902
申请日:2021-08-19
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Robert Pottorff , Guilin Liu , Karan Sapra , Jon Barker , David Tarjan , Pekka Janis , Edvard Fagerholm , Lei Yang , Kevin Jonathan Shih , Marco Salvi , Timo Roman , Andrew Tao , Bryan Catanzaro
Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights.
-
公开(公告)号:US20220114701A1
公开(公告)日:2022-04-14
申请号:US17172330
申请日:2021-02-10
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Robert Pottorff , Guilin Liu , Karan Sapra , Jon Barker , David Tarjan , Pekka Janis , Edvard Fagerholm , Lei Yang , Kevin Shih , Marco Salvi , Timo Roman , Andrew Tao , Bryan Catanzaro
Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights determined based, at least in part, on one or more sub-pixel offset values.
-
公开(公告)号:US20220101494A1
公开(公告)日:2022-03-31
申请号:US17039805
申请日:2020-09-30
Applicant: NVIDIA Corporation
Inventor: Morteza Mardani Korani , Guilin Liu , Aysegul Dundar , Shiqiu Liu , Andrew J. Tao , Bryan Christopher Catanzaro
Abstract: Apparatuses, systems, and techniques to scale textured images using a Fourier transform in conjunction with one or more neural networks. In at least one embodiment, a neural network generates an expanded image from an input image by applying a Fourier transform to one or more feature maps generated by said neural network and up-scaling one or more resulting frequency domain feature maps before generating an expanded output image based on up-scaled feature maps.
-
-
-
-
-
-
-
-
-