-
公开(公告)号:US20220092737A1
公开(公告)日:2022-03-24
申请号:US17543098
申请日:2021-12-06
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Matthieu Le , Andrew Tao
Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create a higher resolution video using upsampled frames from a lower resolution video.
-
公开(公告)号:US20210342980A1
公开(公告)日:2021-11-04
申请号:US17376939
申请日:2021-07-15
Applicant: NVIDIA CORPORATION
Inventor: Shiqiu Liu , Jacopo Pantaleoni
Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
-
公开(公告)号:US20210264571A1
公开(公告)日:2021-08-26
申请号:US17241782
申请日:2021-04-27
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Jacopo Pantaleoni
Abstract: This disclosure presents a method and computer program product to denoise a ray traced scene. An apparatus for processing a ray traced scene is also disclosed. In one example, the method includes: (1) generating filtered scene data by filtering modified scene data from original scene data utilizing a spatial filter, and (2) providing a denoised ray traced scene by adjusting the filtered scene data utilizing a temporal filter. The modified and adjusted scene data can be sent to a rendering processor or system to complete rendering to generate a final scene.
-
公开(公告)号:US20240257439A1
公开(公告)日:2024-08-01
申请号:US18612293
申请日:2024-03-21
Applicant: NVIDIA Corporation
Inventor: Shiqiu Liu , Christopher Ryan Wyman , Jon Hasselgren , Jacob Munkberg , Ignacio Llamas
CPC classification number: G06T15/06 , G06T5/20 , G06T5/70 , G06T15/506 , G06T15/60 , G06T2210/21
Abstract: Disclosed approaches may leverage the actual spatial and reflective properties of a virtual environment—such as the size, shape, and orientation of a bidirectional reflectance distribution function (BRDF) lobe of a light path and its position relative to a reflection surface, a virtual screen, and a virtual camera—to produce, for a pixel, an anisotropic kernel filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface. In order to accomplish this, geometry may be computed that corresponds to a projection of a reflection of the BRDF lobe below the surface along a view vector to the pixel. Using this approach, the dimensions of the anisotropic filter kernel may correspond to the BRDF lobe to accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface.
-
公开(公告)号:US12045952B2
公开(公告)日:2024-07-23
申请号:US17543098
申请日:2021-12-06
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Matthieu Le , Andrew Tao
IPC: G06F7/57 , A63F13/50 , G06N3/08 , G06T3/4046 , G06T3/4092 , G06T5/70
CPC classification number: G06T3/4046 , A63F13/50 , G06F7/57 , G06N3/08 , G06T3/4092 , G06T5/70 , G06T2207/10016 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create a higher resolution video using upsampled frames from a lower resolution video.
-
公开(公告)号:US11663701B2
公开(公告)日:2023-05-30
申请号:US17241782
申请日:2021-04-27
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Jacopo Pantaleoni
CPC classification number: G06T5/002 , G06T1/20 , G06T5/20 , G06T5/40 , G06T15/06 , G06T15/50 , G06T2207/20182
Abstract: This disclosure presents a method and computer program product to denoise a ray traced scene. An apparatus for processing a ray traced scene is also disclosed. In one example, the method includes: (1) generating filtered scene data by filtering modified scene data from original scene data utilizing a spatial filter, and (2) providing a denoised ray traced scene by adjusting the filtered scene data utilizing a temporal filter. The modified and adjusted scene data can be sent to a rendering processor or system to complete rendering to generate a final scene.
-
公开(公告)号:US20220138903A1
公开(公告)日:2022-05-05
申请号:US17089445
申请日:2020-11-04
Applicant: Nvidia Corporation
Inventor: Shiqiu Liu , Robert Pottorff , Andrew Tao , Bryan Catanzaro
Abstract: Apparatuses, systems, and techniques are presented to train one or more neural networks. In at least one embodiment, one or more neural networks are trained based, at least in part, on one or more image sequences, where backpropagation is performed using one or more subsets of images from the one or more image sequences.
-
公开(公告)号:US20210279841A1
公开(公告)日:2021-09-09
申请号:US16813589
申请日:2020-03-09
Applicant: NVIDIA Corporation
Inventor: Guilin Liu , Andrew Tao , Bryan Christopher Catanzaro , Ting-Chun Wang , Zhiding Yu , Shiqiu Liu , Fitsum Reda , Karan Sapra , Brandon Rowlett
Abstract: Apparatuses, systems, and techniques for texture synthesis from small input textures in images using convolutional neural networks. In at least one embodiment, one or more convolutional layers are used in conjunction with one or more transposed convolution operations to generate a large textured output image from a small input textured image while preserving global features and texture, according to various novel techniques described herein.
-
公开(公告)号:US10776985B2
公开(公告)日:2020-09-15
申请号:US16355214
申请日:2019-03-15
Applicant: NVIDIA Corporation
Inventor: Shiqiu Liu , Christopher Ryan Wyman , Jon Hasselgren , Jacob Munkberg , Ignacio Llamas
Abstract: Disclosed approaches may leverage the actual spatial and reflective properties of a virtual environment—such as the size, shape, and orientation of a bidirectional reflectance distribution function (BRDF) lobe of a light path and its position relative to a reflection surface, a virtual screen, and a virtual camera—to produce, for a pixel, an anisotropic kernel filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface. In order to accomplish this, geometry may be computed that corresponds to a projection of a reflection of the BRDF lobe below the surface along a view vector to the pixel. Using this approach, the dimensions of the anisotropic filter kernel may correspond to the BRDF lobe to accurately reflect the spatial characteristics of the virtual environment as well as the reflective properties of the surface.
-
公开(公告)号:US10740954B2
公开(公告)日:2020-08-11
申请号:US16354983
申请日:2019-03-15
Applicant: NVIDIA Corporation
Inventor: Shiqiu Liu
Abstract: In various examples, the actual spatial properties of a virtual environment are used to produce, for a pixel, an anisotropic filter kernel for a filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment. Geometry of the virtual environment may be computed based at least in part on a projection of a light source onto a surface through an occluder, in order to determine a footprint that reflects a contribution of the light source to lighting conditions of the pixel associated with a point on the surface. The footprint may define a size, orientation, and/or shape of the anisotropic filter kernel and corresponding filter weights. The anisotropic filter kernel may be applied to the pixel to produce a graphically-rendered image of the virtual environment.
-
-
-
-
-
-
-
-
-