公开(公告)号：US20220028158A1

公开(公告)日：2022-01-27

申请号：US17177011

申请日：2021-02-16

Applicant: NVIDIA Corporation

Inventor： Michael Stengel ,  Alexander Majercik ,  Ben Boudaoud ,  Morgan McGuire

IPC: G06T15/50 ,  G06T15/06 ,  G06T9/00 ,  H04L29/06 ,  H04N19/46 ,  A63F13/52

Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.

公开(公告)号：US12026830B2

公开(公告)日：2024-07-02

申请号：US17746793

申请日：2022-05-17

Applicant: NVIDIA Corporation

Inventor： Nicholas Vining ,  Paul Lalonde ,  Alexander Majercik

IPC: G06T15/50 ,  G06T5/50 ,  G06T5/70 ,  G06T15/08

CPC classification number: G06T15/506 ,  G06T5/50 ,  G06T5/70 ,  G06T15/08 ,  G06T2207/20108

Abstract: In order to perform denoising on a three-dimensional (3D) spherical measurement of light (such as spherical irradiance probe information or the results of a 3D gonioreflectometry capture), the 3D spherical measurement of light is converted to a two-dimensional (2D) measurement by creating multiple copies of the 3D spherical measurement of light, determining a two-dimensional sub-domain (e.g., a rectangular sub-domain) for each of the multiple copies, and stitching the plurality of two-dimensional sub-domains together in a toroidal configuration. Denoising may then be performed on this 2D measurement via a machine learning implementation or other means. This may result in more accurate 3D spherical light probes that require fewer light measurement samples to generate accurate light measurements.

公开(公告)号：US20240119664A1

公开(公告)日：2024-04-11

申请号：US18545911

申请日：2023-12-19

Applicant: NVIDIA Corporation

Inventor： Michael Stengel ,  Alexander Majercik ,  Ben Boudaoud ,  Morgan McGuire

IPC: G06T15/50 ,  G06T15/04 ,  G06T15/06 ,  H04L67/131 ,  H04N19/46

CPC classification number: G06T15/506 ,  G06T15/04 ,  G06T15/06 ,  H04L67/131 ,  H04N19/46

Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.

公开(公告)号：US20230377251A1

公开(公告)日：2023-11-23

申请号：US17746793

申请日：2022-05-17

Applicant: NVIDIA Corporation

Inventor： Nicholas Vining ,  Paul Lalonde ,  Alexander Majercik

IPC: G06T15/50 ,  G06T15/08 ,  G06T5/00 ,  G06T5/50

CPC classification number: G06T15/506 ,  G06T15/08 ,  G06T5/002 ,  G06T5/50 ,  G06T2207/20108

Abstract: In order to perform denoising on a three-dimensional (3D) spherical measurement of light (such as spherical irradiance probe information or the results of a 3D gonioreflectometry capture), the 3D spherical measurement of light is converted to a two-dimensional (2D) measurement by creating multiple copies of the 3D spherical measurement of light, determining a two-dimensional sub-domain (e.g., a rectangular sub-domain) for each of the multiple copies, and stitching the plurality of two-dimensional sub-domains together in a toroidal configuration. Denoising may then be performed on this 2D measurement via a machine learning implementation or other means. This may result in more accurate 3D spherical light probes that require fewer light measurement samples to generate accurate light measurements.

公开(公告)号：US20210012562A1

公开(公告)日：2021-01-14

申请号：US16926529

申请日：2020-07-10

Applicant: NVIDIA Corporation

Inventor： Morgan McGuire ,  Alexander Majercik ,  David Patrick Luebke

IPC: G06T15/50 ,  G06T15/80 ,  G06T15/10

Abstract: Global illumination in computer graphics refers to the modeling of how light is bounced off of one or more surfaces in a computer generated image onto other surfaces in the image (i.e. indirect light), rather than simply determining the light that hits a surface in an image directly from a light source (i.e. direct light). Rendering accurate global illumination effects in such images makes them more believable. However, simulating physically-based global illumination with offline numerical solvers has traditionally been time consuming and/or noisy and has not adapted well for dynamic scenes. The present disclosure provides a probe-based dynamic global illumination technique for computer generated scenes.

公开(公告)号：US11941752B2

公开(公告)日：2024-03-26

申请号：US17177011

申请日：2021-02-16

Applicant: NVIDIA Corporation

Inventor： Michael Stengel ,  Alexander Majercik ,  Ben Boudaoud ,  Morgan McGuire

IPC: G06T15/50 ,  G06T15/04 ,  G06T15/06 ,  H04L67/131 ,  H04N19/46

CPC classification number: G06T15/506 ,  G06T15/04 ,  G06T15/06 ,  H04L67/131 ,  H04N19/46

Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.

公开(公告)号：US11501467B2

公开(公告)日：2022-11-15

申请号：US17308893

申请日：2021-05-05

Applicant: NVIDIA Corporation

Inventor： Michael Stengel ,  Alexander Majercik ,  Ben Boudaoud ,  Morgan McGuire ,  Dawid Stanislaw Pajak

IPC: G06T9/00 ,  G06T15/04 ,  G06T15/06

Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing lossless or lossy compression and one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.

公开(公告)号：US20220138988A1

公开(公告)日：2022-05-05

申请号：US17308893

申请日：2021-05-05

Applicant: NVIDIA Corporation

Inventor： Michael Stengel ,  Alexander Majercik ,  Ben Boudaoud ,  Morgan McGuire ,  Dawid Stanislaw Pajak

IPC: G06T9/00 ,  G06T15/06 ,  G06T15/04

Abstract: A remote device utilizes ray tracing to compute a light field for a scene to be rendered, where the light field includes information about light reflected off surfaces within the scene. This light field is then compressed utilizing lossless or lossy compression and one or more video compression techniques that implement temporal reuse, such that only differences between the light field for the scene and a light field for a previous scene are compressed. The compressed light field data is then sent to a client device that decompresses the light field data and uses such data to obtain the light field for the scene at the client device. This light field is then used by the client device to compute global illumination for the scene. The global illumination may be used to accurately render the scene at the mobile device, resulting in a realistic scene that is presented by the mobile device.

公开(公告)号：US20210350550A1

公开(公告)日：2021-11-11

申请号：US16872069

申请日：2020-05-11

Applicant: Nvidia Corporation

Inventor： Michael Stengel ,  Morgan McGuire ,  Alexander Majercik ,  David Luebke

IPC: G06T7/246 ,  G06F3/01 ,  G06T7/70 ,  G06N3/08

Abstract: Apparatuses, systems, and techniques are presented to estimate user gaze. In at least one embodiment, one or more neural networks are used to determine coarse and fine gaze estimates for one or more users.