公开(公告)号：US11367160B2

公开(公告)日：2022-06-21

申请号：US16053341

申请日：2018-08-02

Applicant: NVIDIA Corporation

Inventor： Rajballav Dash ,  Gregory Palmer ,  Gentaro Hirota ,  Lacky Shah ,  Jack Choquette ,  Emmett Kilgariff ,  Sriharsha Niverty ,  Milton Lei ,  Shirish Gadre ,  Omkar Paranjape ,  Lei Yang ,  Rouslan Dimitrov

IPC: G06T1/20 ,  G06F9/38 ,  G06F15/80

Abstract: A parallel processing unit (e.g., a GPU), in some examples, includes a hardware scheduler and hardware arbiter that launch graphics and compute work for simultaneous execution on a SIMD/SIMT processing unit. Each processing unit (e.g., a streaming multiprocessor) of the parallel processing unit operates in a graphics-greedy mode or a compute-greedy mode at respective times. The hardware arbiter, in response to a result of a comparison of at least one monitored performance or utilization metric to a user-configured threshold, can selectively cause the processing unit to run one or more compute work items from a compute queue when the processing unit is operating in the graphics-greedy mode, and cause the processing unit to run one or more graphics work items from a graphics queue when the processing unit is operating in the compute-greedy mode. Associated methods and systems are also described.

公开(公告)号：US20220114702A1

公开(公告)日：2022-04-14

申请号：US17406902

申请日：2021-08-19

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Robert Pottorff ,  Guilin Liu ,  Karan Sapra ,  Jon Barker ,  David Tarjan ,  Pekka Janis ,  Edvard Fagerholm ,  Lei Yang ,  Kevin Jonathan Shih ,  Marco Salvi ,  Timo Roman ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/50 ,  G06T5/20

Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights.

公开(公告)号：US20220114701A1

公开(公告)日：2022-04-14

申请号：US17172330

申请日：2021-02-10

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Robert Pottorff ,  Guilin Liu ,  Karan Sapra ,  Jon Barker ,  David Tarjan ,  Pekka Janis ,  Edvard Fagerholm ,  Lei Yang ,  Kevin Shih ,  Marco Salvi ,  Timo Roman ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06T3/40 ,  G06T5/20 ,  G06T5/50 ,  G06T5/00

Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights determined based, at least in part, on one or more sub-pixel offset values.

公开(公告)号：US20220114700A1

公开(公告)日：2022-04-14

申请号：US17066282

申请日：2020-10-08

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Robert Pottorff ,  Guilin Liu ,  Karan Sapra ,  Jon Barker ,  David Tarjan ,  Pekka Janis ,  Edvard Fagerholm ,  Lei Yang ,  Kevin Shih ,  Marco Salvi ,  Timo Roman ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06T3/40 ,  G06T5/50 ,  G06T5/20 ,  G06T5/00

Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights determined based, at least in part, on one or more sub-pixel offset values.

公开(公告)号：US12197954B2

公开(公告)日：2025-01-14

申请号：US17204508

申请日：2021-03-17

Applicant: NVIDIA CORPORATION

Inventor： Yury Uralsky ,  Henry Moreton ,  Matthijs de Smedt ,  Lei Yang

IPC: G06F9/50 ,  G06T1/20 ,  G06T1/60

Abstract: The present technology augments the GPU compute model to provide system-provided data marshalling characteristics of graphics pipelining to increase efficiency and reduce overhead. A simple scheduling model based on scalar counters (e.g., semaphores) abstract the availability of hardware resources. Resource releases can be done programmatically, and a system scheduler only needs to track the states of such counters/semaphores to make work launch decisions. Semantics of the counters/semaphores are defined by an application, which can use the counters/semaphores to represent the availability of free space in a memory buffer, the amount of cache pressure induced by the data flow in the network, or the presence of work items to be processed.

公开(公告)号：US11308658B2

公开(公告)日：2022-04-19

申请号：US17150585

申请日：2021-01-15

Applicant: NVIDIA Corporation

Inventor： Lei Yang ,  Emmett Michael Kilgariff ,  Eric Brian Lum

IPC: G06T11/00 ,  G06T15/80 ,  G06T7/20 ,  G06T7/90 ,  G06T5/00 ,  G06T13/20 ,  G06T13/80 ,  G06T15/06

Abstract: Motion adaptive shading increases rendering performance for real-time animation in graphics systems while maintaining dynamic image quality. Each frame of an animation is statically displayed within a refresh interval, while a viewer's eyes move continuously relative to the image when actively tracking a moving object being displayed. As a result, a statically displayed frame is essentially smeared across the viewer's continuously moving retina over the lifetime of the frame, causing a perception of blur referred to as an eye-tracking motion blur effect. A region of an image depicting a moving object may be rendered at a lower shading rate because eye-tracking motion blur will substantially mask any blur introduced by reducing the shading rate. Reducing an average shading rate for rendering frames reduces computational effort per frame and may advantageously allow a rendering system to operate at a higher frame rate to provide a smoother, clearer visual experience.

公开(公告)号：US20210166441A1

公开(公告)日：2021-06-03

申请号：US17150585

申请日：2021-01-15

Applicant: NVIDIA Corporation

Inventor： Lei Yang ,  Emmett Michael Kilgariff ,  Eric Brian Lum

IPC: G06T11/00 ,  G06T5/00 ,  G06T13/20 ,  G06T15/80 ,  G06T7/20 ,  G06T7/90 ,  G06T13/80 ,  G06T15/06

Abstract: Motion adaptive shading increases rendering performance for real-time animation in graphics systems while maintaining dynamic image quality. Each frame of an animation is statically displayed within a refresh interval, while a viewer's eyes move continuously relative to the image when actively tracking a moving object being displayed. As a result, a statically displayed frame is essentially smeared across the viewer's continuously moving retina over the lifetime of the frame, causing a perception of blur referred to as an eye-tracking motion blur effect. A region of an image depicting a moving object may be rendered at a lower shading rate because eye-tracking motion blur will substantially mask any blur introduced by reducing the shading rate. Reducing an average shading rate for rendering frames reduces computational effort per frame and may advantageously allow a rendering system to operate at a higher frame rate to provide a smoother, clearer visual experience.

公开(公告)号：US10713756B2

公开(公告)日：2020-07-14

申请号：US15967688

申请日：2018-05-01

Applicant: Nvidia Corporation

Inventor： Rouslan Dimitrov ,  Lei Yang ,  Chris Amsinck ,  Walter Donovan ,  Eric Lum ,  Rui Bastos

IPC: G06K9/32 ,  G06T3/40 ,  G06T5/00 ,  G06T5/20

Abstract: One aspect of the current disclosure provides a method of upscaling an image. The method includes: rendering an image, wherein the rendering includes generating color samples of the image at a first resolution and depth samples of the image at a second resolution, which is higher than the first resolution; and upscaling the image to an upscaled image at a third resolution, which is higher than the first resolution, using the color samples and the depth samples.

公开(公告)号：US20200051290A1

公开(公告)日：2020-02-13

申请号：US16415209

申请日：2019-05-17

Applicant: NVIDIA Corporation

Inventor： Lei Yang ,  Emmett Michael Kilgariff ,  Eric Brian Lum

IPC: G06T11/00 ,  G06T5/00 ,  G06T13/20 ,  G06T15/80 ,  G06T15/06 ,  G06T7/20 ,  G06T7/90 ,  G06T13/80

Abstract: Motion adaptive shading increases rendering performance for real-time animation in graphics systems while maintaining dynamic image quality. Each frame of an animation is statically displayed within a refresh interval, while a viewer's eyes move continuously relative to the image when actively tracking a moving object being displayed. As a result, a statically displayed frame is essentially smeared across the viewer's continuously moving retina over the lifetime of the frame, causing a perception of blur referred to as an eye-tracking motion blur effect. A region of an image depicting a moving object may be rendered at a lower shading rate because eye-tracking motion blur will substantially mask any blur introduced by reducing the shading rate. Reducing an average shading rate for rendering frames reduces computational effort per frame and may advantageously allow a rendering system to operate at a higher frame rate to provide a smoother, clearer visual experience.

公开(公告)号：US20190340730A1

公开(公告)日：2019-11-07

申请号：US15967688

申请日：2018-05-01

Applicant: Nvidia Corporation

Inventor： Rouslan Dimitrov ,  Lei Yang ,  Chris Amsinck ,  Walter Donovan ,  Eric Lum ,  Rui Bastos

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/20

Abstract: One aspect of the current disclosure provides a method of upscaling an image. The method includes: rendering an image, wherein the rendering includes generating color samples of the image at a first resolution and depth samples of the image at a second resolution, which is higher than the first resolution; and upscaling the image to an upscaled image at a third resolution, which is higher than the first resolution, using the color samples and the depth samples.