公开(公告)号：US12033301B2

公开(公告)日：2024-07-09

申请号：US16565088

申请日：2019-09-09

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Matthieu Le ,  Andrew Tao

IPC: G06F7/57 ,  A63F13/50 ,  G06N3/08 ,  G06T3/4046 ,  G06T3/4092 ,  G06T5/70

CPC classification number: G06T3/4046 ,  A63F13/50 ,  G06F7/57 ,  G06N3/08 ,  G06T3/4092 ,  G06T5/70 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create a higher resolution video using upsampled frames from a lower resolution video.

公开(公告)号：US20240095880A1

公开(公告)日：2024-03-21

申请号：US17948138

申请日：2022-09-19

Applicant: NVIDIA Corporation

Inventor： Shiqiu Liu ,  Jussi Rasanen ,  Michael Ranzinger ,  Guilin Liu ,  Andrew Tao ,  Bryan Christopher Catanzaro

IPC: G06T3/40 ,  G06T5/00 ,  G06T5/50

CPC classification number: G06T3/4046 ,  G06T5/002 ,  G06T5/50 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20212

Abstract: Apparatuses, systems, and techniques to use one or more neural networks to generate an upsampled version of one or more images based, at least in part, on a denoised version of said one or more images. At least one embodiment pertains to generating an upsampled high-resolution image from a noisy version and denoised version of a low-resolution image. At least one embodiment pertains to separating components of a low-resolution image before denoising an image.

公开(公告)号：US20220114700A1

公开(公告)日：2022-04-14

申请号：US17066282

申请日：2020-10-08

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Robert Pottorff ,  Guilin Liu ,  Karan Sapra ,  Jon Barker ,  David Tarjan ,  Pekka Janis ,  Edvard Fagerholm ,  Lei Yang ,  Kevin Shih ,  Marco Salvi ,  Timo Roman ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06T3/40 ,  G06T5/50 ,  G06T5/20 ,  G06T5/00

Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights determined based, at least in part, on one or more sub-pixel offset values.

公开(公告)号：US20220038654A1

公开(公告)日：2022-02-03

申请号：US16944071

申请日：2020-07-30

Applicant: NVIDIA Corporation

Inventor： Fitsum Reda ,  Karan Sapra ,  Robert Thomas Pottorff ,  Shiqiu Liu ,  Andrew Tao ,  Bryan Christopher Catanzaro

IPC: H04N7/01

Abstract: Apparatuses, systems, and techniques to generate interpolated video frames. In at least one embodiment, an interpolated video frame is generated based, at least in part, on a first set of pixel data sampled from a first video frame, and a second set of pixel data sampled from a second video frame based, at least in part, on a set of forward pointing motion vectors from the first video frame to the second video frame.

公开(公告)号：US20210383505A1

公开(公告)日：2021-12-09

申请号：US17406922

申请日：2021-08-19

Applicant: Nvidia Corporation

Inventor： Robert Pottorff ,  David Tarjan ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06T3/40 ,  G06T5/00 ,  G06T15/50 ,  G06T5/20

Abstract: Apparatuses, systems, and techniques are presented to generate images with one or more visual effects applied. In at least one embodiment, one or more visual effects are applied to one or more images having a resolution that is less than a first resolution and those visual effects approximated for one or more images having a resolution that is greater than or equal to the first resolution.

公开(公告)号：US20210064925A1

公开(公告)日：2021-03-04

申请号：US16558620

申请日：2019-09-03

Applicant: Nvidia Corporation

Inventor： Kevin Shih ,  Aysegul Dundar ,  Animesh Garg ,  Robert Pottorff ,  Andrew Tao ,  Bryan Catanzaro

IPC: G06K9/62 ,  G06N3/04 ,  G06N3/08

Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create, from a first video, a second video having one or more additional video frames.

公开(公告)号：US20190297326A1

公开(公告)日：2019-09-26

申请号：US16360853

申请日：2019-03-21

Applicant: NVIDIA Corporation

Inventor： Fitsum A. Reda ,  Guilin Liu ,  Kevin Shih ,  Robert Kirby ,  Jonathan Barker ,  David Tarjan ,  Andrew Tao ,  Bryan Catanzaro

IPC: H04N19/139 ,  G06N3/08 ,  G06N20/10 ,  G06N3/04 ,  G06N20/20 ,  H04N19/587 ,  H04N19/132 ,  H04N19/172

Abstract: A neural network architecture is disclosed for performing video frame prediction using a sequence of video frames and corresponding pairwise optical flows. The neural network processes the sequence of video frames and optical flows utilizing three-dimensional convolution operations, where time (or multiple video frames in the sequence of video frames) provides the third dimension in addition to the two-dimensional pixel space of the video frames. The neural network generates a set of parameters used to predict a next video frame in the sequence of video frames by sampling a previous video frame utilizing spatially-displaced convolution operations. In one embodiment, the set of parameters includes a displacement vector and at least one convolution kernel per pixel. Generating a pixel value in the next video frame includes applying the convolution kernel to a corresponding patch of pixels in the previous video frame based on the displacement vector.

公开(公告)号：US12045952B2

公开(公告)日：2024-07-23

申请号：US17543098

申请日：2021-12-06

Applicant: Nvidia Corporation

Inventor： Shiqiu Liu ,  Matthieu Le ,  Andrew Tao

IPC: G06F7/57 ,  A63F13/50 ,  G06N3/08 ,  G06T3/4046 ,  G06T3/4092 ,  G06T5/70

CPC classification number: G06T3/4046 ,  A63F13/50 ,  G06F7/57 ,  G06N3/08 ,  G06T3/4092 ,  G06T5/70 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create a higher resolution video using upsampled frames from a lower resolution video.

公开(公告)号：US20230196662A1

公开(公告)日：2023-06-22

申请号：US17556885

申请日：2021-12-20

Applicant: Nvidia Corporation

Inventor： Pietari Kaskela ,  Andrew Tao ,  Michael Ranzinger ,  David Tarjan ,  Jonathan Filip Gustav Granskog ,  Jorge Albericio Latorre

IPC: G06T15/50 ,  G06N3/04 ,  G06T3/40 ,  G06T3/00

CPC classification number: G06T15/503 ,  G06N3/0454 ,  G06T3/4046 ,  G06T3/0093

Abstract: Apparatuses, systems, and techniques are presented to reconstruct one or more images. In at least one embodiment, one or more circuits are to use one or more neural networks to adjust one or more pixel blending weights.

公开(公告)号：US20220180528A1

公开(公告)日：2022-06-09

申请号：US17678666

申请日：2022-02-23

Applicant: NVIDIA Corporation

Inventor： Aysegul Dundar ,  Kevin Jonathan Shih ,  Animesh Garg ,  Robert Thomas Pottorff ,  Andrew Tao ,  Bryan Christopher Catanzaro

IPC: G06T7/194 ,  G06N20/00 ,  G06N5/04 ,  G06T7/70 ,  G06N3/08 ,  G06V20/20

Abstract: Apparatuses, systems, and techniques to perform unsupervised keypoint or landmark learning using one or more neural networks. In at least one embodiment, one or more neural networks use pose and appearance information to construct a foreground and a background, which are then used to reconstruct an input image and determine loss values to train the one or more neural networks.