Invention Grant
- Patent Title: Motion blur and depth of field reconstruction through temporally stable neural networks
-
Application No.: US16422601Application Date: 2019-05-24
-
Publication No.: US10970816B2Publication Date: 2021-04-06
- Inventor: Carl Jacob Munkberg , Jon Niklas Theodor Hasselgren , Marco Salvi
- Applicant: NVIDIA Corporation
- Applicant Address: US CA Santa Clara
- Assignee: NVIDIA Corporation
- Current Assignee: NVIDIA Corporation
- Current Assignee Address: US CA Santa Clara
- Agency: Hogan Lovells US LLP
- Main IPC: G06K9/62
- IPC: G06K9/62 ; G06K9/46 ; G06T3/00 ; G06T5/00 ; G06T1/20

Abstract:
A neural network structure, namely a warped external recurrent neural network, is disclosed for reconstructing images with synthesized effects. The effects can include motion blur, depth of field reconstruction (e.g., simulating lens effects), and/or anti-aliasing (e.g., removing artifacts caused by sampling frequency). The warped external recurrent neural network is not recurrent at each layer inside the neural network. Instead, the external state output by the final layer of the neural network is warped and provided as a portion of the input to the neural network for the next image in a sequence of images. In contrast, in a conventional recurrent neural network, hidden state generated at each layer is provided as a feedback input to the generating layer. The neural network can be implemented, at least in part, on a processor. In an embodiment, the neural network is implemented on at least one parallel processing unit.
Public/Granted literature
- US20200051206A1 MOTION BLUR AND DEPTH OF FIELD RECONSTRUCTION THROUGH TEMPORALLY STABLE NEURAL NETWORKS Public/Granted day:2020-02-13
Information query