公开(公告)号：US20190138889A1

公开(公告)日：2019-05-09

申请号：US16169851

申请日：2018-10-24

Applicant: NVIDIA Corporation

Inventor： Huaizu Jiang ,  Deqing Sun ,  Varun Jampani

IPC: G06N3/04 ,  G06N3/08 ,  G06T7/246 ,  H04N7/01

Abstract: Video interpolation is used to predict one or more intermediate frames at timesteps defined between two consecutive frames. A first neural network model approximates optical flow data defining motion between the two consecutive frames. A second neural network model refines the optical flow data and predicts visibility maps for each timestep. The two consecutive frames are warped according to the refined optical flow data for each timestep to produce pairs of warped frames for each timestep. The second neural network model then fuses the pair of warped frames based on the visibility maps to produce the intermediate frame for each timestep. Artifacts caused by motion boundaries and occlusions are reduced in the predicted intermediate frames.