- 专利标题: Systems and methods for multi-frame video frame interpolation
-
申请号: US17102114申请日: 2020-11-23
-
公开(公告)号: US11430138B2公开(公告)日: 2022-08-30
- 发明人: Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Jin Tang , Juwei Lu
- 申请人: Zhixiang Chi , Rasoul Mohammadi Nasiri , Zheng Liu , Jin Tang , Juwei Lu
- 申请人地址: CA North York; CA Toronto; CA Toronto; CA Markham; CA North York
- 专利权人: Zhixiang Chi,Rasoul Mohammadi Nasiri,Zheng Liu,Jin Tang,Juwei Lu
- 当前专利权人: Zhixiang Chi,Rasoul Mohammadi Nasiri,Zheng Liu,Jin Tang,Juwei Lu
- 当前专利权人地址: CA North York; CA Toronto; CA Toronto; CA Markham; CA North York
- 主分类号: G06T7/246
- IPC分类号: G06T7/246 ; G06N3/08
摘要:
Systems and methods for multi-frame video frame interpolation. Higher-order motion modeling, such as cubic motion modeling, achieves predictions of intermediate optical flow between multiple interpolated frames, assisted by relaxation of the constraints imposed by the loss function used in initial optical flow estimation. A temporal pyramidal optical flow refinement module performs coarse-to-fine refinement of the optical flow maps used to generate the intermediate frames, focusing a proportionally greater amount of refinement attention to the optical flow maps for the high-error middle frames. A temporal pyramidal pixel refinement module performs coarse-to-fine refinement of the generated intermediate frames, focusing a proportionally greater amount of refinement attention to the high-error middle frames. A generative adversarial network (GAN) module calculates a loss function for training the neural networks used in the optical flow estimation module, temporal pyramidal optical flow refinement module, and/or temporal pyramidal pixel refinement module.
公开/授权文献
信息查询