Invention Grant
- Patent Title: Rolling shutter rectification in images/videos using convolutional neural networks with applications to SFM/SLAM with rolling shutter images/videos
-
Application No.: US16593247Application Date: 2019-10-04
-
Publication No.: US11132586B2Publication Date: 2021-09-28
- Inventor: Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
- Applicant: NEC Laboratories America, Inc.
- Applicant Address: US NJ Princeton
- Assignee: NEC Laboratories America, Inc.
- Current Assignee: NEC Laboratories America, Inc.
- Current Assignee Address: US NJ Princeton
- Agent Joseph Kolodka
- Main IPC: H04N5/225
- IPC: H04N5/225 ; G06N3/08 ; G06N3/04 ; H04N5/232 ; G06T7/20 ; G06K9/62
Abstract:
A method for correcting rolling shutter (RS) effects is presented. The method includes generating a plurality of images from a camera, synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN), and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.
Information query
