-
公开(公告)号：US20210158490A1
公开(公告)日：2021-05-27
申请号：US17090508
申请日：2020-11-05
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for jointly removing rolling shutter (RS) distortions and blur artifacts in a single input RS and blurred image is presented. The method includes generating a plurality of RS blurred images from a camera, synthesizing RS blurred images from a set of GS sharp images, corresponding GS sharp depth maps, and synthesized RS camera motions by employing a structure-and-motion-aware RS distortion and blur rendering module to generate training data to train a single-view joint RS correction and deblurring convolutional neural network (CNN), and predicting an RS rectified and deblurred image from the single input RS and blurred image by employing the single-view joint RS correction and deblurring CNN.
-
公开(公告)号：US11468585B2
公开(公告)日：2022-10-11
申请号：US16987705
申请日：2020-08-07
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Pan Ji , Manmohan Chandraker , Lokender Tiwari
Abstract: A method for improving geometry-based monocular structure from motion (SfM) by exploiting depth maps predicted by convolutional neural networks (CNNs) is presented. The method includes capturing a sequence of RGB images from an unlabeled monocular video stream obtained by a monocular camera, feeding the RGB images into a depth estimation/refinement module, outputting depth maps, feeding the depth maps and the RGB images to a pose estimation/refinement module, the depths maps and the RGB images collectively defining pseudo RGB-D images, outputting camera poses and point clouds, and constructing a 3D map of a surrounding environment displayed on a visualization device.
-
公开(公告)号：US20220111869A1
公开(公告)日：2022-04-14
申请号：US17494927
申请日：2021-10-06
Applicant: NEC Laboratories America, Inc.
Inventor： Buyu Liu , Pan Ji , Bingbing Zhuang , Manmohan Chandraker , Uday Kusupati
IPC: B60W60/00 , G06T7/50 , G06K9/72 , G06T7/10 , G06K9/00 , G06K9/62 , G06T7/70 , G06N3/04 , G06N3/08
Abstract: Methods and systems for determining a path include detecting objects within a perspective image that shows a scene. Depth is predicted within the perspective image. Semantic segmentation is performed on the perspective image. An attention map is generated using the detected objects and the predicted depth. A refined top-down view of the scene is generated using the predicted depth and the semantic segmentation. A parametric top-down representation of the scene is determined using a relational graph model. A path through the scene is determined using the parametric top-down representation.
-
4.发明授权公开(公告)号：US11321853B2
公开(公告)日：2022-05-03
申请号：US16939604
申请日：2020-07-27
Applicant: NEC Laboratories America, Inc.
Inventor： Pan Ji , Quoc-Huy Tran , Manmohan Chandraker , Yuliang Zou
Abstract: A computer-implemented method for implementing a self-supervised visual odometry framework using long-term modeling includes, within a pose network of the self-supervised visual odometry framework including a plurality of pose encoders, a convolution long short-term memory (ConvLSTM) module having a first-layer ConvLSTM and a second-layer ConvLSTM, and a pose prediction layer, performing a first stage of training over a first image sequence using photometric loss, depth smoothness loss and pose cycle consistency loss, and performing a second stage of training to finetune the second-layer ConvLSTM over a second image sequence longer than the first image sequence.
-
公开(公告)号：US11132586B2
公开(公告)日：2021-09-28
申请号：US16593247
申请日：2019-10-04
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for correcting rolling shutter (RS) effects is presented. The method includes generating a plurality of images from a camera, synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN), and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.
-
Patent Agency Ranking
公开(公告)号：US11222409B2
公开(公告)日：2022-01-11
申请号：US16867805
申请日：2020-05-06
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for correcting blur effects is presented. The method includes generating a plurality of images from a camera, synthesizing blurred images from sharp image counterparts to generate training data to train a structure-and-motion-aware convolutional neural network (CNN), and predicting a camera motion and a depth map from a single blurred image by employing the structure-and-motion-aware CNN to remove blurring from the single blurred image.
-
7.发明申请公开(公告)号：US20210042937A1
公开(公告)日：2021-02-11
申请号：US16939604
申请日：2020-07-27
Applicant: NEC Laboratories America, Inc.
Inventor： Pan Ji , Quoc-Huy Tran , Manmohan Chandraker , Yuliang Zou
Abstract: A computer-implemented method for implementing a self-supervised visual odometry framework using long-term modeling includes, within a pose network of the self-supervised visual odometry framework including a plurality of pose encoders, a convolution long short-term memory (ConvLSTM) module having a first-layer ConvLSTM and a second-layer ConvLSTM, and a pose prediction layer, performing a first stage of training over a first image sequence using photometric loss, depth smoothness loss and pose cycle consistency loss, and performing a second stage of training to finetune the second-layer ConvLSTM over a second image sequence longer than the first image sequence.
-
公开(公告)号：US20200234467A1
公开(公告)日：2020-07-23
申请号：US16736451
申请日：2020-01-07
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: Systems and methods for camera self-calibration are provided. The method includes receiving real uncalibrated images, and estimating, using a camera self-calibration network, multiple predicted camera parameters corresponding to the real uncalibrated images. Deep supervision is implemented based on a dependence order between the plurality of predicted camera parameters to place supervision signals across multiple layers according to the dependence order. The method also includes determining calibrated images using the real uncalibrated images and the predicted camera parameters.
-
公开(公告)号：US11987236B2
公开(公告)日：2024-05-21
申请号：US17408911
申请日：2021-08-23
Applicant: NEC Laboratories America, Inc.
Inventor： Pan Ji , Buyu Liu , Bingbing Zhuang , Manmohan Chandraker , Xiangyu Chen
CPC classification number: B60W30/09 , B60W30/0956 , G06F18/2193 , G06T7/215 , G06T7/251 , G08G1/166 , B60W2554/40 , G06T2207/20084 , G06T2207/30261
Abstract: A method provided for 3D object localization predicts pairs of 2D bounding boxes. Each pair corresponds to a detected object in each of the two consecutive input monocular images. The method generates, for each detected object, a relative motion estimation specifying a relative motion between the two images. The method constructs an object cost volume by aggregating temporal features from the two images using the pairs of 2D bounding boxes and the relative motion estimation to predict a range of object depth candidates and a confidence score for each object depth candidate and an object depth from the object depth candidates. The method updates the relative motion estimation based on the object cost volume and the object depth to provide a refined object motion and a refined object depth. The method reconstructs a 3D bounding box for each detected object based on the refined object motion and refined object depth.
-
公开(公告)号：US11599974B2
公开(公告)日：2023-03-07
申请号：US17090508
申请日：2020-11-05
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for jointly removing rolling shutter (RS) distortions and blur artifacts in a single input RS and blurred image is presented. The method includes generating a plurality of RS blurred images from a camera, synthesizing RS blurred images from a set of GS sharp images, corresponding GS sharp depth maps, and synthesized RS camera motions by employing a structure-and-motion-aware RS distortion and blur rendering module to generate training data to train a single-view joint RS correction and deblurring convolutional neural network (CNN), and predicting an RS rectified and deblurred image from the single input RS and blurred image by employing the single-view joint RS correction and deblurring CNN.
-
-
-
-
-
-
-
-
-
Search Results
15
records
(took 0.018 seconds)
