-
公开(公告)号：US11222409B2
公开(公告)日：2022-01-11
申请号：US16867805
申请日：2020-05-06
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for correcting blur effects is presented. The method includes generating a plurality of images from a camera, synthesizing blurred images from sharp image counterparts to generate training data to train a structure-and-motion-aware convolutional neural network (CNN), and predicting a camera motion and a depth map from a single blurred image by employing the structure-and-motion-aware CNN to remove blurring from the single blurred image.
-
2.发明申请公开(公告)号：US20210042937A1
公开(公告)日：2021-02-11
申请号：US16939604
申请日：2020-07-27
Applicant: NEC Laboratories America, Inc.
Inventor： Pan Ji , Quoc-Huy Tran , Manmohan Chandraker , Yuliang Zou
Abstract: A computer-implemented method for implementing a self-supervised visual odometry framework using long-term modeling includes, within a pose network of the self-supervised visual odometry framework including a plurality of pose encoders, a convolution long short-term memory (ConvLSTM) module having a first-layer ConvLSTM and a second-layer ConvLSTM, and a pose prediction layer, performing a first stage of training over a first image sequence using photometric loss, depth smoothness loss and pose cycle consistency loss, and performing a second stage of training to finetune the second-layer ConvLSTM over a second image sequence longer than the first image sequence.
-
公开(公告)号：US10852749B2
公开(公告)日：2020-12-01
申请号：US16100445
申请日：2018-08-10
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Manmohan Chandraker , Hyo Jin Kim
IPC: G05D1/08 , G06T7/73 , G05D1/00 , G08G5/04 , B64C39/02 , G08G5/00 , G06N3/04 , G06N3/08 , G06N5/04 , G06T7/00 , G06F16/29 , G01C21/32
Abstract: A computer-implemented method, system, and computer program product are provided for pose estimation. The method includes receiving, by a processor, a plurality of images from one or more cameras. The method also includes generating, by the processor with a feature extraction convolutional neural network (CNN), a feature map for each of the plurality of images. The method additionally includes estimating, by the processor with a feature weighting network, a score map from a pair of the feature maps. The method further includes predicting, by the processor with a pose estimation CNN, a pose from the score map and a combined feature map. The method also includes controlling an operation of a processor-based machine to change a state of the processor-based machine, responsive to the pose.
-
公开(公告)号：US20200234467A1
公开(公告)日：2020-07-23
申请号：US16736451
申请日：2020-01-07
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: Systems and methods for camera self-calibration are provided. The method includes receiving real uncalibrated images, and estimating, using a camera self-calibration network, multiple predicted camera parameters corresponding to the real uncalibrated images. Deep supervision is implemented based on a dependence order between the plurality of predicted camera parameters to place supervision signals across multiple layers according to the dependence order. The method also includes determining calibrated images using the real uncalibrated images and the predicted camera parameters.
-
公开(公告)号：US20180129910A1
公开(公告)日：2018-05-10
申请号：US15709748
申请日：2017-09-20
Applicant: NEC Laboratories America, Inc.
Inventor： Muhammad Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Manmohan Chandraker , Chi Li
CPC classification number: G06K9/6256 , B60T2201/022 , B60W30/00 , G05D1/0221 , G06F17/5009 , G06K9/00201 , G06K9/00208 , G06K9/00624 , G06K9/00771 , G06K9/00805 , G06K9/4628 , G06K9/6255 , G06N3/02 , G06N3/084 , G06T7/55 , G06T7/74 , G06T11/60 , G06T15/10 , G06T15/40 , G06T2207/20101 , G06T2207/30261 , G06T2210/22 , G08G1/0962 , G08G1/166 , H04N7/00
Abstract: A system and method are provided. The system includes an image capture device configured to capture an actual image depicting an object. The system also includes a processor. The processor is configured to render, based on a set of 3D Computer Aided Design (CAD) models, a set of synthetic images with corresponding intermediate shape concept labels. The processor is also configured to form a multi-layer Convolutional Neural Network (CNN) which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is further configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN to the actual image to output an image pair including a 2D geometric structure and a 3D geometric structure of the object depicted in the actual image.
-
Patent Agency Ranking
6.发明授权公开(公告)号：US11321853B2
公开(公告)日：2022-05-03
申请号：US16939604
申请日：2020-07-27
Applicant: NEC Laboratories America, Inc.
Inventor： Pan Ji , Quoc-Huy Tran , Manmohan Chandraker , Yuliang Zou
Abstract: A computer-implemented method for implementing a self-supervised visual odometry framework using long-term modeling includes, within a pose network of the self-supervised visual odometry framework including a plurality of pose encoders, a convolution long short-term memory (ConvLSTM) module having a first-layer ConvLSTM and a second-layer ConvLSTM, and a pose prediction layer, performing a first stage of training over a first image sequence using photometric loss, depth smoothness loss and pose cycle consistency loss, and performing a second stage of training to finetune the second-layer ConvLSTM over a second image sequence longer than the first image sequence.
-
公开(公告)号：US11132586B2
公开(公告)日：2021-09-28
申请号：US16593247
申请日：2019-10-04
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for correcting rolling shutter (RS) effects is presented. The method includes generating a plurality of images from a camera, synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN), and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.
-
公开(公告)号：US20190066326A1
公开(公告)日：2019-02-28
申请号：US16100445
申请日：2018-08-10
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Manmohan Chandraker , Hyo Jin Kim
Abstract: A computer-implemented method, system, and computer program product are provided for pose estimation. The method includes receiving, by a processor, a plurality of images from one or more cameras. The method also includes generating, by the processor with a feature extraction convolutional neural network (CNN), a feature map for each of the plurality of images. The method additionally includes estimating, by the processor with a feature weighting network, a score map from a pair of the feature maps. The method further includes predicting, by the processor with a pose estimation CNN, a pose from the score map and a combined feature map. The method also includes controlling an operation of a processor-based machine to change a state of the processor-based machine, responsive to the pose.
-
公开(公告)号：US20210279843A1
公开(公告)日：2021-09-09
申请号：US17182836
申请日：2021-02-23
Applicant: NEC Laboratories America, Inc.
Inventor： Bingbing Zhuang , Quoc-Huy Tran
Abstract: A computer-implemented method executed by at least one processor for applying rolling shutter (RS)-aware spatially varying differential homography fields for simultaneous RS distortion removal and image stitching is presented. The method includes inputting two consecutive frames including RS distortions from a video stream, performing keypoint detection and matching to extract correspondences between the two consecutive frames, feeding the correspondences between the two consecutive frames into an RS-aware differential homography estimation component to filter out outlier correspondences, sending inlier correspondences to an RS-aware spatially varying differential homography field estimation component to compute an RS-aware spatially varying differential homography field, and using the RS-aware spatially varying differential homography field in an RS stitching and correction component to produce stitched images with removal of the RS distortions.
-
公开(公告)号：US20210158490A1
公开(公告)日：2021-05-27
申请号：US17090508
申请日：2020-11-05
Applicant: NEC Laboratories America, Inc.
Inventor： Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for jointly removing rolling shutter (RS) distortions and blur artifacts in a single input RS and blurred image is presented. The method includes generating a plurality of RS blurred images from a camera, synthesizing RS blurred images from a set of GS sharp images, corresponding GS sharp depth maps, and synthesized RS camera motions by employing a structure-and-motion-aware RS distortion and blur rendering module to generate training data to train a single-view joint RS correction and deblurring convolutional neural network (CNN), and predicting an RS rectified and deblurred image from the single input RS and blurred image by employing the single-view joint RS correction and deblurring CNN.
-
-
-
-
-
-
-
-
-
Search Results
33
records
(took 0.016 seconds)
