-
公开(公告)号：US09821813B2
公开(公告)日：2017-11-21
申请号：US14879264
申请日：2015-10-09
Applicant: NEC Laboratories America, Inc.
Inventor： Manmohan Chandraker , Vikas Dhiman
IPC: B60W40/04 , G06T17/00 , H04N7/18 , H04N5/225 , G06T7/20 , G06K9/00 , G06T7/579 , G06T7/215 , G06T7/277
CPC classification number: B60W40/04 , B60R2300/108 , B60R2300/804 , G06K9/00798 , G06K9/00805 , G06T7/215 , G06T7/277 , G06T7/579 , G06T17/00 , G06T2207/10016 , G06T2207/20076 , G06T2207/30241 , G06T2207/30252 , H04N5/225 , H04N7/183
Abstract: Systems and methods are disclosed for road scene understanding of vehicles in traffic by capturing images of traffic with a camera coupled to a vehicle; generating a continuous model of occlusions with a continuous occlusion mode for traffic participants to enhance point track association accuracy without distinguishing between moving and static objects; applying the continuous occlusion model to handle visibility constraints in object tracks; and combining point track association and soft object track modeling to improve 3D localization accuracy.
-
公开(公告)号：US20170124711A1
公开(公告)日：2017-05-04
申请号：US15342700
申请日：2016-11-03
Applicant: NEC Laboratories America, Inc.
Inventor： Manmohan Chandraker , Christopher Bongsoo Choy , Silvio Savarese
CPC classification number: G06K9/42 , G06K9/00201 , G06K9/4628 , G06N3/0454 , G06N3/08 , G06T2207/20081 , G06T2207/20084
Abstract: A computer-implemented method for training a convolutional neural network (CNN) is presented. The method includes extracting coordinates of corresponding points in the first and second locations, identifying positive points in the first and second locations, identifying negative points in the first and second locations, training features that correspond to positive points of the first and second locations to move closer to each other, and training features that correspond to negative points in the first and second locations to move away from each other.
-
公开(公告)号：US20170124433A1
公开(公告)日：2017-05-04
申请号：US15342766
申请日：2016-11-03
Applicant: NEC Laboratories America, Inc.
Inventor： Manmohan Chandraker , Angjoo Kim
CPC classification number: G06N3/04 , G06F17/30247 , G06N3/0454 , G06T7/337 , G06T7/50 , G06T2207/20081 , G06T2207/20084
Abstract: A computer-implemented method for training a deep learning network is presented. The method includes receiving a first image and a second image, mining exemplar thin-plate spline (TPS) to determine transformations for generating point correspondences between the first and second images, using artificial point correspondences to train the deep neural network, learning and using the TPS transformation output through a spatial transformer, and applying heuristics for selecting an acceptable set of images to match for accurate reconstruction. The deep learning network learns to warp points in the first image to points in the second image.
-
44.发明授权公开(公告)号：US09189689B2
公开(公告)日：2015-11-17
申请号：US14451280
申请日：2014-08-04
Applicant: NEC Laboratories America, Inc.
Inventor： Manmohan Chandraker , Shiyu Song
CPC classification number: G06K9/00791 , G06K9/46 , G06K2009/4666
Abstract: A method for performing three-dimensional (3D) localization requiring only a single camera including capturing images from only one camera; generating a cue combination from sparse features, dense stereo and object bounding boxes; correcting for scale in monocular structure from motion (SFM) using the cue combination for estimating a ground plane; and performing localization by combining SFM, ground plane and object bounding boxes to produce a 3D object localization.
Abstract translation: 一种用于执行三维（3D）定位的方法，其仅需要单个相机，包括仅从一个相机捕获图像; 从稀疏特征，密集的立体声和物体边界框中产生提示组合; 使用用于估计接地平面的提示组合来校正来自运动的单眼结构（SFM）中的尺度; 并通过组合SFM，地平面和对象边界框来执行定位，以产生3D对象定位。
-
公开(公告)号：US20140132727A1
公开(公告)日：2014-05-15
申请号：US14073794
申请日：2013-11-06
Applicant: NEC Laboratories America, Inc.
Inventor： Manmohan Chandraker
IPC: H04N13/02
CPC classification number: G06T7/0055 , G06T7/514 , G06T7/55
Abstract: Systems and methods are disclosed for determining three dimensional (3D) shape by capturing with a camera a plurality of images of an object in differential motion; derive a general relation that relates spatial and temporal image derivatives to BRDF derivatives; exploiting rank deficiency to eliminate BRDF terms and recover depth or normal for directional lighting; and using depth-normal-BRDF relation to recover depth or normal for unknown arbitrary lightings.
Abstract translation: 公开了用于通过用相机捕获差分运动中的对象的多个图像来确定三维（3D）形状的系统和方法; 导出将空间和时间图像衍生物与BRDF衍生物相关联的一般关系; 利用职级缺陷消除BRDF术语，恢复定向照明的深度或正常; 并使用深度正常BRDF关系恢复未知任意照明的深度或正常。
-
Patent Agency Ranking
公开(公告)号：US20250118063A1
公开(公告)日：2025-04-10
申请号：US18891625
申请日：2024-09-20
Applicant: NEC Laboratories America, Inc.
Inventor： Jong-Chyi Su , Samuel Schulter , Sparsh Garg , Manmohan Chandraker , Mingfu Liang
Abstract: Systems and methods include detecting one or more objects in an image and generating one or more captions for the image. One or more predicted categories of the one or more objects detected in the image and the one or more captions are matched. From the one or more predicted categories, a category that is not successfully predicted in the image is identified. Data is curated to improve the category that is not successfully predicted in the image. A perception model is finetuned using data curated.
-
公开(公告)号：US20250118009A1
公开(公告)日：2025-04-10
申请号：US18903348
申请日：2024-10-01
Applicant: NEC Laboratories America, Inc.
Inventor： Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Manmohan Chandraker , Shanlin Sun
IPC: G06T15/08 , G01S17/89 , G06V10/774 , G06V20/52
Abstract: A computer-implemented method for synthesizing an image includes capturing data from a scene and fusing grid-based representations of the scene from different encodings to inherit beneficial properties of the different encodings, The encodings include Lidar encoding and a high definition map encoding. Rays are rendered from fused grid-based representations. A density and color are determined for points in the rays. A volume rendering is employed for the rays with the density and color. An image is synthesized from the volume rendered rays with the density and the color.
-
公开(公告)号：US20250117029A1
公开(公告)日：2025-04-10
申请号：US18905280
申请日：2024-10-03
Applicant: NEC Laboratories America, Inc.
Inventor： Tom Bu , Bingbing Zhuang , Manmohan Chandraker
IPC: G05D1/86 , G05D1/242 , G05D1/243 , G05D107/60 , G05D111/67
Abstract: Systems and methods for automatic multi-modality sensor calibration with near-infrared images (NIR). Image keypoints from collected images and NIR keypoints from NIR can be detected. A deep-learning-based neural network that learns relation graphs between the image keypoints and the NIR keypoints can match the image keypoints and the NIR keypoints. Three dimensional (3D) points from 3D point cloud data can be filtered based on corresponding 3D points from the NIR keypoints (NIR-to-3D points) to obtain filtered NIR-to-3D points. An extrinsic calibration can be optimized based on a reprojection error computed from the filtered NIR-to-3D points to obtain an optimized extrinsic calibration for an autonomous entity control system. An entity can be controlled by employing the optimized extrinsic calibration for the autonomous entity control system.
-
公开(公告)号：US20250115278A1
公开(公告)日：2025-04-10
申请号：US18905695
申请日：2024-10-03
Applicant: NEC Laboratories America, Inc.
Inventor： Francesco Pittaluga , Buyu Liu , Manmohan Chandraker , Kaiyuan Zhang
IPC: B60W60/00
Abstract: Systems and methods for generating adversarial driving scenarios for autonomous vehicles. An artificial intelligence model can compute an adversarial loss function by minimizing the distance between predicted adversarial perturbed trajectories and corresponding generated neighbor future trajectories from input data. A traffic violation loss function can be computed based on observed adversarial agents adhering to driving rules from the input data. A comfort loss function can be computed based on the predicted driving characteristics of adversarial vehicles relevant to comfort of hypothetical passengers from the input data. A planner module can be trained for autonomous vehicles based on a combined loss function of the adversarial loss function, the traffic violation loss function and the comfort loss function to generate adversarial driving scenarios. An autonomous vehicle can be controlled based on trajectories generated in the adversarial driving scenarios.
-
公开(公告)号：US12205356B2
公开(公告)日：2025-01-21
申请号：US18188766
申请日：2023-03-23
Applicant: NEC Laboratories America, Inc.
Inventor： Samuel Schulter , Sparsh Garg , Manmohan Chandraker
IPC: G06V10/776 , G06T7/00 , G06T7/11 , G06V10/74 , G06V10/774 , G06V20/70 , H04N17/00
Abstract: Methods and systems for detecting faults include capturing an image of a scene using a camera. The image is embedded using a segmentation model that includes an image branch having an image embedding layer that embeds images into a joint latent space and a text branch having a text embedding layer that embeds text into the joint latent space. Semantic information is generated for a region of the image corresponding to a predetermined static object using the embedded image. A fault of the camera is identified based on a discrepancy between the semantic information and semantic information of the predetermined static image. The fault of the camera is corrected.
-
-
-
-
-
-
-
-
-
Search Results
230
records
(took 0.02 seconds)
