-
公开(公告)号:US20180268055A1
公开(公告)日:2018-09-20
申请号:US15888693
申请日:2018-02-05
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Kihyuk Sohn , Manmohan Chandraker
CPC classification number: G06K9/00288 , G06F16/71 , G06F16/743 , G06F16/784 , G06K9/00201 , G06K9/00208 , G06K9/00214 , G06K9/00255 , G06K9/00275 , G06K9/00771 , G06K9/00899 , G06K9/4628 , G06K9/6256 , G06T19/20 , G06T2210/44
Abstract: A video retrieval system is provided that includes a server for retrieving video sequences from a remote database responsive to a text specifying a face recognition result as an identity of a subject of an input image. The face recognition result is determined by a processor of the server, which estimates, using a 3DMM conditioned Generative Adversarial Network, 3DMM coefficients for the subject of the input image. The subject varies from an ideal front pose. The processor produces a synthetic frontal face image of the subject of the input image based on the input image and coefficients. An area spanning the frontal face of the subject is made larger in the synthetic than in the input image. The processor provides a decision of whether the synthetic image subject is an actual person and provides the identity of the subject in the input image based on the synthetic and input images.
-
公开(公告)号:US20180137370A1
公开(公告)日:2018-05-17
申请号:US15711349
申请日:2017-09-21
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Bharat Singh , Manmohan Chandraker
CPC classification number: G06T7/74 , B60W30/09 , B60W30/0956 , G06F3/0482 , G06K9/00744 , G06K9/00771 , G06K9/00785 , G06K9/00791 , G06K9/00805 , G06K9/3241 , G06N3/02 , G06T7/20 , G06T7/246 , G06T7/292 , G06T9/002 , G06T2200/28 , G06T2207/10016 , G06T2207/20084 , G06T2207/30232 , G06T2210/12 , G08B21/02
Abstract: A surveillance system and method are provided. The surveillance system includes an image capture device configured to capture a video sequence of a target area that includes a set of objects and is formed from a set of image frames. The surveillance system also includes a processor. The processor is configured to detect the objects to form object detections, and track the object detections over the frames to form tracked detections. The processor is further configured to generate for a current input frame, responsive to conditions, a set of sparse object proposals for a current location of an object based on: (i) the tracked detections of the object from an immediately previous frame; and (ii) detection proposals for the object derived from the current frame. The processor is additionally configured to provide a user perceptible indication of the current location of the object, based on the sparse object proposals.
-
173.
公开(公告)号:US20180130355A1
公开(公告)日:2018-05-10
申请号:US15709814
申请日:2017-09-20
Applicant: NEC Laboratories America, Inc.
Inventor: Muhammad Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Manmohan Chandraker , Chi Li
CPC classification number: G06K9/6256 , B60T2201/022 , B60W30/00 , G05D1/0221 , G06F17/5009 , G06K9/00201 , G06K9/00208 , G06K9/00624 , G06K9/00771 , G06K9/00805 , G06K9/4628 , G06K9/6255 , G06N3/02 , G06N3/084 , G06T7/55 , G06T7/74 , G06T11/60 , G06T15/10 , G06T15/40 , G06T2207/20101 , G06T2207/30261 , G06T2210/22 , G08G1/0962 , G08G1/166 , H04N7/00
Abstract: A system and method are provided for driving assistance. The system includes an image capture device configured to capture an actual image relative to an outward view from a motor vehicle and depicting an object. The system further includes a processor configured to render, based on a set of 3D CAD models, synthetic images with corresponding intermediate shape concept labels. The processor is further configured to form a multi-layer CNN which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is also configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN to the actual image to output an image pair including a 2D and 3D geometric structure of the object. The processor is additionally configured to perform an action to mitigate a likelihood of harm involving the motor vehicle, based on the image pair.
-
174.
公开(公告)号:US20180129912A1
公开(公告)日:2018-05-10
申请号:US15801688
申请日:2017-11-02
Applicant: NEC Laboratories America, Inc.
Inventor: Paul Vernaza , Manmohan Chandraker
CPC classification number: G06K9/6256 , G06K9/00791 , G06K9/6259 , G06K9/627 , G06N3/0454 , G06N3/084 , G06T7/10 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2207/30241 , G08G1/166
Abstract: Systems and methods for training semantic segmentation. Embodiments of the present invention include predicting semantic labeling of each pixel in each of at least one training image using a semantic segmentation model. Further included is predicting semantic boundaries at boundary pixels of objects in the at least one training image using a semantic boundary model concurrently with predicting the semantic labeling. Also included is propagating sparse labels to every pixel in the at least one training image using the predicted semantic boundaries. Additionally, the embodiments include optimizing a loss function according the predicted semantic labeling and the propagated sparse labels to concurrently train the semantic segmentation model and the semantic boundary model to accurately and efficiently generate a learned semantic segmentation model from sparsely annotated training images.
-
175.
公开(公告)号:US20180129865A1
公开(公告)日:2018-05-10
申请号:US15709897
申请日:2017-09-20
Applicant: NEC Laboratories America, Inc.
Inventor: Muhammad Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Manmohan Chandraker , Chi Li
CPC classification number: G06K9/6256 , B60T2201/022 , B60W30/00 , G05D1/0221 , G06F17/5009 , G06K9/00201 , G06K9/00208 , G06K9/00624 , G06K9/00771 , G06K9/00805 , G06K9/4628 , G06K9/6255 , G06N3/02 , G06N3/0454 , G06N3/082 , G06N3/084 , G06T7/55 , G06T7/74 , G06T11/60 , G06T15/10 , G06T15/40 , G06T2207/20101 , G06T2207/30261 , G06T2210/22 , G08G1/0962 , G08G1/166 , H04N7/00
Abstract: An action recognition system and method are provided. The action recognition system includes an image capture device configured to capture an actual image depicting an object. The action recognition system includes a processor configured to render, based on a set of 3D CAD models, synthetic images with corresponding intermediate shape concept labels. The processor is configured to form a multi-layer CNN which jointly models multiple intermediate shape concepts, based on the rendered synthetic images. The processor is configured to perform an intra-class appearance variation-aware and occlusion-aware 3D object parsing on the actual image by applying the CNN thereto to generate an image pair including a 2D and 3D geometric structure of the object. The processor is configured to control a device to perform a response action in response to an identification of an action performed by the object, wherein the identification of the action is based on the image pair.
-
公开(公告)号:US20180046646A1
公开(公告)日:2018-02-15
申请号:US15637533
申请日:2017-06-29
Applicant: NEC Laboratories America, Inc. , NEC Hong Kong Limited
Inventor: Manmohan Chandraker , Wongun Choi , Eric Lau , Elsa Wong , Guobin Chen
CPC classification number: G08B21/0205 , G06F17/30256 , G06F17/30259 , G06K9/00067 , G06N99/005 , G08B21/0208 , G08B21/0222 , G08B21/0461 , G08B21/24
Abstract: A mass transit surveillance system and corresponding method are provided. The mass transit surveillance system includes a camera configured to capture an input image of a subject purported to be a baby and presented at a mass transit environment. The mass transit surveillance system further includes a memory storing a deep learning model configured to perform a baby detection task for the mass transit environment. The mass transit surveillance system also includes a processor configured to apply the deep learning model to the input image to provide a baby detection result of either a presence or an absence of an actual baby in relation to the subject purported to be the baby. The baby detection task is configured to evaluate one or more different distractor modalities corresponding to one or more different physical spoofing materials to prevent baby spoofing for the baby detection task.
-
公开(公告)号:US20180025213A1
公开(公告)日:2018-01-25
申请号:US15637368
申请日:2017-06-29
Applicant: NEC Laboratories America, Inc. , NEC Hong Kong Limited
Inventor: Manmohan Chandraker , Xiang Yu , Eric Lau , Elsa Wong
IPC: G06K9/00
CPC classification number: G06F21/32 , G06F21/6218 , G06F2221/2133 , G06K9/00221 , G06K9/00228 , G06K9/00255 , G06K9/00281 , G06K9/00288 , G06K9/00624 , G06K9/00791 , G06K9/00906 , G06K9/4652 , G06K9/66 , G06N99/005 , G07C9/00158 , G07C9/00166 , H04L63/0861 , H04L63/1483
Abstract: A traffic enforcement system and corresponding method are provided. The traffic enforcement system includes a camera configured to capture an input image of one or more subjects in a motor vehicle. The traffic enforcement system further includes a memory storing a deep learning model configured to perform multi-task learning for a pair of tasks including a liveness detection task and a face recognition task on one or more subjects in a motor vehicle depicted in the input image. The traffic enforcement system also includes a processor configured to apply the deep learning model to the input image to recognize an identity the one or more subjects in the motor vehicle and a liveness of the one or more subjects. The liveness detection task is configured to evaluate a plurality of different distractor modalities corresponding to different physical spoofing materials to prevent face spoofing for the face recognition task.
-
公开(公告)号:US09367922B2
公开(公告)日:2016-06-14
申请号:US14639536
申请日:2015-03-05
Applicant: NEC Laboratories America, Inc.
Inventor: Manmohan Chandraker , Shiyu Song
IPC: G06T7/00
CPC classification number: G06T7/0071 , G06T7/20 , G06T7/579 , G06T7/70 , G06T2207/10016 , G06T2207/10028
Abstract: Methods and systems for moving object localization include estimating a ground plane in a video frame based on a detected object within the video frame and monocular structure-from-motion (SFM) information; computing object pose for objects in the frame based on the SFM information using dense feature tracking; and determining a three-dimensional location for the detected object based on the estimated ground plane and the computed object pose.
Abstract translation: 用于移动对象定位的方法和系统包括基于视频帧内的检测对象和单目动作(SFM)信息来估计视频帧中的接地平面; 基于使用密集特征跟踪的SFM信息计算帧中对象的物体姿态; 以及基于估计的接地平面和所计算的物体姿态来确定被检测物体的三维位置。
-
179.
公开(公告)号:US08879851B2
公开(公告)日:2014-11-04
申请号:US13716294
申请日:2012-12-17
Applicant: NEC Laboratories America, Inc.
Inventor: Manmohan Chandraker , Kai Yu
CPC classification number: G06K9/6267 , G06T7/579 , G06T2207/10016 , G06T2207/10024 , G06T2207/10152 , G06T2207/30244
Abstract: A computer implemented method for determining shape from differential motion with unknown reflectance includes deriving a general relation that relates spatial and temporal image derivatives to bidirectional reflectance distribution function BRDF derivatives, responsive to 3D points and relative camera poses from images and feature tracks of an object in motion under colocated and unknown directional light conditions, employing a rank deficiency in image sequences from the deriving for shape determinations, under predetermined multiple camera and lighting conditions, to eliminate BDRF terms; and recovering a surface depth for determining a shape of the object.
Abstract translation: 用于根据具有未知反射的差分运动来确定形状的计算机实现方法包括导出将空间和时间图像导数与双向反射分布函数BRDF导数相关联的一般关系,其响应于来自图像中的3D点和相对相机姿态的对象的图像和特征轨迹 在预定的多个照相机和照明条件下,在共定位和未知的定向光条件下运动,在来自形状确定的图像序列中使用秩缺陷,以消除BDRF项; 以及恢复用于确定所述物体的形状的表面深度。
-
公开(公告)号:US20140078258A1
公开(公告)日:2014-03-20
申请号:US13858040
申请日:2013-04-06
Applicant: NEC LABORATORIES AMERICA, INC.
Inventor: Manmohan Chandraker , Shiyu Song
IPC: H04N13/02
CPC classification number: H04N13/204 , G06T7/579 , G06T7/74 , G06T2207/30244 , G06T2207/30252
Abstract: Systems and methods are disclosed for multithreaded visual odometry by acquired with a single camera on-board a vehicle; using 2D-3D correspondences for continuous pose estimation; and combining the pose estimation with 2D-2D epipolar search to replenish 3D points.
Abstract translation: 公开了通过用车上单个摄像机采集的用于多线程视觉测距的系统和方法; 使用2D-3D对应连续姿态估计; 并将姿态估计与2D-2D对极搜索相结合,以补充3D点。
-
-
-
-
-
-
-
-
-