-
公开(公告)号:US10402983B2
公开(公告)日:2019-09-03
申请号:US15695625
申请日:2017-09-05
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Paul Vernaza , Manmohan Chandraker
Abstract: A surveillance system and method are provided. The surveillance system includes at least one camera configured to capture a set of images of a given target area that includes a set of objects to be tracked. The surveillance system includes a memory storing a learning model configured to perform multi-object tracking by jointly learning arbitrarily parameterized and differentiable cost functions for all variables in a linear program that associates object detections with bounding boxes to form trajectories. The surveillance system includes a processor configured to perform surveillance of the target area to (i) detect the objects and track locations of the objects by applying the learning model to the images in a surveillance task that uses the multi-object tracking, and (ii), provide a listing of the objects and their locations for surveillance task. A bi-level optimization is used to minimize a loss defined on a solution of the linear program.
-
公开(公告)号:US10402701B2
公开(公告)日:2019-09-03
申请号:US15889913
申请日:2018-02-06
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Xiang Yu , Manmohan Chandraker
IPC: G06K9/00 , G06K9/66 , G06N3/08 , G06N20/00 , G06K9/62 , G06T7/70 , G06T9/00 , G06K9/46 , G06N3/02 , G08B13/196 , G06N3/04
Abstract: A face recognition system is provided that includes a device configured to capture a video sequence formed from a set of unlabeled testing video frames. The system includes a processor configured to pre-train a face recognition engine formed from reference CNNs on a still image domain that includes labeled training still image frames of faces. The processor adapts the face recognition engine to a video domain to form an adapted engine, by applying non-reference CNNs to domains including the still image and video domains and a degraded image domain. The degraded image domain includes labeled synthetically degraded versions of the frames included in the still image domain. The video domain includes random unlabeled training video frames. The processor recognizes, using the adapted engine, identities of persons corresponding to at least one face in the video sequence to obtain a set of identities. A display device displays the set of identities.
-
公开(公告)号:US10347007B2
公开(公告)日:2019-07-09
申请号:US15711214
申请日:2017-09-21
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Bharat Singh , Manmohan Chandraker
IPC: G06K9/00 , G06T7/73 , G06T7/20 , B60W30/09 , B60W30/095 , G06T7/292 , G06T7/246 , G06F3/0482 , G08B21/02 , G06K9/32 , G06T9/00 , G06N3/02
Abstract: A system and method are provided. The system includes an image capture device configured to capture a video sequence formed from a set of input image frames and including a set of objects. The system further includes a processor configured to detect the objects to form object detections and track the object detections over the input frames to form tracked detections. The processor is also configured to generate for a current input frame, responsive to conditions, a set of sparse object proposals for a current location of an object based on: (i) the tracked detections of the object from an immediately previous input frame; and (ii) detection proposals for the object derived from the current frame. The processor is additionally configured to provide a user perceptible indication of the current location of the object, based on the set of sparse object proposals.
-
公开(公告)号:US10339671B2
公开(公告)日:2019-07-02
申请号:US15711373
申请日:2017-09-21
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Bharat Singh , Manmohan Chandraker
IPC: G06K9/00 , G06T7/73 , G06T7/20 , B60W30/09 , B60W30/095 , G06T7/292 , G06T7/246 , G06F3/0482 , G08B21/02 , G06K9/32 , G06T9/00 , G06N3/02
Abstract: An action recognition system and method are provided. The system includes an image capture device configured to capture a video sequence formed from image frames and depicting a set of objects. The system includes a processor configured to detect the objects to form object detections. The processor is configured to track the object detections over the frames to form tracked detections. The processor is configured to generate for a current frame, responsive to conditions, sparse object proposals for a current location of an object based on: (i) the tracked detections of the object from an immediately previous frame; and (ii) detection proposals for the object derived from the current frame. The processor is configured to control a hardware device to perform a response action in response to an identification of an action type of an action performed by the object, the identification being based on the sparse object proposals.
-
公开(公告)号:US10332264B2
公开(公告)日:2019-06-25
申请号:US15695565
申请日:2017-09-05
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Paul Vernaza , Manmohan Chandraker
Abstract: A multi-object tracking system and method are provided. The multi-object tracking system includes at least one camera configured to capture a set of input images of a set of objects to be tracked. The multi-object tracking system further includes a memory storing a learning model configured to perform multi-object tracking by jointly learning arbitrarily parameterized and differentiable cost functions for all variables in a linear program that associates object detections with bounding boxes to form trajectories. The multi-object tracking system also includes a processor configured to (i) detect the objects and track locations of the objects by applying the learning model to the set of input images in a multi-object tracking task, and (ii), provide a listing of the objects and the locations of the objects for the multi-object tracking task. A bi-level optimization is used to minimize a loss defined on a solution of the linear program.
-
公开(公告)号:US10290196B2
公开(公告)日:2019-05-14
申请号:US15637433
申请日:2017-06-29
Applicant: NEC Laboratories America, Inc. , NEC Hong Kong Limited
Inventor: Manmohan Chandraker , Wongun Choi , Eric Lau , Elsa Wong , Guobin Chen
Abstract: A smuggling detection system and corresponding method are provided. The smuggling detection system includes a camera configured to capture an input image of a subject purported to be a baby. The smuggling detection system further includes a memory storing a deep learning model configured to perform a baby detection task for a smuggling detection application. The smuggling detection system also includes a processor configured to apply the deep learning model to the input image to provide a baby detection result of either a presence or an absence of an actual baby in relation to the subject purported to be the baby. The baby detection task is configured to evaluate one or more different distractor modalities corresponding to one or more different physical spoofing materials to prevent baby spoofing for the baby detection task.
-
公开(公告)号:US20190095699A1
公开(公告)日:2019-03-28
申请号:US16145578
申请日:2018-09-28
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Xi Yin , Kihyuk Sohn , Manmohan Chandraker
Abstract: A computer-implemented method, system, and computer program product are provided for facial recognition. The method includes receiving, by a processor device, a plurality of images. The method also includes extracting, by the processor device with a feature extractor utilizing a convolutional neural network (CNN) with an enlarged intra-class variance of long-tail classes, feature vectors for each of the plurality of images. The method additionally includes generating, by the processor device with a feature generator, discriminative feature vectors for each of the feature vectors. The method further includes classifying, by the processor device utilizing a fully connected classifier, an identity from the discriminative feature vector. The method also includes control an operation of a processor-based machine to react in accordance with the identity.
-
公开(公告)号:US10204299B2
公开(公告)日:2019-02-12
申请号:US15342766
申请日:2016-11-03
Applicant: NEC Laboratories America, Inc.
Inventor: Manmohan Chandraker , Angjoo Kim
Abstract: A computer-implemented method for training a deep learning network is presented. The method includes receiving a first image and a second image, mining exemplar thin-plate spline (TPS) to determine transformations for generating point correspondences between the first and second images, using artificial point correspondences to train the deep neural network, learning and using the TPS transformation output through a spatial transformer, and applying heuristics for selecting an acceptable set of images to match for accurate reconstruction. The deep learning network learns to warp points in the first image to points in the second image.
-
公开(公告)号:US20180268201A1
公开(公告)日:2018-09-20
申请号:US15888629
申请日:2018-02-05
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Kihyuk Sohn , Manmohan Chandraker
CPC classification number: G06K9/00288 , G06F16/71 , G06F16/743 , G06F16/784 , G06K9/00201 , G06K9/00208 , G06K9/00214 , G06K9/00255 , G06K9/00275 , G06K9/00771 , G06K9/00899 , G06K9/4628 , G06K9/6256 , G06T19/20 , G06T2210/44
Abstract: A face recognition system is provided. The system includes a device configured to capture an input image of a subject. The system further includes a processor. The processor estimates, using a 3D Morphable Model (3DMM) conditioned Generative Adversarial Network, 3DMM coefficients for the subject of the input image. The subject varies from an ideal front pose. The processor produces, using an image generator, a synthetic frontal face image of the subject of the input image based on the input image and the 3DMM coefficients. An area spanning the frontal face of the subject is made larger in the synthetic image than in the input image. The processor provides, using a discriminator, a decision indicative of whether the subject of the synthetic image is an actual person. The processor provides, using a face recognition engine, an identity of the subject in the input image based on the synthetic and input images.
-
公开(公告)号:US20180247429A1
公开(公告)日:2018-08-30
申请号:US15965480
申请日:2018-04-27
Applicant: NEC Laboratories America, Inc.
Inventor: Manmohan Chandraker , Shiyu Song
CPC classification number: G06T7/74 , G05D1/0088 , G05D1/0251 , G05D1/0253 , G05D2201/0213 , G06K9/00664 , G06K9/00791 , G06K9/00798 , G06T7/277 , G06T7/579 , G06T7/73 , G06T2207/10012 , G06T2207/10016 , G06T2207/20081 , G06T2207/20164 , G06T2207/30244 , G06T2207/30252 , G06T2207/30256
Abstract: Systems and methods are described for multithreaded navigation assistance by acquired with a single camera on-board a vehicle, using 2D-3D correspondences for continuous pose estimation, and combining the pose estimation with 2D-2D epipolar search to replenish 3D points.
-
-
-
-
-
-
-
-
-