-
公开(公告)号:US20200151940A1
公开(公告)日:2020-05-14
申请号:US16673256
申请日:2019-11-04
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Feng-Ju Chang , Manmohan Chandraker
Abstract: A system is provided for pose-variant 3D facial attribute generation. A first stage has a hardware processor based 3D regression network for directly generating a space position map for a 3D shape and a camera perspective matrix from a single input image of a face and further having a rendering layer for rendering a partial texture map of the single input image based on the space position map and the camera perspective matrix. A second stage has a hardware processor based two-part stacked Generative Adversarial Network (GAN) including a Texture Completion GAN (TC-GAN) stacked with a 3D Attribute generation GAN (3DA-GAN). The TC-GAN completes the partial texture map to form a complete texture map based on the partial texture map and the space position map. The 3DA-GAN generates a target facial attribute for the single input image based on the complete texture map and the space position map.
-
公开(公告)号:US20200089966A1
公开(公告)日:2020-03-19
申请号:US16567236
申请日:2019-09-11
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Manmohan Chandraker , Shuyang Dai , Kihyuk Sohn
Abstract: Systems and methods for recognizing fine-grained objects are provided. The system divides unlabeled training data from a target domain into two or more target subdomains using an attribute annotation. The system ranks the target subdomains based on a similarity to the source domain. The system applies multiple domain discriminators between each of the target subdomains and a mixture of the source domain and preceding target domains. The system recognizes, using the multiple domain discriminators for the target domain, fine-grained objects.
-
公开(公告)号:US20200082221A1
公开(公告)日:2020-03-12
申请号:US16535681
申请日:2019-08-08
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Kihyuk Sohn , Buyu Liu , Manmohan Chandraker , Jong-Chyi Su
Abstract: Systems and methods for domain adaptation are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.
-
公开(公告)号:US10474881B2
公开(公告)日:2019-11-12
申请号:US15888693
申请日:2018-02-05
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Kihyuk Sohn , Manmohan Chandraker
Abstract: A video retrieval system is provided that includes a server for retrieving video sequences from a remote database responsive to a text specifying a face recognition result as an identity of a subject of an input image. The face recognition result is determined by a processor of the server, which estimates, using a 3DMM conditioned Generative Adversarial Network, 3DMM coefficients for the subject of the input image. The subject varies from an ideal front pose. The processor produces a synthetic frontal face image of the subject of the input image based on the input image and coefficients. An area spanning the frontal face of the subject is made larger in the synthetic than in the input image. The processor provides a decision of whether the synthetic image subject is an actual person and provides the identity of the subject in the input image based on the synthetic and input images.
-
公开(公告)号:US10332274B2
公开(公告)日:2019-06-25
申请号:US15711349
申请日:2017-09-21
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Wongun Choi , Bharat Singh , Manmohan Chandraker
IPC: G06K9/00 , G06T7/73 , G06T7/20 , B60W30/09 , B60W30/095 , G06T7/292 , G06T7/246 , G06F3/0482 , G08B21/02 , G06K9/32 , G06T9/00 , G06N3/02
Abstract: A surveillance system and method are provided. The surveillance system includes an image capture device configured to capture a video sequence of a target area that includes a set of objects and is formed from a set of image frames. The surveillance system also includes a processor. The processor is configured to detect the objects to form object detections, and track the object detections over the frames to form tracked detections. The processor is further configured to generate for a current input frame, responsive to conditions, a set of sparse object proposals for a current location of an object based on: (i) the tracked detections of the object from an immediately previous frame; and (ii) detection proposals for the object derived from the current frame. The processor is additionally configured to provide a user perceptible indication of the current location of the object, based on the sparse object proposals.
-
公开(公告)号:US10289822B2
公开(公告)日:2019-05-14
申请号:US15637264
申请日:2017-06-29
Applicant: NEC Laboratories America, Inc. , NEC Hong Kong Limited
Inventor: Manmohan Chandraker , Xiang Yu , Eric Lau , Elsa Wong
IPC: G06K9/00 , G06F21/32 , G06N20/00 , G06N99/00 , G07C9/00 , H04L29/06 , G06F21/62 , G06K9/46 , G06K9/66
Abstract: A face recognition system and corresponding method are provided. The face recognition system includes a camera configured to capture an input image of a subject purported to be a person. The face recognition system further includes a memory storing a deep learning model configured to perform multi-task learning for a pair of tasks including a liveness detection task and a face recognition task. The face recognition system also includes a processor configured to apply the deep learning model to the input image to recognize an identity of the subject in the input image and a liveness of the subject. The liveness detection task is configured to evaluate a plurality of different distractor modalities corresponding to different physical spoofing materials to prevent face spoofing for the face recognition task.
-
公开(公告)号:US20190138811A1
公开(公告)日:2019-05-09
申请号:US16111298
申请日:2018-08-24
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Manmohan Chandraker , Xiang Yu
Abstract: A computer-implemented method, system, and computer program product are provided for activity recognition. The method includes receiving, by a processor, a plurality of videos, the plurality of videos including labeled videos and unlabeled videos. The method also includes extracting, by the processor with a feature extraction convolutional neural network (CNN), frame features for frames from each of the plurality of videos. The method additionally includes estimating, by the processor with a feature aggregation system, a vector representation for one of the plurality of videos responsive to the frame features. The method further includes classifying, by the processor, an activity from the vector representation. The method also includes controlling an operation of a processor-based machine to react in accordance with the activity.
-
168.
公开(公告)号:US20190065868A1
公开(公告)日:2019-02-28
申请号:US16029167
申请日:2018-07-06
Applicant: NEC Laboratories America, Inc.
Inventor: Quoc-Huy Tran , Mohammed E.F. Salem , Muhammad Zeeshan Zia , Paul Vernaza , Manmohan Chandraker
CPC classification number: G06K9/00798 , G06K9/00785 , G06K9/00825 , G06K9/46 , G06K9/4628 , G06K9/6262 , G06K9/6274 , G06K9/6276 , G06K9/629 , G06K9/66 , G06N3/0454 , G06N3/08 , G06T17/05 , G06T2200/08 , G06T2207/20081
Abstract: Systems and methods for detecting traffic scenarios include an image capturing device which captures two or more images of an area of a traffic environment with each image having a different view of vehicles and a road in the traffic environment. A hierarchical feature extractor concurrently extracts features at multiple neural network layers from each of the images, with the features including geometric features and semantic features, and for estimating correspondences between semantic features for each of the images and refining the estimated correspondences with correspondences between the geometric features of each of the images to generate refined correspondence estimates. A traffic localization module uses the refined correspondence estimates to determine locations of vehicles in the environment in three dimensions to automatically determine a traffic scenario according to the locations of vehicles. A notification device generates a notification of the traffic scenario.
-
公开(公告)号:US20190063932A1
公开(公告)日:2019-02-28
申请号:US16100462
申请日:2018-08-10
Applicant: NEC Laboratories America, Inc.
Inventor: Quoc-Huy Tran , Manmohan Chandraker , Hyo Jin Kim
Abstract: A computer-implemented method, system, and computer program product are provided for a guidance control system utilizing pose estimation in an autonomous vehicle. The method includes receiving, by a pose estimation system, a plurality of images from one or more cameras. The method also includes predicting, by the pose estimation system, a pose from the score map and a combined feature map, the combined feature map correlated from a pair of the plurality of images. The method additionally includes moving, by a propulsion system, the autonomous vehicle responsive to the pose.
-
170.
公开(公告)号:US20180268203A1
公开(公告)日:2018-09-20
申请号:US15889913
申请日:2018-02-06
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Xiang Yu , Manmohan Chandraker
CPC classification number: G06K9/66 , G06K9/00268 , G06K9/00288 , G06K9/00718 , G06K9/00744 , G06K9/00771 , G06K9/4628 , G06K9/6201 , G06K9/6217 , G06K9/6262 , G06K9/6274 , G06K2009/00738 , G06N3/02 , G06N3/0454 , G06N3/08 , G06N3/088 , G06N20/00 , G06T7/70 , G06T9/002 , G06T2207/20081 , G08B13/196 , G08B13/19613
Abstract: A face recognition system is provided that includes a device configured to capture a video sequence formed from a set of unlabeled testing video frames. The system includes a processor configured to pre-train a face recognition engine formed from reference CNNs on a still image domain that includes labeled training still image frames of faces. The processor adapts the face recognition engine to a video domain to form an adapted engine, by applying non-reference CNNs to domains including the still image and video domains and a degraded image domain. The degraded image domain includes labeled synthetically degraded versions of the frames included in the still image domain. The video domain includes random unlabeled training video frames. The processor recognizes, using the adapted engine, identities of persons corresponding to at least one face in the video sequence to obtain a set of identities. A display device displays the set of identities.
-
-
-
-
-
-
-
-
-