-
公开(公告)号:US11055989B2
公开(公告)日:2021-07-06
申请号:US16051924
申请日:2018-08-01
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Luan Tran , Xiang Yu , Manmohan Chandraker
IPC: G08G1/017 , G06K9/62 , G06K9/00 , G06N3/08 , G06N3/04 , G06N5/04 , G06T17/00 , G06N20/00 , G08G1/01 , G08G1/04 , G08G1/048 , G06K9/46
Abstract: Systems and methods for performing domain adaptation include collecting a labeled source image having a view of an object. Viewpoints of the object in the source image are synthesized to generate view augmented source images. Photometrics of each of the viewpoints of the object are adjusted to generate lighting and view augmented source images. Features are extracted from each of the lighting and view augmented source images with a first feature extractor and from captured images captured by an image capture device with a second feature extractor. The extracted features are classified using domain adaptation with domain adversarial learning between extracted features of the captured images and extracted features of the lighting and view augmented source images. Labeled target images are displayed corresponding to each of the captured images including labels corresponding to classifications of the extracted features of the captured images.
-
公开(公告)号:US20200089966A1
公开(公告)日:2020-03-19
申请号:US16567236
申请日:2019-09-11
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Manmohan Chandraker , Shuyang Dai , Kihyuk Sohn
Abstract: Systems and methods for recognizing fine-grained objects are provided. The system divides unlabeled training data from a target domain into two or more target subdomains using an attribute annotation. The system ranks the target subdomains based on a similarity to the source domain. The system applies multiple domain discriminators between each of the target subdomains and a mixture of the source domain and preceding target domains. The system recognizes, using the multiple domain discriminators for the target domain, fine-grained objects.
-
公开(公告)号:US20200082221A1
公开(公告)日:2020-03-12
申请号:US16535681
申请日:2019-08-08
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Kihyuk Sohn , Buyu Liu , Manmohan Chandraker , Jong-Chyi Su
Abstract: Systems and methods for domain adaptation are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.
-
公开(公告)号:US10474881B2
公开(公告)日:2019-11-12
申请号:US15888693
申请日:2018-02-05
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Kihyuk Sohn , Manmohan Chandraker
Abstract: A video retrieval system is provided that includes a server for retrieving video sequences from a remote database responsive to a text specifying a face recognition result as an identity of a subject of an input image. The face recognition result is determined by a processor of the server, which estimates, using a 3DMM conditioned Generative Adversarial Network, 3DMM coefficients for the subject of the input image. The subject varies from an ideal front pose. The processor produces a synthetic frontal face image of the subject of the input image based on the input image and coefficients. An area spanning the frontal face of the subject is made larger in the synthetic than in the input image. The processor provides a decision of whether the synthetic image subject is an actual person and provides the identity of the subject in the input image based on the synthetic and input images.
-
公开(公告)号:US20190138811A1
公开(公告)日:2019-05-09
申请号:US16111298
申请日:2018-08-24
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Manmohan Chandraker , Xiang Yu
Abstract: A computer-implemented method, system, and computer program product are provided for activity recognition. The method includes receiving, by a processor, a plurality of videos, the plurality of videos including labeled videos and unlabeled videos. The method also includes extracting, by the processor with a feature extraction convolutional neural network (CNN), frame features for frames from each of the plurality of videos. The method additionally includes estimating, by the processor with a feature aggregation system, a vector representation for one of the plurality of videos responsive to the frame features. The method further includes classifying, by the processor, an activity from the vector representation. The method also includes controlling an operation of a processor-based machine to react in accordance with the activity.
-
26.
公开(公告)号:US20180268203A1
公开(公告)日:2018-09-20
申请号:US15889913
申请日:2018-02-06
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Xiang Yu , Manmohan Chandraker
CPC classification number: G06K9/66 , G06K9/00268 , G06K9/00288 , G06K9/00718 , G06K9/00744 , G06K9/00771 , G06K9/4628 , G06K9/6201 , G06K9/6217 , G06K9/6262 , G06K9/6274 , G06K2009/00738 , G06N3/02 , G06N3/0454 , G06N3/08 , G06N3/088 , G06N20/00 , G06T7/70 , G06T9/002 , G06T2207/20081 , G08B13/196 , G08B13/19613
Abstract: A face recognition system is provided that includes a device configured to capture a video sequence formed from a set of unlabeled testing video frames. The system includes a processor configured to pre-train a face recognition engine formed from reference CNNs on a still image domain that includes labeled training still image frames of faces. The processor adapts the face recognition engine to a video domain to form an adapted engine, by applying non-reference CNNs to domains including the still image and video domains and a degraded image domain. The degraded image domain includes labeled synthetically degraded versions of the frames included in the still image domain. The video domain includes random unlabeled training video frames. The processor recognizes, using the adapted engine, identities of persons corresponding to at least one face in the video sequence to obtain a set of identities. A display device displays the set of identities.
-
公开(公告)号:US20180268055A1
公开(公告)日:2018-09-20
申请号:US15888693
申请日:2018-02-05
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Kihyuk Sohn , Manmohan Chandraker
CPC classification number: G06K9/00288 , G06F16/71 , G06F16/743 , G06F16/784 , G06K9/00201 , G06K9/00208 , G06K9/00214 , G06K9/00255 , G06K9/00275 , G06K9/00771 , G06K9/00899 , G06K9/4628 , G06K9/6256 , G06T19/20 , G06T2210/44
Abstract: A video retrieval system is provided that includes a server for retrieving video sequences from a remote database responsive to a text specifying a face recognition result as an identity of a subject of an input image. The face recognition result is determined by a processor of the server, which estimates, using a 3DMM conditioned Generative Adversarial Network, 3DMM coefficients for the subject of the input image. The subject varies from an ideal front pose. The processor produces a synthetic frontal face image of the subject of the input image based on the input image and coefficients. An area spanning the frontal face of the subject is made larger in the synthetic than in the input image. The processor provides a decision of whether the synthetic image subject is an actual person and provides the identity of the subject in the input image based on the synthetic and input images.
-
公开(公告)号:US11610420B2
公开(公告)日:2023-03-21
申请号:US17128565
申请日:2020-12-21
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Kihyuk Sohn , Buyu Liu , Manmohan Chandraker , Jong-Chyi Su
Abstract: Systems and methods for human detection are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The target domain includes humans in one or more different scenes. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.
-
公开(公告)号:US20210142046A1
公开(公告)日:2021-05-13
申请号:US17091066
申请日:2020-11-06
Applicant: NEC Laboratories America, Inc.
Inventor: Xiang Yu , Manmohan Chandraker , Kihyuk Sohn , Aruni RoyChowdhury
Abstract: A computer-implemented method for implementing face recognition includes obtaining a face recognition model trained on labeled face data, separating, using a mixture of probability distributions, a plurality of unlabeled faces corresponding to unlabeled face data into a set of one or more overlapping unlabeled faces that include overlapping identities to those in the labeled face data and a set of one or more disjoint unlabeled faces that include disjoint identities to those in the labeled face data, clustering the one or more disjoint unlabeled faces using a graph convolutional network to generate one or more cluster assignments, generating a clustering uncertainty associated with the one or more cluster assignments, and retraining the face recognition model on the labeled face data and the unlabeled face data to improve face recognition performance by incorporating the clustering uncertainty.
-
公开(公告)号:US20210110209A1
公开(公告)日:2021-04-15
申请号:US17128612
申请日:2020-12-21
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Kihyuk Sohn , Buyu Liu , Manmohan Chandraker , Jong-Chyi Su
Abstract: Systems and methods for construction zone segmentation are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The target domain includes construction zones scenes having various objects. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.
-
-
-
-
-
-
-
-
-