-
公开(公告)号:US12080100B2
公开(公告)日:2024-09-03
申请号:US17519986
申请日:2021-11-05
Applicant: NEC Laboratories America, Inc.
Inventor: Yumin Suh , Xiang Yu , Yi-Hsuan Tsai , Masoud Faraki , Manmohan Chandraker
IPC: G06V40/16 , G06F18/214 , G06V20/52 , G06V40/10
CPC classification number: G06V40/172 , G06F18/214 , G06V20/52 , G06V40/103
Abstract: A method for employing facial information in unsupervised person re-identification is presented. The method includes extracting, by a body feature extractor, body features from a first data stream, extracting, by a head feature extractor, head features from a second data stream, outputting a body descriptor vector from the body feature extractor, outputting a head descriptor vector from the head feature extractor, and concatenating the body descriptor vector and the head descriptor vector to enable a model to generate a descriptor vector.
-
公开(公告)号:US20240233314A1
公开(公告)日:2024-07-11
申请号:US18612606
申请日:2024-03-21
Applicant: NEC Laboratories America, Inc.
Inventor: Yumin Suh , Weijian Deng , Xiang Yu , Masoud Faraki , Manmohan Chandraker , Turgun Kashgari
IPC: G06V10/44 , G06Q30/0601 , G06T7/11 , G06T7/73 , G06V20/52 , G06V40/10 , G06V40/20 , G08B25/00 , G08G1/005 , G08G1/07
CPC classification number: G06V10/454 , G06Q30/0631 , G06T7/11 , G06T7/73 , G06V20/52 , G06V40/103 , G06V40/23 , G08B25/00 , G08G1/005 , G08G1/07
Abstract: A system for rich human analysis includes a memory and one or more processors in communication with the memory configured to extract images from camera in a surveillance system and feed the images to a person detection and tracking system that deciphers human activity tasks. Attributes of persons detected and tracked by the person detection and tracking system are estimated by a rich human analysis system to identify attributes in accordance with set criteria using a set of filters of deeper layers of convolutional layers of a feature extractor where the filters are divided into N groups trained on N corresponding tasks corresponding to task-specific heads such that one task is assigned to each group of the N groups and that each task loss updates only one subset of filters. One or more people that satisfy the attributes and the set criteria are identified.
-
公开(公告)号:US11987236B2
公开(公告)日:2024-05-21
申请号:US17408911
申请日:2021-08-23
Applicant: NEC Laboratories America, Inc.
Inventor: Pan Ji , Buyu Liu , Bingbing Zhuang , Manmohan Chandraker , Xiangyu Chen
CPC classification number: B60W30/09 , B60W30/0956 , G06F18/2193 , G06T7/215 , G06T7/251 , G08G1/166 , B60W2554/40 , G06T2207/20084 , G06T2207/30261
Abstract: A method provided for 3D object localization predicts pairs of 2D bounding boxes. Each pair corresponds to a detected object in each of the two consecutive input monocular images. The method generates, for each detected object, a relative motion estimation specifying a relative motion between the two images. The method constructs an object cost volume by aggregating temporal features from the two images using the pairs of 2D bounding boxes and the relative motion estimation to predict a range of object depth candidates and a confidence score for each object depth candidate and an object depth from the object depth candidates. The method updates the relative motion estimation based on the object cost volume and the object depth to provide a refined object motion and a refined object depth. The method reconstructs a 3D bounding box for each detected object based on the refined object motion and refined object depth.
-
公开(公告)号:US20230281977A1
公开(公告)日:2023-09-07
申请号:US18188766
申请日:2023-03-23
Applicant: NEC Laboratories America, Inc.
Inventor: Samuel Schulter , Sparsh Garg , Manmohan Chandraker
IPC: G06V10/776 , G06T7/11 , G06V20/70 , H04N17/00 , G06V10/774 , G06V10/74 , G06T7/00
CPC classification number: G06V10/776 , G06T7/11 , G06V20/70 , H04N17/002 , G06V10/774 , G06V10/761 , G06T7/0002 , G06T2207/20081 , G06T2207/20021 , G06T2207/20084
Abstract: Methods and systems for detecting faults include capturing an image of a scene using a camera. The image is embedded using a segmentation model that includes an image branch having an image embedding layer that embeds images into a joint latent space and a text branch having a text embedding layer that embeds text into the joint latent space. Semantic information is generated for a region of the image corresponding to a predetermined static object using the embedded image. A fault of the camera is identified based on a discrepancy between the semantic information and semantic information of the predetermined static image. The fault of the camera is corrected.
-
公开(公告)号:US11599974B2
公开(公告)日:2023-03-07
申请号:US17090508
申请日:2020-11-05
Applicant: NEC Laboratories America, Inc.
Inventor: Quoc-Huy Tran , Bingbing Zhuang , Pan Ji , Manmohan Chandraker
Abstract: A method for jointly removing rolling shutter (RS) distortions and blur artifacts in a single input RS and blurred image is presented. The method includes generating a plurality of RS blurred images from a camera, synthesizing RS blurred images from a set of GS sharp images, corresponding GS sharp depth maps, and synthesized RS camera motions by employing a structure-and-motion-aware RS distortion and blur rendering module to generate training data to train a single-view joint RS correction and deblurring convolutional neural network (CNN), and predicting an RS rectified and deblurred image from the single input RS and blurred image by employing the single-view joint RS correction and deblurring CNN.
-
公开(公告)号:US11580334B2
公开(公告)日:2023-02-14
申请号:US17128612
申请日:2020-12-21
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Kihyuk Sohn , Buyu Liu , Manmohan Chandraker , Jong-Chyi Su
Abstract: Systems and methods for construction zone segmentation are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The target domain includes construction zones scenes having various objects. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.
-
公开(公告)号:US11520923B2
公开(公告)日:2022-12-06
申请号:US16674425
申请日:2019-11-05
Applicant: NEC Laboratories America, Inc.
Inventor: Kihyuk Sohn , Manmohan Chandraker , Yi-Hsuan Tsai
Abstract: A method for protecting visual private data by preventing data reconstruction from latent representations of deep networks is presented. The method includes obtaining latent features from an input image and learning, via an adversarial reconstruction learning framework, privacy-preserving feature representations to maintain utility performance and prevent the data reconstruction by simulating a black-box model inversion attack by training a decoder to reconstruct the input image from the latent features and training an encoder to maximize a reconstruction error to prevent the decoder from inverting the latent features while minimizing the task loss.
-
148.
公开(公告)号:US11462112B2
公开(公告)日:2022-10-04
申请号:US16787727
申请日:2020-02-11
Applicant: NEC Laboratories America, Inc.
Inventor: Quoc-Huy Tran , Samuel Schulter , Paul Vernaza , Buyu Liu , Pan Ji , Yi-Hsuan Tsai , Manmohan Chandraker
Abstract: A method is provided in an Advanced Driver-Assistance System (ADAS). The method extracts, from an input video stream including a plurality of images using a multi-task Convolutional Neural Network (CNN), shared features across different perception tasks. The perception tasks include object detection and other perception tasks. The method concurrently solves, using the multi-task CNN, the different perception tasks in a single pass by concurrently processing corresponding ones of the shared features by respective different branches of the multi-task CNN to provide a plurality of different perception task outputs. Each respective different branch corresponds to a respective one of the different perception tasks. The method forms a parametric representation of a driving scene as at least one top-view map responsive to the plurality of different perception task outputs. The method controls an operation of the vehicle for collision avoidance responsive to the at least one top-view map indicating an impending collision.
-
公开(公告)号:US20220147761A1
公开(公告)日:2022-05-12
申请号:US17521057
申请日:2021-11-08
Applicant: NEC Laboratories America, Inc.
Inventor: Yi-Hsuan Tsai , Xiang Yu , Bingbing Zhuang , Manmohan Chandraker , Donghyun Kim
Abstract: Video methods and systems include extracting features of a first modality and a second modality from a labeled first training dataset in a first domain and an unlabeled second training dataset in a second domain. A video analysis model is trained using contrastive learning on the extracted features, including optimization of a loss function that includes a cross-domain regularization part and a cross-modality regularization part.
-
公开(公告)号:US20220067457A1
公开(公告)日:2022-03-03
申请号:US17412704
申请日:2021-08-26
Applicant: NEC Laboratories America, Inc.
Inventor: Francesco Pittaluga , Giovanni Milione , Xiang Yu , Manmohan Chandraker , Yi-Hsuan Tsai , Zaid Tasneem
Abstract: A method for acquiring privacy-enhancing encodings in an optical domain before image capture is presented. The method includes feeding a differentiable sensing model with a plurality of images to obtain encoded images, the differentiable sensing model including parameters for sensor optics, integrating the differentiable sensing model into an adversarial learning framework where parameters of attack networks, parameters of utility networks, and the parameters of the sensor optics are concurrently updated, and, once adversarial training is complete, validating efficacy of a learned sensor design by fixing the parameters of the sensor optics and training the attack networks and the utility networks to learn to estimate private and public attributes, respectively, from a set of the encoded images.
-
-
-
-
-
-
-
-
-