公开(公告)号：US20250118009A1

公开(公告)日：2025-04-10

申请号：US18903348

申请日：2024-10-01

Applicant: NEC Laboratories America, Inc.

Inventor： Bingbing Zhuang ,  Ziyu Jiang ,  Buyu Liu ,  Manmohan Chandraker ,  Shanlin Sun

IPC: G06T15/08 ,  G01S17/89 ,  G06V10/774 ,  G06V20/52

Abstract: A computer-implemented method for synthesizing an image includes capturing data from a scene and fusing grid-based representations of the scene from different encodings to inherit beneficial properties of the different encodings, The encodings include Lidar encoding and a high definition map encoding. Rays are rendered from fused grid-based representations. A density and color are determined for points in the rays. A volume rendering is employed for the rays with the density and color. An image is synthesized from the volume rendered rays with the density and the color.

公开(公告)号：US20250117029A1

公开(公告)日：2025-04-10

申请号：US18905280

申请日：2024-10-03

Applicant: NEC Laboratories America, Inc.

Inventor： Tom Bu ,  Bingbing Zhuang ,  Manmohan Chandraker

IPC: G05D1/86 ,  G05D1/242 ,  G05D1/243 ,  G05D107/60 ,  G05D111/67

Abstract: Systems and methods for automatic multi-modality sensor calibration with near-infrared images (NIR). Image keypoints from collected images and NIR keypoints from NIR can be detected. A deep-learning-based neural network that learns relation graphs between the image keypoints and the NIR keypoints can match the image keypoints and the NIR keypoints. Three dimensional (3D) points from 3D point cloud data can be filtered based on corresponding 3D points from the NIR keypoints (NIR-to-3D points) to obtain filtered NIR-to-3D points. An extrinsic calibration can be optimized based on a reprojection error computed from the filtered NIR-to-3D points to obtain an optimized extrinsic calibration for an autonomous entity control system. An entity can be controlled by employing the optimized extrinsic calibration for the autonomous entity control system.

公开(公告)号：US20250115278A1

公开(公告)日：2025-04-10

申请号：US18905695

申请日：2024-10-03

Applicant: NEC Laboratories America, Inc.

Inventor： Francesco Pittaluga ,  Buyu Liu ,  Manmohan Chandraker ,  Kaiyuan Zhang

IPC: B60W60/00

Abstract: Systems and methods for generating adversarial driving scenarios for autonomous vehicles. An artificial intelligence model can compute an adversarial loss function by minimizing the distance between predicted adversarial perturbed trajectories and corresponding generated neighbor future trajectories from input data. A traffic violation loss function can be computed based on observed adversarial agents adhering to driving rules from the input data. A comfort loss function can be computed based on the predicted driving characteristics of adversarial vehicles relevant to comfort of hypothetical passengers from the input data. A planner module can be trained for autonomous vehicles based on a combined loss function of the adversarial loss function, the traffic violation loss function and the comfort loss function to generate adversarial driving scenarios. An autonomous vehicle can be controlled based on trajectories generated in the adversarial driving scenarios.

公开(公告)号：US20250115276A1

公开(公告)日：2025-04-10

申请号：US18904639

申请日：2024-10-02

Applicant: NEC Laboratories America, Inc.

Inventor： Samuel Schulter ,  Vijay Kumar Baikampady Gopalkrishna ,  Yumin Suh

IPC: B60W60/00 ,  G06T5/77 ,  G06V10/774 ,  G06V20/58

Abstract: Methods and systems for object detection include generating a negative description for an input image of a road scene, based on a positive description of the input image, using a language model. A negative image is generated based on the input image and the negative description by replacing a portion of the input image that is described by the positive description with content that is described by the negative description using a generative image model. An object detection model is trained with the input image, the positive description, the negative description, and the negative image. An object is identified within a driving scene using the trained object detection model. A driving action is performed in a self-driving vehicle responsive to the identified object.

公开(公告)号：US12263849B2

公开(公告)日：2025-04-01

申请号：US17961169

申请日：2022-10-06

Applicant: NEC Laboratories America, Inc. ,  NEC Corporation

Inventor： LuAn Tang ,  Yuncong Chen ,  Wei Cheng ,  Zhengzhang Chen ,  Haifeng Chen ,  Yuji Kobayashi ,  Yuxiang Ren

IPC: B60W40/09 ,  G06F18/25 ,  G06N3/084

Abstract: Systems and methods for data fusion and analysis of vehicle sensor data, including receiving a multiple modality input data stream from a plurality of different types of vehicle sensors, determining latent features by extracting modality-specific features from the input data stream, and aligning a distribution of the latent features of different modalities by feature-level data fusion. Classification probabilities can be determined for the latent features using a fused modality scene classifier. A tree-organized neural network can be trained to determine path probabilities and issue driving pattern judgments, with the tree-organized neural network including a soft tree model and a hard decision leaf. One or more driving pattern judgments can be issued based on a probability of possible driving patterns derived from the modality-specific features.

公开(公告)号：US12205418B2

公开(公告)日：2025-01-21

申请号：US17464056

申请日：2021-09-01

Applicant: NEC Laboratories America, Inc. ,  NEC Corporation

Inventor： Luan Tang ,  Wei Cheng ,  Haifeng Chen ,  Yuji Kobayashi ,  Zhengzhang Chen

IPC: G07C5/08 ,  G06N3/04

Abstract: A method for early warning is provided. The method clusters normal historical data of normal cars into groups based on the car subsystem to which they belong. The method extracts (i) features based on group membership and (ii) feature correlations based on correlation graphs formed from the groups. The method trains an Auto-Encoder and Auto Decoder (AE&AD) model based on the features and the feature correlations to reconstruct the normal historical data with minimum reconstruction errors. The method reconstructs, using the trained AE&AD model, historical data of specific car fault types with reconstruction errors, normalizes the reconstruction errors, and selects features of the car faults with a top k large errors as fault signatures. The method reconstructs streaming data of monitored cars using the trained AE&AD model to determine streaming reconstruction errors, comparing the streaming reconstruction errors with the fault signatures to predict and provide alerts for impending known faults.

公开(公告)号：US12205356B2

公开(公告)日：2025-01-21

申请号：US18188766

申请日：2023-03-23

Applicant: NEC Laboratories America, Inc.

Inventor： Samuel Schulter ,  Sparsh Garg ,  Manmohan Chandraker

IPC: G06V10/776 ,  G06T7/00 ,  G06T7/11 ,  G06V10/74 ,  G06V10/774 ,  G06V20/70 ,  H04N17/00

Abstract: Methods and systems for detecting faults include capturing an image of a scene using a camera. The image is embedded using a segmentation model that includes an image branch having an image embedding layer that embeds images into a joint latent space and a text branch having a text embedding layer that embeds text into the joint latent space. Semantic information is generated for a region of the image corresponding to a predetermined static object using the embedded image. A fault of the camera is identified based on a discrepancy between the semantic information and semantic information of the predetermined static image. The fault of the camera is corrected.

公开(公告)号：US12201403B2

公开(公告)日：2025-01-21

申请号：US17325613

申请日：2021-05-20

Applicant: NEC Laboratories America, Inc.

Inventor： Kunal Rao ,  Giuseppe Coviello ,  Min Feng ,  Biplob Debnath ,  Wang-pin Hsiung ,  Murugan Sankaradas ,  Srimat Chakradhar ,  Yi Yang ,  Oliver Po ,  Utsav Drolia

IPC: A61B5/01 ,  A61B5/00

Abstract: A method for free flow fever screening is presented. The method includes capturing a plurality of frames from thermal data streams and visual data streams related to a same scene to define thermal data frames and visual data frames, detecting and tracking a plurality of individuals moving in a free-flow setting within the visual data frames, and generating a tracking identification for each individual of the plurality of individuals present in a field-of-view of the one or more cameras across several frames of the plurality of frames. The method further includes fusing the thermal data frames and the visual data frames, measuring, by a fever-screener, a temperature of each individual of the plurality of individuals within and across the plurality of frames derived from the thermal data streams and the visual data streams, and generating a notification when a temperature of an individual exceeds a predetermined threshold temperature.

公开(公告)号：US20250005373A1

公开(公告)日：2025-01-02

申请号：US18749887

申请日：2024-06-21

Applicant: NEC Laboratories America, Inc.

Inventor： Junxiang Wang ,  Wei Cheng ,  LuAn Tang ,  Haifeng Chen

IPC: G06N3/096 ,  G06N3/0455 ,  G06N3/084

Abstract: Systems and methods are provided for adapting a model trained from multiple source time-series domains to a target time-series domain, including integrating input data from source time-series domains to pretrain a model with a set of domain-invariant representations, fine-tuning the model by learning prompts specific to each source time-series domain using data from the source time-series domains, and applying instance normalization and segmenting the time-series data into subseries-level normalized patches for the target time-series domain. The normalized patches are fed into a transformer encoder to generate high-dimensional representations of the normalized patches, and a limited number of samples from the target time-series domain are utilized to learn the prompt specific to the target domain. Cosine similarity between the prompt of the target domain and the prompts of source domains is calculated to identify a nearest neighbor prompt, which is utilized for model prediction in the target time-series domain.

公开(公告)号：US20240419801A1

公开(公告)日：2024-12-19

申请号：US18731845

申请日：2024-06-03

Applicant: NEC Laboratories America, Inc.

Inventor： Wei Cheng ,  Xianjun Yang ,  Haifeng Chen

IPC: G06F21/57 ,  G06F11/36

Abstract: Systems and methods for detecting artificial intelligence (AI) generated computer code. Lines of code can be masked from a candidate code to obtain perturbed codes. Missing code can be generated from the perturbed codes by employing an AI code generator model to obtain machine-filled codes. Probabilities of the candidate code probability and the machine-filled codes as AI-generated can be predicted by employing a surrogate model. The candidate code can be distinguished as AI-generated by comparing the probabilities against a detection threshold to obtain detection results.