公开(公告)号：US12047467B2

公开(公告)日：2024-07-23

申请号：US18321880

申请日：2023-05-23

Applicant: NEC Laboratories America, Inc.

Inventor： Giuseppe Coviello ,  Kunal Rao ,  Srimat Chakradhar

IPC: H04L67/55 ,  H04L67/563

CPC classification number: H04L67/55 ,  H04L67/563

Abstract: A pull-based communication method for microservices-based real-time streaming video analytics pipelines is provided. The method includes receiving a plurality of frames from a plurality of cameras, each camera including a camera sidecar, arranging a plurality of detectors in layers such that a first detector layer includes detectors with detector sidecars and detector business logic, and the second detector layer includes detectors with only sidecars, arranging a plurality of extractors in layers such that a first extractor layer includes extractors with extractor sidecars and extractor business logic, and the second extractor layer includes extractors with only sidecars, and enabling a mesh controller, during registration, to selectively assign inputs to one or more of the detector sidecars of the first detector layer and one or more of the extractor sidecars of the first extractor layer to pull data items for processing.

公开(公告)号：US20240118938A1

公开(公告)日：2024-04-11

申请号：US18474658

申请日：2023-09-26

Applicant: NEC Laboratories America, Inc.

Inventor： Giuseppe Coviello ,  Kunal Rao ,  Srimat Chakradhar ,  Priscilla Benedetti

IPC: G06F9/50

CPC classification number: G06F9/5055

Abstract: A computer implemented method is provided for resource management of stream analytics at each individual node that includes computing a mean of output processing rate of microservices in a pipeline; and evaluating a state of each microservice of the microservices in the pipeline. The computer implemented method also includes selecting a single microservice from the pipeline for updating resources for an action that changes the state in single the microservice that is selected; and performing resource allocation update for the selected microservice. The computer implemented method may also include updating the state of the selected microservice.

公开(公告)号：US20230385116A1

公开(公告)日：2023-11-30

申请号：US18322102

申请日：2023-05-23

Applicant: NEC Laboratories America, Inc.

Inventor： Kunal Rao ,  Wang-pin Hsiung ,  Oliver Po ,  Murugan Sankaradas ,  Srimat Chakradhar ,  Anousheh Gholami

IPC: G06F9/50 ,  G06N20/00

CPC classification number: G06F9/5038 ,  G06N20/00 ,  G06F9/5083

Abstract: Methods and systems for reserving resources include determining a state of a distributed computing system based on resource needs of an application that is executed on the distributed computing system and system resource constraints. An action is determined using the state of the distributed computing system as an input to a trained reinforcement learning model. A resource request is issued for the application to reserve resources based on the action.

公开(公告)号：US11810398B2

公开(公告)日：2023-11-07

申请号：US17526492

申请日：2021-11-15

Applicant: NEC Laboratories America, Inc.

Inventor： Biplob Debnath ,  Srimat Chakradhar ,  Giuseppe Coviello ,  Yi Yang

IPC: G06V40/16 ,  G06V10/75 ,  G06F18/10 ,  G06F18/2321

CPC classification number: G06V40/172 ,  G06F18/10 ,  G06F18/2321 ,  G06V10/751

Abstract: Methods and systems for face clustering include determining a quality score for each of a set of input images. A first subset of the input images is clustered, having respective quality scores that exceed a predetermined threshold, to form an initial set of clusters. A second subset of the input images is clustered, having respective quality scores below the predetermined threshold. An action is performed responsive to the clustered images after the second subset is added to the initial set of clusters.

公开(公告)号：US11699216B2

公开(公告)日：2023-07-11

申请号：US17182685

申请日：2021-02-23

Applicant: NEC Laboratories America, Inc.

Inventor： Min Feng ,  Srimat Chakradhar ,  Alper Yildirim

IPC: G06T5/00 ,  G06T7/13 ,  G06T7/80

CPC classification number: G06T5/006 ,  G06T7/13 ,  G06T7/80 ,  G06T2207/10016

Abstract: A computer-implemented method executed by at least one processor for reducing radial distortion errors in fish-eye images is presented. The method includes capturing an image from a camera including distortions, detecting arc-shaped edge segments in the image including the distortions, estimating a main distortion parameter by fixing a distortion centerpoint in a middle of the image, estimating the distortion centerpoint with the main distortion parameter, and obtaining an undistorted version of the captured image by inverting the distortion model.

公开(公告)号：US20230049770A1

公开(公告)日：2023-02-16

申请号：US17862667

申请日：2022-07-12

Applicant: NEC Laboratories America, Inc.

Inventor： Biplob Debnath ,  Srimat Chakradhar ,  Oliver Po ,  Asim Kadav ,  Farley Lai ,  Farhan Asif Chowdhury

IPC: G06V20/40 ,  G06V10/764 ,  G06V10/82 ,  G06N3/08

Abstract: Methods and systems of training a neural network include training a feature extractor and a classifier using a first set of training data that includes one or more base cases. The classifier is trained with few-shot adaptation using a second set of training data, smaller than the first set of training data, while keeping parameters of the feature extractor constant.

公开(公告)号：US11574461B2

公开(公告)日：2023-02-07

申请号：US17197403

申请日：2021-03-10

Applicant: NEC Laboratories America, Inc.

Inventor： Biplob Debnath ,  Srimat Chakradhar ,  M. Ashraf Siddiquee

IPC: G06V10/74 ,  G06F16/783 ,  G06F16/78 ,  G06V20/40

Abstract: Methods and systems for detecting and predicting anomalies include processing frames of a video stream to determine values of a feature corresponding to each frame. A feature time series is generated that corresponds to values of the identified feature over time. A matrix profile is generated that identifies similarities of sub-sequences of the time series to other sub-sequences of the feature time series. An anomaly is detected by determining that a value of the matrix profile exceeds a threshold value. An automatic action is performed responsive to the detected anomaly.

公开(公告)号：US20220114380A1

公开(公告)日：2022-04-14

申请号：US17494979

申请日：2021-10-06

Applicant: NEC Laboratories America, Inc.

Inventor： Murugan Sankaradas ,  Kunal Rao ,  Yi Yang ,  Biplob Debnath ,  Utsav Drolia ,  Srimat Chakradhar ,  Amit Redkar ,  Ravi Kailasam Rajendran

IPC: G06K9/62 ,  G06T7/50 ,  G06K9/00 ,  G06T11/00 ,  G06K9/46 ,  G06N3/04

Abstract: A method for real-time cross-spectral object association and depth estimation is presented. The method includes synthesizing, by a cross-spectral generative adversarial network (CS-GAN), visual images from different data streams obtained from a plurality of different types of sensors, applying a feature-preserving loss function resulting in real-time pairing of corresponding cross-spectral objects, and applying dual bottleneck residual layers with skip connections to accelerate real-time inference and to accelerate convergence during model training.

公开(公告)号：US20220114369A1

公开(公告)日：2022-04-14

申请号：US17497246

申请日：2021-10-08

Applicant: NEC Laboratories America, Inc.

Inventor： Biplob Debnath ,  Srimat Chakradhar ,  Yi Yang ,  Neisarg Dave

IPC: G06K9/00 ,  G06T7/20 ,  G06N3/02

Abstract: Systems and methods for video analytic processing with neuro-symbolic artificial intelligence are provided. These systems and methods include detecting and extracting one or more objects from one or more video frames, and identifying the attributes associated with each of the one or more objects. These further include extracting context from a question, and compiling a series of inquiries to identify the information needed to answer the question and identify missing information. These further include storing intermediate information about the extracted objects and identified attributes, and determining whether the question requires further modeling of data to obtain missing information. These further include mining the one or more video frames for missing information, and compiling the intermediate information from the data storage and missing information based on the context of the question to produce a final answer.

公开(公告)号：US20210303870A1

公开(公告)日：2021-09-30

申请号：US17208572

申请日：2021-03-22

Applicant: NEC Laboratories America, Inc.

Inventor： Yi Yang ,  Murugan Sankaradas ,  Srimat Chakradhar ,  Ashutosh Jain

IPC: G06K9/00 ,  G06Q30/02

Abstract: A computer-implemented method for characterizing a crowd that includes recording a video stream of individuals at a location having at least one reference point for viewing; and extracting the individuals from frames of the video streams. The method may further include assigning tracking identification values to the individuals that have been extracted from the video streams; and measuring at least one type classification from the individuals having the tracking identification values. The method may further include generating a crowd designation further characterizing the individuals having the tracking identification values in the location, the crowd designation comprising at least one measurement of probability that the individuals having the tracking identification values in the location view the at least one reference point for viewing.