-
公开(公告)号:US20240275996A1
公开(公告)日:2024-08-15
申请号:US18439291
申请日:2024-02-12
Applicant: NEC Laboratories America, Inc.
Inventor: Biplob Debnath , Deep Patel , Srimat Chakradhar , Oliver Po , Christoph Reich
IPC: H04N19/42 , G06N20/00 , H04N7/18 , H04N19/119 , H04N19/124 , H04N19/14 , H04N19/154 , H04N19/156 , H04N19/172 , H04N19/176 , H04N19/177 , H04N19/463 , H04N19/61
CPC classification number: H04N19/42 , G06N20/00 , H04N7/183 , H04N19/119 , H04N19/124 , H04N19/14 , H04N19/154 , H04N19/156 , H04N19/172 , H04N19/176 , H04N19/177 , H04N19/463 , H04N19/61
Abstract: Systems and methods are provided for optimizing video compression using end-to-end learning, including capturing, using an edge device, raw video frames from a video clip and determining maximum network bandwidth. Predicting, using a control network implemented on the edge device, optimal codec parameters, based on dynamic network conditions and content of the video clip, encoding, using a differentiable surrogate model of a video codec, the video clip using the predicted codec parameters and to propagate gradients from a server-side vision model to adjust the codec parameters. Decoding, using a server, the video clip and analyzing the video clip with a deep vision model located on the server, transmitting, using a feedback mechanism, analysis from the deep vision model back to the control network to facilitate end-to-end training of the system. Adjusting the encoding parameters based on the analysis from the deep vision model received from the feedback mechanism.
-
公开(公告)号:US20230385116A1
公开(公告)日:2023-11-30
申请号:US18322102
申请日:2023-05-23
Applicant: NEC Laboratories America, Inc.
Inventor: Kunal Rao , Wang-pin Hsiung , Oliver Po , Murugan Sankaradas , Srimat Chakradhar , Anousheh Gholami
CPC classification number: G06F9/5038 , G06N20/00 , G06F9/5083
Abstract: Methods and systems for reserving resources include determining a state of a distributed computing system based on resource needs of an application that is executed on the distributed computing system and system resource constraints. An action is determined using the state of the distributed computing system as an input to a trained reinforcement learning model. A resource request is issued for the application to reserve resources based on the action.
-
公开(公告)号:US20230049770A1
公开(公告)日:2023-02-16
申请号:US17862667
申请日:2022-07-12
Applicant: NEC Laboratories America, Inc.
Inventor: Biplob Debnath , Srimat Chakradhar , Oliver Po , Asim Kadav , Farley Lai , Farhan Asif Chowdhury
IPC: G06V20/40 , G06V10/764 , G06V10/82 , G06N3/08
Abstract: Methods and systems of training a neural network include training a feature extractor and a classifier using a first set of training data that includes one or more base cases. The classifier is trained with few-shot adaptation using a second set of training data, smaller than the first set of training data, while keeping parameters of the feature extractor constant.
-
公开(公告)号:US12266174B2
公开(公告)日:2025-04-01
申请号:US17862667
申请日:2022-07-12
Applicant: NEC Laboratories America, Inc.
Inventor: Biplob Debnath , Srimat Chakradhar , Oliver Po , Asim Kadav , Farley Lai , Farhan Asif Chowdhury
IPC: G06V20/40 , G06N3/08 , G06V10/764 , G06V10/82
Abstract: Methods and systems of training a neural network include training a feature extractor and a classifier using a first set of training data that includes one or more base cases. The classifier is trained with few-shot adaptation using a second set of training data, smaller than the first set of training data, while keeping parameters of the feature extractor constant.
-
公开(公告)号:US20240147054A1
公开(公告)日:2024-05-02
申请号:US18495064
申请日:2023-10-26
Applicant: NEC Laboratories America, Inc.
Inventor: Kunal Rao , Sibendu Paul , Giuseppe Coviello , Murugan Sankaradas , Oliver Po , Srimat Chakradhar
IPC: H04N23/60
Abstract: Methods and systems for camera configuration include configuring an image capture configuration parameter of a camera according to a multi-objective reinforcement learning aggregated reward function. Respective quality estimates for analytics are determined after configuring the image capture parameters. The aggregated reward function is updated based on the quality estimates.
-
公开(公告)号:US20230237805A1
公开(公告)日:2023-07-27
申请号:US18157915
申请日:2023-01-23
Applicant: NEC Laboratories America, Inc.
Inventor: Biplob Debnath , Oliver Po , Srimat Chakradhar
IPC: G06V20/56 , G06V20/40 , G06V10/74 , G06V10/764 , B60W30/09
CPC classification number: G06V20/56 , B60W30/09 , G06V10/761 , G06V10/764 , G06V20/46
Abstract: A computer-implemented method is provided. The method includes classifying a video clip of consecutive video frames into one of predefined new classes in relation to a base training set class. The method further includes controlling a system of a motor vehicle for accident avoidance responsive to the one of the predefined classes indicating an impending collision. The classifying step includes extracting video frame features from the video clip. The classifying step further includes aggregating the video frame features of the consecutive video frames into a single frame feature to form a video level feature presentation. The classifying step also includes mapping, by a distance-based classifier, the video level feature presentation into a classification prediction based on cosine similarity.
-
公开(公告)号:US20220414935A1
公开(公告)日:2022-12-29
申请号:US17825519
申请日:2022-05-26
Applicant: NEC Laboratories America, Inc.
Inventor: Kunal Rao , Giuseppe Coviello , Murugan Sankaradas , Oliver Po , Srimat Chakradhar , Sibendu Paul
Abstract: A method for automatically adjusting camera parameters to improve video analytics accuracy during continuously changing environmental conditions is presented. The method includes capturing a video stream from a plurality of cameras, performing video analytics tasks on the video stream, the video analytics tasks defined as analytics units (AUs), applying image processing to the video stream to obtain processed frames, filtering the processed frames through a filter to discard low-quality frames and dynamically fine-tuning parameters of the plurality of cameras. The fine-tuning includes passing the filtered frames to an AU-specific proxy quality evaluator, employing State-Action-Reward-State-Action (SARSA) reinforcement learning (RL) computations to automatically fine-tune the parameters of the plurality of cameras, and based on the reinforcement computations, applying a new policy for an agent to take actions and learn to maximize a reward.
-
公开(公告)号:US20220337644A1
公开(公告)日:2022-10-20
申请号:US17720776
申请日:2022-04-14
Applicant: NEC Laboratories America, Inc.
Inventor: Giuseppe Coviello , Kunal Rao , Wang-Pin Hsiung , Oliver Po , Srimat Chakradhar
IPC: H04L65/60
Abstract: Methods and systems for managing communications include identifying a system condition in a distributed computing system comprising a first microservice in communication with a second microservice. A communications method is identified responsive to the identified system condition using a reinforcement learning model that associates communication methods with system conditions. The identified communications method is implemented for communications between the first microservice and the second microservice, such that the first microservice and the second microservice use the identified communications method to transmit data.
-
公开(公告)号:US12201403B2
公开(公告)日:2025-01-21
申请号:US17325613
申请日:2021-05-20
Applicant: NEC Laboratories America, Inc.
Inventor: Kunal Rao , Giuseppe Coviello , Min Feng , Biplob Debnath , Wang-pin Hsiung , Murugan Sankaradas , Srimat Chakradhar , Yi Yang , Oliver Po , Utsav Drolia
Abstract: A method for free flow fever screening is presented. The method includes capturing a plurality of frames from thermal data streams and visual data streams related to a same scene to define thermal data frames and visual data frames, detecting and tracking a plurality of individuals moving in a free-flow setting within the visual data frames, and generating a tracking identification for each individual of the plurality of individuals present in a field-of-view of the one or more cameras across several frames of the plurality of frames. The method further includes fusing the thermal data frames and the visual data frames, measuring, by a fever-screener, a temperature of each individual of the plurality of individuals within and across the plurality of frames derived from the thermal data streams and the visual data streams, and generating a notification when a temperature of an individual exceeds a predetermined threshold temperature.
-
公开(公告)号:US20240089592A1
公开(公告)日:2024-03-14
申请号:US18466296
申请日:2023-09-13
Applicant: NEC Laboratories America, Inc.
Inventor: Kunal Rao , Sibendu Paul , Giuseppe Coviello , Murugan Sankaradas , Oliver Po , Srimat Chakradhar
Abstract: Systems and methods are provided for dynamically tuning camera parameters in a video analytics system to optimize analytics accuracy. A camera captures a current scene, and optimal camera parameter settings are learned and identified for the current scene using a Reinforcement Learning (RL) engine. The learning includes defining a state within the RL engine as a tuple of two vectors: a first representing current camera parameter values and a second representing measured values of frames of the current scene. Quality of frames is estimated using a quality estimator, and camera parameters are adjusted based on the quality estimator and the RL engine for optimization. Effectiveness of tuning is determined using perceptual Image Quality Assessment (IQA) to quantify a quality measure. Camera parameters are adaptively tuned in real-time based on learned optimal camera parameter settings, state, quality measure, and set of actions, to optimize the analytics accuracy for video analytics tasks.
-
-
-
-
-
-
-
-
-