Communication efficient sparse-reduce in distributed machine learning

    公开(公告)号:US11356334B2

    公开(公告)日:2022-06-07

    申请号:US15980243

    申请日:2018-05-15

    Abstract: A method is provided for sparse communication in a parallel machine learning environment. The method includes determining a fixed communication cost for a sparse graph to be computed. The sparse graph is (i) determined from a communication graph that includes all the machines in a target cluster of the environment, and (ii) represents a communication network for the target cluster having (a) an overall spectral gap greater than or equal to a minimum threshold, and (b) certain information dispersal properties such that an intermediate output from a given node disperses to all other nodes of the sparse graph in lowest number of time steps given other possible node connections. The method further includes computing the sparse graph, based on the communication graph and the fixed communication cost. The method also includes initiating a propagation of the intermediate output in the parallel machine learning environment using a topology of the sparse graph.

    Audio scene recognition using time series analysis

    公开(公告)号:US11355138B2

    公开(公告)日:2022-06-07

    申请号:US16997249

    申请日:2020-08-19

    Abstract: A method is provided. Intermediate audio features are generated from respective segments of an input acoustic time series for a same scene. Using a nearest neighbor search, respective segments of the input acoustic time series are classified based on the intermediate audio features to generate a final intermediate feature as a classification for the input acoustic time series. Each respective segment corresponds to a respective different acoustic window. The generating step includes learning the intermediate audio features from Multi-Frequency Cepstral Component (MFCC) features extracted from the input acoustic time series, dividing the same scene into the different windows having varying MFCC features, and feeding the MFCC features of each window into respective LSTM units such that a hidden state of each respective LSTM unit is passed through an attention layer to identify feature correlations between hidden states at different time steps corresponding to different ones of the different windows.

    SELF-OPTIMIZING VIDEO ANALYTICS PIPELINES

    公开(公告)号:US20220172005A1

    公开(公告)日:2022-06-02

    申请号:US17522226

    申请日:2021-11-09

    Abstract: A method for implementing a self-optimized video analytics pipeline is presented. The method includes decoding video files into a sequence of frames, extracting features of objects from one or more frames of the sequence of frames of the video files, employing an adaptive resource allocation component based on reinforcement learning (RL) to dynamically balance resource usage of different microservices included in the video analytics pipeline, employing an adaptive microservice parameter tuning component to balance accuracy and performance of a microservice of the different microservices, applying a graph-based filter to minimize redundant computations across the one or more frames of the sequence of frames, and applying a deep-learning-based filter to remove unnecessary computations resulting from mismatches between the different microservices in the video analytics pipeline.

    ECO: EDGE-CLOUD OPTIMIZATION OF 5G APPLICATIONS

    公开(公告)号:US20220150326A1

    公开(公告)日:2022-05-12

    申请号:US17515875

    申请日:2021-11-01

    Abstract: A method for optimal placement of microservices of a micro-services-based application in a multi-tiered computing network environment employing 5G technology is presented. The method includes accessing a centralized server or cloud to request a set of services to be deployed on a plurality of sensors associated with a plurality of devices, the set of services including launching an application on a device of the plurality of devices, modeling the application as a directed graph with vertices being microservices and edges representing communication between the microservices, assigning each of the vertices of the directed graph with two cost weights, employing an edge monitor (EM), an edge scheduler (ES), an alerts-manager at edge (AM-E), and a file transfer (FT) at the edge to handle partitioning of the microservices, and dynamically mapping the microservices to the edge or the cloud to satisfy application-specific response times.

    MODULAR NETWORK BASED KNOWLEDGE SHARING FOR MULTIPLE ENTITIES

    公开(公告)号:US20220111836A1

    公开(公告)日:2022-04-14

    申请号:US17493323

    申请日:2021-10-04

    Abstract: A method for vehicle fault detection is provided. The method includes training, by a cloud module controlled by a processor device, an entity-shared modular and a shared modular connection controller. The entity-shared modular stores common knowledge for a transfer scope, and is formed from a set of sub-networks which are dynamically assembled for different target entities of a vehicle by the shared modular connection controller. The method further includes training, by an edge module controlled by another processor device, an entity-specific decoder and an entity-specific connection controller. The entity-specific decoder is for filtering entity-specific information from the common knowledge in the entity-shared modular by dynamically assembling the set of sub-networks in a manner decided by the entity specific connection controller.

    VOTING-BASED APPROACH FOR DIFFERENTIALLY PRIVATE FEDERATED LEARNING

    公开(公告)号:US20220108226A1

    公开(公告)日:2022-04-07

    申请号:US17491663

    申请日:2021-10-01

    Abstract: A method for employing a general label space voting-based differentially private federated learning (DPFL) framework is presented. The method includes labeling a first subset of unlabeled data from a first global server, to generate first pseudo-labeled data, by employing a first voting-based DPFL computation where each agent trains a local agent model by using private local data associated with the agent, labeling a second subset of unlabeled data from a second global server, to generate second pseudo-labeled data, by employing a second voting-based DPFL computation where each agent maintains a data-independent feature extractor, and training a global model by using the first and second pseudo-labeled data to provide provable differential privacy (DP) guarantees for both instance-level and agent-level privacy regimes.

    Real-time threat alert forensic analysis

    公开(公告)号:US11275832B2

    公开(公告)日:2022-03-15

    申请号:US16781366

    申请日:2020-02-04

    Abstract: Methods and systems for security monitoring and response include assigning an anomaly score to each of a plurality of event paths that are stored in a first memory. Events that are cold, events that are older than a threshold, and events that are not part of a top-k anomalous path are identified. The identified events are evicted from the first memory to a second memory. A threat associated with events in the first memory is identified. A security action is performed responsive to the identified threat.

    ANOMALY DETECTION IN CYBER-PHYSICAL SYSTEMS

    公开(公告)号:US20220067535A1

    公开(公告)日:2022-03-03

    申请号:US17465054

    申请日:2021-09-02

    Abstract: Methods and systems for training and deploying a neural network mode include training a modular encoder model using training data collected from heterogeneous system types. The modular encoder model includes layers of neural network blocks and a selectively enabled connections between neural network blocks of adjacent layers. Each neural network block includes neural network layers. The modular encoder model is deployed to a system corresponding to one of the heterogeneous system types.

Patent Agency Ranking