MULTI-TASK LEARNING VIA GRADIENT SPLIT FOR RICH HUMAN ANALYSIS

    公开(公告)号:US20220121953A1

    公开(公告)日:2022-04-21

    申请号:US17496214

    申请日:2021-10-07

    Abstract: A method for multi-task learning via gradient split for rich human analysis is presented. The method includes extracting images from training data having a plurality of datasets, each dataset associated with one task, feeding the training data into a neural network model including a feature extractor and task-specific heads, wherein the feature extractor has a feature extractor shared component and a feature extractor task-specific component, dividing filters of deeper layers of convolutional layers of the feature extractor into N groups, N being a number of tasks, assigning one task to each group of the N groups, and manipulating gradients so that each task loss updates only one subset of filters.

    Unsupervised domain adaptation for video classification

    公开(公告)号:US11301716B2

    公开(公告)日:2022-04-12

    申请号:US16515593

    申请日:2019-07-18

    Abstract: A method is provided for unsupervised domain adaptation for video classification. The method learns a transformation for each target video clips taken from a set of target videos, responsive to original features extracted from the target video clips. The transformation corrects differences between a target domain corresponding to target video clips and a source domain corresponding to source video clips taken from a set of source videos. The method adapts the target to the source domain by applying the transformation to the original features extracted to obtain transformed features for the plurality of target video clips. The method converts the original and transformed features of same ones of the target video clips into a single classification feature for each of the target videos. The method classifies a new target video relative to the set of source videos using the single classification feature for each of the target videos.

    Protocol-independent anomaly detection

    公开(公告)号:US11297082B2

    公开(公告)日:2022-04-05

    申请号:US16535521

    申请日:2019-08-08

    Abstract: A computer-implemented method for implementing protocol-independent anomaly detection within an industrial control system (ICS) includes implementing a detection stage, including performing byte filtering using a byte filtering model based on at least one new network packet associated with the ICS, performing horizontal detection to determine whether a horizontal constraint anomaly exists in the at least one network packet based on the byte filtering and a horizontal model, including analyzing constraints across different bytes of the at least one new network packet, performing message clustering based on the horizontal detection to generate first cluster information, and performing vertical detection to determine whether a vertical anomaly exists based on the first cluster information and a vertical model, including analyzing a temporal pattern of each byte of the at least one new network packet.

    RULE ENABLED COMPOSITIONAL REASONING SYSTEM

    公开(公告)号:US20220083781A1

    公开(公告)日:2022-03-17

    申请号:US17464099

    申请日:2021-09-01

    Abstract: A computer-implemented method is provided for compositional reasoning. The method includes producing a set of primitive predictions from an input sequence. Each of the primitive predictions is of a single action of a tracked subject to be composed in a complex action comprising multiple single actions. The method further includes performing contextual rule filtering of the primitive predictions to pass through filtered primitive predictions that interact with one or more entities of interest in the input sequence with respect to predefined contextual interaction criteria. The method includes performing, by a processor device, temporal rule matching by matching the filtered primitive predictions according to pre-defined temporal rules to identify complex event patterns in the sequence of primitive predictions.

    META-LEARNING SYSTEM AND METHOD FOR DISENTANGLED DOMAIN REPRESENTATION LEARNING

    公开(公告)号:US20220076135A1

    公开(公告)日:2022-03-10

    申请号:US17391526

    申请日:2021-08-02

    Abstract: A method for employing meta-learning based feature disentanglement to extract transferrable knowledge in an unsupervised setting is presented. The method includes identifying how to transfer prior knowledge data from a plurality of source domains to one or more target domains, extracting domain dependence features and domain agnostic features from the prior knowledge data, via a disentangle meta-controller, by discovering factors of variation within the prior knowledge data received from a data stream, and obtaining an evaluation for a downstream task, via a child network, to obtain an optimal child model and a feature disentangle strategy.

    CROSS-LINGUAL ZERO-SHOT TRANSFER VIA SEMANTIC AND SYNTHETIC REPRESENTATION LEARNING

    公开(公告)号:US20220075945A1

    公开(公告)日:2022-03-10

    申请号:US17464005

    申请日:2021-09-01

    Abstract: A computer-implemented method is provided for cross-lingual transfer. The method includes randomly masking a source corpus and a target corpus to obtain a masked source corpus and a masked target corpus. The method further includes tokenizing, by pretrained Natural Language Processing (NLP) models, the masked source corpus and the masked target corpus to obtain source tokens and target tokens. The method also includes transforming the source tokens and the target tokens into a source dependency parsing tree and a target dependency parsing tree. The method additionally includes inputting the source dependency parsing tree and the target dependency parsing tree into a graph encoder pretrained on a translation language modeling task to extract common language information for transfer. The method further includes fine-tuning the graph encoder and a down-stream network for a specific NLP down-stream task.

    Learning representations of generalized cross-modal entailment tasks

    公开(公告)号:US11250299B2

    公开(公告)日:2022-02-15

    申请号:US16668680

    申请日:2019-10-30

    Abstract: A method is provided for determining entailment between an input premise and an input hypothesis of different modalities. The method includes extracting features from the input hypothesis and an entirety of and regions of interest in the input premise. The method further includes deriving intra-modal relevant information while suppressing intra-modal irrelevant information, based on intra-modal interactions between elementary ones of the features of the input hypothesis and between elementary ones of the features of the input premise. The method also includes attaching cross-modal relevant information to the features from the input premise to the features from the input hypothesis to form a cross-modal representation, based on cross-modal interactions between pairs of different elementary features from different modalities. The method additionally includes classifying a relationship between the input premise and the input hypothesis using a label selected from the group consisting of entailment, neutral, and contradiction based on the cross-modal representation.

    Deep Q-network reinforcement learning for testing case selection and prioritization

    公开(公告)号:US11249887B2

    公开(公告)日:2022-02-15

    申请号:US16998224

    申请日:2020-08-20

    Abstract: Systems and methods for automated software test design and implementation. The system and method being able to establish an initial pool of test cases for testing computer code; apply the initial pool of test cases to the computer code in a testing environment to generate test results; preprocess the test results into a predetermined format; extract metadata from the test results; generate a training sequence; calculate a reward value for the pool of test cases; input the training sequence and reward value into a reinforcement learning agent; utilizing the value output from the reinforcement learning agent to produce a ranking list; prioritizing the initial pool of test cases and one or more new test cases based on the ranking list; and applying the prioritized initial pool of test cases and one or more new test cases to the computer code in a testing environment to generate test results.

Patent Agency Ranking