MODEL TESTING USING TEST SAMPLE UNCERTAINTY
    1.
    发明公开

    公开(公告)号:US20240185027A1

    公开(公告)日:2024-06-06

    申请号:US18074148

    申请日:2022-12-02

    CPC classification number: G06N3/045 G06N3/08

    Abstract: Using encoded representations of target model training data and a label corresponding to each portion of the target model training data, a proxy model to determine an uncertainty score corresponding to an output of a trained target model is trained. Using the trained proxy model, a set of uncertainty scores is computed, each uncertainty score in the set of uncertainty scores corresponding to a portion of target model testing data in a set of target model testing data. A subset of the set of target model testing data is selected, the subset comprising a plurality of portions of target model testing data having an uncertainty score above a threshold uncertainty score. Using the subset of the set of target model testing data, the trained target model.

    User explanation guided machine learning

    公开(公告)号:US11636331B2

    公开(公告)日:2023-04-25

    申请号:US16506413

    申请日:2019-07-09

    Abstract: Methods, systems, and computer program products for active explanation guided learning are provided herein. A computer-implemented method includes identifying a subset of training examples, from a set of training examples, based on at least one of (i) an uncertainty metric computed for each one of the training examples and (ii) an influence metric computed for each one of the training examples; outputting said subset of training examples to a user; obtaining, from the user, a user explanation for each training example in said subset of training examples, wherein each of the user explanations identifies at least one part of the corresponding training example; and training a machine learning model based at least in part on the user explanations, wherein said training comprises prioritizing the identified parts of the training examples in the subset.

    DETECTING CONTEXTUAL BIAS IN TEXT

    公开(公告)号:US20220335217A1

    公开(公告)日:2022-10-20

    申请号:US17233727

    申请日:2021-04-19

    Abstract: Methods, systems, and computer program products for detecting contextual bias in text are provided herein. A computer-implemented method includes identifying, by a machine learning network, a protected attribute in one or more data samples; processing the identified data samples using a first sub-network of the machine learning network, wherein the first sub-network is configured to determine a plurality of contexts of the protected attribute across the identified data samples; determining an impact of each of the plurality of contexts on a second sub-network of the machine learning network, wherein the second sub-network of the machine learning network is configured to classify a given data sample into one of a plurality of classes; and adjusting the second sub-network of the machine learning to account for the impact of at least one of the plurality of contexts on the second sub-network.

    EXPLANATION GUIDED LEARNING
    10.
    发明申请

    公开(公告)号:US20210012156A1

    公开(公告)日:2021-01-14

    申请号:US16506413

    申请日:2019-07-09

    Abstract: Methods, systems, and computer program products for active explanation guided learning are provided herein. A computer-implemented method includes identifying a subset of training examples, from a set of training examples, based on at least one of (i) an uncertainty metric computed for each one of the training examples and (ii) an influence metric computed for each one of the training examples; outputting said subset of training examples to a user; obtaining, from the user, a user explanation for each training example in said subset of training examples, wherein each of the user explanations identifies at least one part of the corresponding training example; and training a machine learning model based at least in part on the user explanations, wherein said training comprises prioritizing the identified parts of the training examples in the subset.

Patent Agency Ranking