Prototype-based machine learning reasoning interpretation

    公开(公告)号:US11610085B2

    公开(公告)日:2023-03-21

    申请号:US16289520

    申请日:2019-02-28

    申请人: ADOBE INC.

    IPC分类号: G06K9/62 G06N20/00 G06F11/30

    摘要: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.

    QUANTIFYING AND IMPROVING THE PERFORMANCE OF COMPUTATION-BASED CLASSIFIERS

    公开(公告)号:US20220300557A1

    公开(公告)日:2022-09-22

    申请号:US17203300

    申请日:2021-03-16

    申请人: ADOBE INC.

    摘要: Enhanced methods for improving the performance of classifiers are described. A ground-truth labeled dataset is accessed. A classifier predicts a predicted label for datapoints of the dataset. A confusion matrix for the dataset and classifier is generated. A credibility interval is determined for a performance metric for each label. A first labels with a sufficiently large credibility interval is identified. A second label is identified, where the classifier is likely to confuse, in its predictions, the first label with the second label. The identification of the second label is based on instances of incorrect label predictions of the classifier for the first and/or the second labels. The classifier is updated based on a new third label that includes an aggregation of the first label and the second label. The updated classifier model predicts the third label for any datapoint that the classifier previously predicted the first or second labels.

    PROTOTYPE-BASED MACHINE LEARNING REASONING INTERPRETATION

    公开(公告)号:US20200279140A1

    公开(公告)日:2020-09-03

    申请号:US16289520

    申请日:2019-02-28

    申请人: ADOBE INC.

    摘要: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.