公开(公告)号：US11610085B2

公开(公告)日：2023-03-21

申请号：US16289520

申请日：2019-02-28

Applicant: ADOBE INC.

Inventor： Deepak Pai ,  Debraj Debashish Basu ,  Joshua Alan Sweetkind-Singer

IPC: G06K9/62 ,  G06N20/00 ,  G06F11/30

Abstract: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.

公开(公告)号：US20200279140A1

公开(公告)日：2020-09-03

申请号：US16289520

申请日：2019-02-28

Applicant: ADOBE INC.

Inventor： Deepak Pai ,  Debraj Debashish Basu ,  Joshua Alan Sweetkind-Singer

IPC: G06K9/62 ,  G06N20/00 ,  G06N5/04 ,  G06F11/30

Abstract: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.