Invention Grant
- Patent Title: Methods and systems for explaining a decision process of a machine learning model
-
Application No.: US16866997Application Date: 2020-05-05
-
Publication No.: US11443045B2Publication Date: 2022-09-13
- Inventor: Arash Rahnama-Moghaddam , Andrew Tseng
- Applicant: Booz Allen Hamilton Inc.
- Applicant Address: US VA McLean
- Assignee: Booz Allen Hamilton Inc.
- Current Assignee: Booz Allen Hamilton Inc.
- Current Assignee Address: US VA McLean
- Agency: Buchanan Ingersoll & Rooney PC
- Main IPC: G06F21/57
- IPC: G06F21/57 ; G06N20/00 ; G06F16/23

Abstract:
A method and system for explaining a decision process of a machine learning model that includes inputting into a machine learning model a first input data file; receiving a first output data file from the machine learning model based on the first input data file; executing an adversarial attack on the machine learning model, creating a mapping of the one or more units of data of the first input data file with changes by the adversarial attack exceeding a first threshold to one or more segments of the first input data file; determining a density of the changes to the one or more units of data in each of the one or more segments; and displaying the one or more segments of the first input data file having a density of changes to the one or more units of data exceeding a second threshold via a graphical user interface.
Public/Granted literature
- US20210350004A1 METHODS AND SYSTEMS FOR EXPLAINING A DECISION PROCESS OF A MACHINE LEARNING MODEL Public/Granted day:2021-11-11
Information query