Invention Publication
- Patent Title: METHOD AND SYSTEM FOR EVALUATING CLINICAL EFFICACY OF MULTI-LABEL MULTI-CLASS COMPUTATIONAL DIAGNOSTIC MODELS
-
Application No.: US18367546Application Date: 2023-09-13
-
Publication No.: US20240096492A1Publication Date: 2024-03-21
- Inventor: Arijit UKIL , Trisrota DEB , Ishan SAHU , Sai Chander RACHA , Sundeep KHANDELWAL , Arpan PAL , Utpal GARAIN , Soumadeep SAHA
- Applicant: Tata Consultancy Services Limited
- Applicant Address: IN Mumbai
- Assignee: Tata Consultancy Services Limited
- Current Assignee: Tata Consultancy Services Limited
- Current Assignee Address: IN Mumbai
- Priority: IN 2221052587 2022.09.14
- Main IPC: G16H50/20
- IPC: G16H50/20

Abstract:
The present invention relates to the field of evaluating clinical diagnostic models. Conventional metrics does not consider context dependent clinical principles and is unable to capture critically important features that ought to be present in a diagnostic model. Thus, present disclosure provides a method and system for evaluating clinical efficacy of multi-label multi-class computational diagnostic models. Diagnosis for a given dataset of diagnostic samples is obtained from the diagnostic model which is then classified as wrong, missed, over or right diagnosis, based on which a first penalty is calculated. A second penalty is calculated for each diagnostic sample using a contradiction matrix. The first and second penalties are summed up to compute a pre-score for each diagnostic sample. Finally, the diagnostic model is evaluated using a metric that is based on sum of pre-scores, and scores from a perfect and a null multi-label multi-class computational diagnostic model.
Information query