METHOD AND SYSTEM FOR EVALUATING CLINICAL EFFICACY OF MULTI-LABEL MULTI-CLASS COMPUTATIONAL DIAGNOSTIC MODELS

    公开(公告)号:US20240096492A1

    公开(公告)日:2024-03-21

    申请号:US18367546

    申请日:2023-09-13

    CPC classification number: G16H50/20

    Abstract: The present invention relates to the field of evaluating clinical diagnostic models. Conventional metrics does not consider context dependent clinical principles and is unable to capture critically important features that ought to be present in a diagnostic model. Thus, present disclosure provides a method and system for evaluating clinical efficacy of multi-label multi-class computational diagnostic models. Diagnosis for a given dataset of diagnostic samples is obtained from the diagnostic model which is then classified as wrong, missed, over or right diagnosis, based on which a first penalty is calculated. A second penalty is calculated for each diagnostic sample using a contradiction matrix. The first and second penalties are summed up to compute a pre-score for each diagnostic sample. Finally, the diagnostic model is evaluated using a metric that is based on sum of pre-scores, and scores from a perfect and a null multi-label multi-class computational diagnostic model.

    METHOD AND SYSTEM FOR CONTRADICTION AVOIDED LEARNING FOR MULTI-CLASS MULTI-LABEL CLASSIFICATION

    公开(公告)号:US20240143630A1

    公开(公告)日:2024-05-02

    申请号:US18383930

    申请日:2023-10-26

    CPC classification number: G06F16/285

    Abstract: This disclosure relates generally to multi-class multi-label classification and more particularly to contradiction avoided learning for multi-class multi-label classification. Conventional classification methods do not consider contradictory outcomes in multi-label classification tasks wherein contradictory outcomes have significant negative impact in the classification problem solution. The present disclosure provides a contradiction avoided learning multi-class multi-label classification. The disclosed method utilizes a binary contradiction matrix constructed using domain knowledge. Based on the binary contradiction matrix the training dataset is divided into two parts, one comprising contradictions and the second without contradictions. The classification model is trained using the divided datasets using a contradiction loss and a binary cross entropy loss to avoid contradictions during learning of the classification model. The disclosed method is used for electrocardiogram classification, shape classification and so on.

Patent Agency Ranking