Preprocessing and imputing method for structural data

    公开(公告)号:US11841839B1

    公开(公告)日:2023-12-12

    申请号:US18143059

    申请日:2023-05-03

    Applicant: ZHEJIANG LAB

    CPC classification number: G06F16/215 G06N3/0455 G06N3/0475

    Abstract: The present invention discloses a preprocessing and imputing method for structural data, comprising: step 1, querying the missing information of an original data, counting missing values, and obtaining a missing rate for the original data; step 2, based on the missing rate, performing listwise deletion on the original data, and then traversing the rows to generate corresponding dichotomous arrays, converting the arrays to the form of histogram, calculating the maximum rectangular area formed by the corresponding histogram, and then sorting all rectangular areas to obtain the maximum complete information matrix; step 3, using multiple imputation by chained equations, auto-encoders, or generative adversarial imputation networks to impute missing values on the original data. The present invention can carry out missing information statistics on the original data, automatically search the maximum complete information that meets the conditions, impute the structural data, greatly improve the quality of the original dataset and convenience for subsequent prediction tasks.

Patent Agency Ranking