公开(公告)号：US20190087469A1

公开(公告)日：2019-03-21

申请号：US15707594

申请日：2017-09-18

Applicant: Google Inc.

Inventor： Stephanie Zhang ,  Jon Vaver

IPC: G06F17/30 ,  G06F17/18 ,  G06Q30/02

Abstract: Systems and methods for model validation includes generating a first and a second time series of segmentation states for a data set representative of a simulated population, e.g., a collection of membership counts corresponding to respective segments of the simulated population. The first and second time series of segmentation states are generated by respectively processing the data set through a first and a second simulation each comprising iterative application of a plurality of event functions. The first and the second simulation differ in at least one capacity, e.g., one including a first event function configured with a first parameter, and the second not. Analysis of differences between the first and second time series may be compared to analysis of one of the time series using a subject model. The comparison is then used to validate the model or demonstrate accuracies, inaccuracies, and/or model bias with respect to a performance metric.

公开(公告)号：US10719521B2

公开(公告)日：2020-07-21

申请号：US15707594

申请日：2017-09-18

Applicant: Google Inc.

Inventor： Stephanie Zhang ,  Jon Vaver

IPC: G06G7/00 ,  G06F16/2458 ,  G06F17/18 ,  G06Q30/02 ,  G06F16/242 ,  G06F17/16

Abstract: Systems and methods for model validation includes generating a first and a second time series of segmentation states for a data set representative of a simulated population, e.g., a collection of membership counts corresponding to respective segments of the simulated population. The first and second time series of segmentation states are generated by respectively processing the data set through a first and a second simulation each comprising iterative application of a plurality of event functions. The first and the second simulation differ in at least one capacity, e.g., one including a first event function configured with a first parameter, and the second not. Analysis of differences between the first and second time series may be compared to analysis of one of the time series using a subject model. The comparison is then used to validate the model or demonstrate accuracies, inaccuracies, and/or model bias with respect to a performance metric.