公开(公告)号：US20160179063A1

公开(公告)日：2016-06-23

申请号：US14573866

申请日：2014-12-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Alexandre De Baynast De Septfontaines ,  Markus Cozowicz ,  Philipp Kranen ,  Thomas Santen

IPC: G05B15/02

CPC classification number: G05B15/02 ,  G06Q10/10 ,  H04L41/0853 ,  H04L41/0883 ,  H04L43/045 ,  H04L43/08

Abstract: A control system is described which receives a live data steam of time stamped sensor data observed from a system. The control system accesses a store of time-stamped sensor data from the live data stream. A plurality of pipeline configurations is generated for analyzing the live data stream. Each pipeline configuration comprises a plurality of components for analyzing data, an order of the components, and values of one or more parameters of each component. The pipeline configurations are evaluated by applying the pipeline configurations to data from the store. A ground truth selector is configured to receive user input comprising ground truth data being labeled data items from the store of time-stamped sensor data. The pipeline configurations are re-evaluated using the ground truth data to select one of the pipeline configurations. Control is achieved using output of the selected one of the pipeline configurations executing on the live data stream.

Abstract translation: 描述了一种控制系统，其接收从系统观察到的具有时间戳的传感器数据的实况数据蒸汽。 控制系统从实时数据流访问时间戳的传感器数据的存储。 生成用于分析实时数据流的多个流水线配置。 每个流水线配置包括用于分析数据，组件的顺序以及每个组件的一个或多个参数的值的多个组件。 通过将管道配置应用于存储的数据来评估流水线配置。 地面真相选择器被配置为从时间戳传感器数据的存储区接收包括被标记数据项的地面真实数据的用户输入。 使用地面真值数据对流水线配置进行重新评估，以选择其中一个流水线配置。 使用在实时数据流上执行的所选流水线配置的输出来实现控制。

公开(公告)号：US11182280B2

公开(公告)日：2021-11-23

申请号：US15839281

申请日：2017-12-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Aleksandrs Slivkins ,  John Langford ,  Markus Cozowicz ,  Alekh Agarwal ,  Siddhartha Sen

IPC: G06F11/36 ,  G06F11/34 ,  G06F8/38 ,  G06T11/20 ,  G06F9/451 ,  G06N20/00 ,  H04L29/08 ,  G06Q30/02

Abstract: The claimed subject matter includes techniques for providing an application testing service with a user interface that enables a user to evaluate performance data for computer implemented decision policies. An example method includes displaying a first reward statistic comprising an actual performance result for a policy implemented by an application. The method also includes obtaining experimental data corresponding to previously implemented policies, computing a second reward statistic for a hypothetical policy using a reward function applied to the experimental data. The method also includes displaying the second reward statistic together with the first reward statistic to enable a user to compare the first reward statistic and the second first reward statistic.