公开(公告)号：US11182280B2

公开(公告)日：2021-11-23

申请号：US15839281

申请日：2017-12-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Aleksandrs Slivkins ,  John Langford ,  Markus Cozowicz ,  Alekh Agarwal ,  Siddhartha Sen

IPC: G06F11/36 ,  G06F11/34 ,  G06F8/38 ,  G06T11/20 ,  G06F9/451 ,  G06N20/00 ,  H04L29/08 ,  G06Q30/02

Abstract: The claimed subject matter includes techniques for providing an application testing service with a user interface that enables a user to evaluate performance data for computer implemented decision policies. An example method includes displaying a first reward statistic comprising an actual performance result for a policy implemented by an application. The method also includes obtaining experimental data corresponding to previously implemented policies, computing a second reward statistic for a hypothetical policy using a reward function applied to the experimental data. The method also includes displaying the second reward statistic together with the first reward statistic to enable a user to compare the first reward statistic and the second first reward statistic.

公开(公告)号：US20170308535A1

公开(公告)日：2017-10-26

申请号：US15136688

申请日：2016-04-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Alekh Agarwal ,  Miroslav Dudik ,  Akshay Krishnamurthy ,  John Langford ,  Adith Swaminathan

IPC: G06F17/30 ,  G06N7/00

CPC classification number: G06F16/24578 ,  G06F16/248 ,  G06F16/3326 ,  G06F16/337 ,  G06F16/9535 ,  G06N7/005

Abstract: A computing device can determine a decomposition of data of actions of a first session based at least in part on a first computational model associating the actions of the first session with corresponding state values of the first session. The computing device can determine a second computational model based at least in part on the decomposition and an operation template. The computing device can receive a query via the communications interface, the query associated with the second session. The computing device can determine a state value of the second session based at least in part on the query. The computing device can operate the second computational model to determine at least one response associated with the query based at least in part on the state value of the second session. The computing device can provide an indication of the at least one response via the communications interface.