公开(公告)号：US11182280B2

公开(公告)日：2021-11-23

申请号：US15839281

申请日：2017-12-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Aleksandrs Slivkins ,  John Langford ,  Markus Cozowicz ,  Alekh Agarwal ,  Siddhartha Sen

IPC: G06F11/36 ,  G06F11/34 ,  G06F8/38 ,  G06T11/20 ,  G06F9/451 ,  G06N20/00 ,  H04L29/08 ,  G06Q30/02

Abstract: The claimed subject matter includes techniques for providing an application testing service with a user interface that enables a user to evaluate performance data for computer implemented decision policies. An example method includes displaying a first reward statistic comprising an actual performance result for a policy implemented by an application. The method also includes obtaining experimental data corresponding to previously implemented policies, computing a second reward statistic for a hypothetical policy using a reward function applied to the experimental data. The method also includes displaying the second reward statistic together with the first reward statistic to enable a user to compare the first reward statistic and the second first reward statistic.

公开(公告)号：US11049006B2

公开(公告)日：2021-06-29

申请号：US15510356

申请日：2014-09-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： John Langford ,  Gang Li ,  Frank Torsten Bernd Seide ,  James Droppo ,  Dong Yu

IPC: G06N3/08 ,  G06N7/00 ,  G06N3/04

Abstract: Techniques and constructs can reduce the time required to determine solutions to optimization problems such as training of neural networks. Modifications to a computational model can be determined by a plurality of nodes operating in parallel. Quantized modification values can be transmitted between the nodes to reduce the volume of data to be transferred. The quantized values can be as small as one bit each. Quantization-error values can be stored and used in quantizing subsequent modifications. The nodes can operate in parallel and overlap computation and data transfer to further reduce the time required to determine solutions. The quantized values can be partitioned and each node can aggregate values for a corresponding partition.

公开(公告)号：US20170308535A1

公开(公告)日：2017-10-26

申请号：US15136688

申请日：2016-04-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Alekh Agarwal ,  Miroslav Dudik ,  Akshay Krishnamurthy ,  John Langford ,  Adith Swaminathan

IPC: G06F17/30 ,  G06N7/00

CPC classification number: G06F16/24578 ,  G06F16/248 ,  G06F16/3326 ,  G06F16/337 ,  G06F16/9535 ,  G06N7/005

Abstract: A computing device can determine a decomposition of data of actions of a first session based at least in part on a first computational model associating the actions of the first session with corresponding state values of the first session. The computing device can determine a second computational model based at least in part on the decomposition and an operation template. The computing device can receive a query via the communications interface, the query associated with the second session. The computing device can determine a state value of the second session based at least in part on the query. The computing device can operate the second computational model to determine at least one response associated with the query based at least in part on the state value of the second session. The computing device can provide an indication of the at least one response via the communications interface.