公开(公告)号：US10909450B2

公开(公告)日：2021-02-02

申请号：US15084113

申请日：2016-03-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianshu Chen ,  Li Deng ,  Jianfeng Gao ,  Xiadong He ,  Lihong Li ,  Ji He ,  Mari Ostendorf

IPC: G06N3/08 ,  G06N3/04

Abstract: A processing unit can determine a first feature value corresponding to a session by operating a first network computational model (NCM) based part on information of the session. The processing unit can determine respective second feature values corresponding to individual actions of a plurality of actions by operating a second NCM. The second NCM can use a common set of parameters in determining the second feature values. The processing unit can determine respective expectation values of some of the actions of the plurality of actions based on the first feature value and the respective second feature values. The processing unit can select a first action of the plurality of actions based on at least one of the expectation values. In some examples, the processing unit can operate an NCM to determine expectation values based on information of a session and information of respective actions.

公开(公告)号：US10445650B2

公开(公告)日：2019-10-15

申请号：US14949156

申请日：2015-11-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianfeng Gao ,  Li Deng ,  Xiaodong He ,  Lin Xiao ,  Xinying Song ,  Yelong Shen ,  Ji He ,  Jianshu Chen

IPC: G06N7/00

Abstract: A processing unit can successively operate layers of a multilayer computational graph (MCG) according to a forward computational order to determine a topic value associated with a document based at least in part on content values associated with the document. The processing unit can successively determine, according to a reverse computational order, layer-specific deviation values associated with the layers based at least in part on the topic value, the content values, and a characteristic value associated with the document. The processing unit can determine a model adjustment value based at least in part on the layer-specific deviation values. The processing unit can modify at least one parameter associated with the MCG based at least in part on the model adjustment value. The MCG can be operated to provide a result characteristic value associated with test content values of a test document.

公开(公告)号：US20170193360A1

公开(公告)日：2017-07-06

申请号：US14985017

申请日：2015-12-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianfeng Gao ,  Li Deng ,  Xiaodong He ,  Prabhdeep Singh ,  Lihong Li ,  Jianshu Chen ,  Xiujun Li ,  Ji He

IPC: G06N3/08

CPC classification number: G06N3/08 ,  G06N3/0445 ,  G06N3/0454

Abstract: A processing unit can operate a first recurrent computational model (RCM) to provide first state information and a predicted result value. The processing unit can operating a first network computational model (NCM) to provide respective expectation values of a plurality of actions based at least in part on the first state information. The processing unit can provide an indication of at least one of the plurality of actions, and receive a reference result value, e.g., via a communications interface. The processing unit can train the first RCM based at least in part on the predicted result value and the reference result value to provide a second RCM, and can train the first NCM based at least in part on the first state information and the at least one of the plurality of actions to provide a second NCM.

公开(公告)号：US20170147942A1

公开(公告)日：2017-05-25

申请号：US14949156

申请日：2015-11-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianfeng Gao ,  Li Deng ,  Xiaodong He ,  Lin Xiao ,  Xinying Song ,  Yelong Shen ,  Ji He ,  Jianshu Chen

IPC: G06N99/00

CPC classification number: G06N7/005

Abstract: A processing unit can successively operate layers of a multilayer computational graph (MCG) according to a forward computational order to determine a topic value associated with a document based at least in part on content values associated with the document. The processing unit can successively determine, according to a reverse computational order, layer-specific deviation values associated with the layers based at least in part on the topic value, the content values, and a characteristic value associated with the document. The processing unit can determine a model adjustment value based at least in part on the layer-specific deviation values. The processing unit can modify at least one parameter associated with the MCG based at least in part on the model adjustment value. The MCG can be operated to provide a result characteristic value associated with test content values of a test document.

公开(公告)号：US11170293B2

公开(公告)日：2021-11-09

申请号：US14985017

申请日：2015-12-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianfeng Gao ,  Li Deng ,  Xiaodong He ,  Prabhdeep Singh ,  Lihong Li ,  Jianshu Chen ,  Xiujun Li ,  Ji He

IPC: G06N3/08 ,  G06N3/04

Abstract: A processing unit can operate a first recurrent computational model (RCM) to provide first state information and a predicted result value. The processing unit can operating a first network computational model (NCM) to provide respective expectation values of a plurality of actions based at least in part on the first state information. The processing unit can provide an indication of at least one of the plurality of actions, and receive a reference result value, e.g., via a communications interface. The processing unit can train the first RCM based at least in part on the predicted result value and the reference result value to provide a second RCM, and can train the first NCM based at least in part on the first state information and the at least one of the plurality of actions to provide a second NCM.

公开(公告)号：US20170286860A1

公开(公告)日：2017-10-05

申请号：US15084113

申请日：2016-03-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jianshu Chen ,  Li Deng ,  Jianfeng Gao ,  Xiadong He ,  Lihong Li ,  Ji He ,  Mari Ostendorf

IPC: G06N99/00

CPC classification number: G06N3/08 ,  G06N3/0454

Abstract: A processing unit can determine a first feature value corresponding to a session by operating a first network computational model (NCM) based part on information of the session. The processing unit can determine respective second feature values corresponding to individual actions of a plurality of actions by operating a second NCM. The second NCM can use a common set of parameters in determining the second feature values. The processing unit can determine respective expectation values of some of the actions of the plurality of actions based on the first feature value and the respective second feature values. The processing unit can select a first action of the plurality of actions based on at least one of the expectation values. In some examples, the processing unit can operate an NCM to determine expectation values based on information of a session and information of respective actions.