Multiple-action computational model training and operation

    公开(公告)号:US10909450B2

    公开(公告)日:2021-02-02

    申请号:US15084113

    申请日:2016-03-29

    Abstract: A processing unit can determine a first feature value corresponding to a session by operating a first network computational model (NCM) based part on information of the session. The processing unit can determine respective second feature values corresponding to individual actions of a plurality of actions by operating a second NCM. The second NCM can use a common set of parameters in determining the second feature values. The processing unit can determine respective expectation values of some of the actions of the plurality of actions based on the first feature value and the respective second feature values. The processing unit can select a first action of the plurality of actions based on at least one of the expectation values. In some examples, the processing unit can operate an NCM to determine expectation values based on information of a session and information of respective actions.

    Training and operating multi-layer computational models

    公开(公告)号:US10445650B2

    公开(公告)日:2019-10-15

    申请号:US14949156

    申请日:2015-11-23

    Abstract: A processing unit can successively operate layers of a multilayer computational graph (MCG) according to a forward computational order to determine a topic value associated with a document based at least in part on content values associated with the document. The processing unit can successively determine, according to a reverse computational order, layer-specific deviation values associated with the layers based at least in part on the topic value, the content values, and a characteristic value associated with the document. The processing unit can determine a model adjustment value based at least in part on the layer-specific deviation values. The processing unit can modify at least one parameter associated with the MCG based at least in part on the model adjustment value. The MCG can be operated to provide a result characteristic value associated with test content values of a test document.

    Multi-model controller
    5.
    发明授权

    公开(公告)号:US11170293B2

    公开(公告)日:2021-11-09

    申请号:US14985017

    申请日:2015-12-30

    Abstract: A processing unit can operate a first recurrent computational model (RCM) to provide first state information and a predicted result value. The processing unit can operating a first network computational model (NCM) to provide respective expectation values of a plurality of actions based at least in part on the first state information. The processing unit can provide an indication of at least one of the plurality of actions, and receive a reference result value, e.g., via a communications interface. The processing unit can train the first RCM based at least in part on the predicted result value and the reference result value to provide a second RCM, and can train the first NCM based at least in part on the first state information and the at least one of the plurality of actions to provide a second NCM.

    Semantically-relevant discovery of solutions

    公开(公告)号:US10133729B2

    公开(公告)日:2018-11-20

    申请号:US14839281

    申请日:2015-08-28

    Abstract: Systems, methods, and computer-readable media for providing semantically-relevant discovery of solutions are described herein. In some examples, a computing device can receive an input, such as a query. The computing device can process each word of the input sequentially to determine a semantic representation of the input. Techniques and technologies described herein determine a response to the input, such as an answer, based on the semantic representation of the input matching a semantic representation of the response. An output including one or more relevant responses to the request can then be provided to the requestor. Example techniques described herein can apply machine learning to train a model with click-through data to provide semantically-relevant discovery of solutions. Example techniques described herein can apply recurrent neural networks (RNN) and/or long short term memory (LSTM) cells in the machine learning model.

    TRAINING AND OPERATION OF COMPUTATIONAL MODELS
    7.
    发明申请
    TRAINING AND OPERATION OF COMPUTATIONAL MODELS 审中-公开
    计算模型的培训与操作

    公开(公告)号:US20160379112A1

    公开(公告)日:2016-12-29

    申请号:US14754474

    申请日:2015-06-29

    CPC classification number: G06N3/08 G06N3/0454 G06N3/049 G06N20/00

    Abstract: A processing unit can acquire datasets from respective data sources, each having a respective unique data domain. The processing unit can determine values of a plurality of features based on the plurality of datasets. The processing unit can modify input-specific parameters or history parameters of a computational model based on the values of the features. In some examples, the processing unit can determine an estimated value of a target feature based at least in part on the modified computational model and values of one or more reference features. In some examples, the computational model can include neural networks for several input sets. An output layer of at least one of the neural networks can be connected to the respective hidden layer(s) of one or more other(s) of the neural networks. In some examples, the neural networks can be operated to provide transformed feature value(s) for respective times.

    Abstract translation: 处理单元可以从相应的数据源获取数据集,每个数据源具有相应的唯一数据域。 处理单元可以基于多个数据集来确定多个特征的值。 处理单元可以基于特征的值修改计算模型的输入特定参数或历史参数。 在一些示例中,处理单元可以至少部分地基于修改的计算模型和一个或多个参考特征的值来确定目标特征的估计值。 在一些示例中,计算模型可以包括用于多个输入集合的神经网络。 至少一个神经网络的输出层可以连接到神经网络的一个或多个其他神经网络的相应隐藏层。 在一些示例中,可以操作神经网络以在相应时间提供变换的特征值。

    Unsupervised learning utilizing sequential output statistics

    公开(公告)号:US10776716B2

    公开(公告)日:2020-09-15

    申请号:US15621753

    申请日:2017-06-13

    Abstract: In classification tasks applicable to data that exhibit sequential output statistics, a classifier may be trained in an unsupervised manner based on a sequence of input samples and an unaligned sequence of output labels, using a cost function that measures the negative cross-entropy of an N-gram joint probability distribution derived from the sequence of output labels with respect to an expected N-gram frequency in a second sequence of output labels predicted by the classifier. In some embodiments, a primal-dual reformulation of the cost function is employed to facilitate optimization.

    MULTIPLE-ACTION COMPUTATIONAL MODEL TRAINING AND OPERATION

    公开(公告)号:US20170286860A1

    公开(公告)日:2017-10-05

    申请号:US15084113

    申请日:2016-03-29

    CPC classification number: G06N3/08 G06N3/0454

    Abstract: A processing unit can determine a first feature value corresponding to a session by operating a first network computational model (NCM) based part on information of the session. The processing unit can determine respective second feature values corresponding to individual actions of a plurality of actions by operating a second NCM. The second NCM can use a common set of parameters in determining the second feature values. The processing unit can determine respective expectation values of some of the actions of the plurality of actions based on the first feature value and the respective second feature values. The processing unit can select a first action of the plurality of actions based on at least one of the expectation values. In some examples, the processing unit can operate an NCM to determine expectation values based on information of a session and information of respective actions.

Patent Agency Ranking