公开(公告)号：US11720795B2

公开(公告)日：2023-08-08

申请号：US15531212

申请日：2014-11-26

申请人： CANARY CAPITAL LLC

发明人： Harri Valpola

IPC分类号： G06N3/084 ,  G06N20/00 ,  G06N3/02 ,  G06N7/04

CPC分类号： G06N3/084 ,  G06N3/02 ,  G06N7/046 ,  G06N20/00

摘要： Disclosed is a neural network structure enabling efficient training of the network and a method thereto. The structure is a ladder-type structure wherein one or more lateral input(s) is/are taken to decoding functions. By minimizing one or more cost function(s) belonging to the structure the neural network structure may be trained in an efficient way.

公开(公告)号：US11138468B2

公开(公告)日：2021-10-05

申请号：US16615002

申请日：2018-05-21

申请人： CANARY CAPITAL LLC

发明人： Matti Herranen ,  Harri Valpola

IPC分类号： G06K9/62 ,  G06N3/04 ,  G06N3/08

摘要： A method for generating an output signal of a system based on input data received by the system includes receiving training data and training a neural network for generating the output signal by optimizing a primary cost function and an auxiliary cost function and modulating the auxiliary cost function with a gradient-based attention mask during the training.

公开(公告)号：US11669056B2

公开(公告)日：2023-06-06

申请号：US16760591

申请日：2018-10-31

申请人： CANARY CAPITAL LLC

发明人： Harri Valpola ,  Eva Koppali

IPC分类号： G05B13/02 ,  G05B13/04 ,  G06N3/08 ,  G06N3/045 ,  G06N3/02

CPC分类号： G05B13/027 ,  G05B13/048 ,  G06N3/045 ,  G06N3/08 ,  G06N3/02

摘要： The invention relates to a method for generating a control system for a target system, wherein: operational data is received; a first neural model component is trained with the received operational data for generating a prediction on a state of the target system based on the received operational data; a second neural model component is trained with the operational data for generating a regularizer for use in inverting the first neural model component; and the control system is generated by inverting the first neural model component by optimization and arranging to apply the regularizer generated with the second neural model component in the optimization. The invention relates also to a system and a computer program product.

公开(公告)号：US11481585B2

公开(公告)日：2022-10-25

申请号：US16303333

申请日：2017-05-19

申请人： CANARY CAPITAL LLC

发明人： Harri Valpola ,  Klaus Greff

IPC分类号： G06K9/62 ,  G06N3/02 ,  G06N3/08

摘要： Disclosed is a computer-implemented method for segmenting input data. In the method a plurality of tags is generated; the input data is masked with the plurality of tags; a plurality of output reconstructions is generated by inputting the plurality of masked input data to one of the following: a denoising neural network, a variational autoencoder; a plurality of values representing distances of each plurality of output reconstructions to the input data are determined; a plurality of updated versions of input data is generated by applying at least one of the determined values representing distances of each plurality of output reconstructions to the input data; and updated output reconstructions are generated by inputting the plurality of updated versions of input data to one of the networks. Also disclosed is a method for training the network and a processing unit.

公开(公告)号：US11568208B2

公开(公告)日：2023-01-31

申请号：US16677851

申请日：2019-11-08

申请人： CANARY CAPITAL LLC

发明人： Harri Valpola

IPC分类号： G06N3/04 ,  G06N20/00 ,  G06N3/10 ,  G06N3/08

摘要： Disclosed is a computer-implemented method for estimating an uncertainty of a prediction generated by a machine learning system, the method including: receiving first data; training a first machine learning model component of a machine learning system with the received first data, the first machine learning model component is trained to generate a prediction; generating an uncertainty estimate of the prediction; training a second machine learning model component of the machine learning system with second data, the second machine learning model component is trained to generate a calibrated uncertainty estimate of the prediction. Also disclosed is a corresponding system.

公开(公告)号：US11620511B2

公开(公告)日：2023-04-04

申请号：US16486576

申请日：2018-02-14

申请人： CANARY CAPITAL LLC

发明人： Harri Valpola

IPC分类号： G06N3/08 ,  G06N3/04

摘要： Disclosed is a computer-implemented method for training a neural network system including an original neural network and a label generator. The method is based on an idea that the neural network system is trained by a sequence of training steps where at each training step at least one of a plurality of operations is performed and each of the operations gets performed at least once during training of the neural network system. Also disclosed are a neural network system and a computer program product.