公开(公告)号：US20230316081A1

公开(公告)日：2023-10-05

申请号：US18011873

申请日：2022-05-06

Applicant: Google LLC

Inventor： Mark Sandler ,  Andrey Zhmoginov ,  Thomas Edward Madams ,  Maksym Vladymyrov ,  Nolan Andrew Miller ,  Blaise Aguera-Arcas ,  Andrew Michael Jackson

IPC: G06N3/084 ,  G06N3/04

CPC classification number: G06N3/084 ,  G06N3/04

Abstract: The present disclosure provides a new type of generalized artificial neural network where neurons and synapses maintain multiple states. While classical gradient-based backpropagation in artificial neural networks can be seen as a special case of a two-state network where one state is used for activations and another for gradients with update rules derived from the chain rule, example implementations of the generalized framework proposed herein may additionally: have neither explicit notion of nor ever receive gradients; contain more than two states; and/or implement or apply learned (e.g., meta-learned) update rules that control updates to the state(s) of the neuron during forward and/or backward propagation of information.