公开(公告)号：US20230289598A1

公开(公告)日：2023-09-14

申请号：US18174394

申请日：2023-02-24

Applicant: DeepMind Technologies Limited

Inventor： EDWARD THOMAS GREFENSTETTE ,  Karl Moritz Hermann ,  Mustafa Suleyman ,  Philip Blunsom

IPC: G06N3/08 ,  G06N3/063 ,  G06N3/044 ,  G06N3/082

CPC classification number: G06N3/08 ,  G06N3/063 ,  G06N3/044 ,  G06N3/082

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for augmenting neural networks with an external memory. One of the methods includes providing an output derived from the neural network output for the time step as a system output for the time step; maintaining a current state of the external memory; determining, from the neural network output for the time step, memory state parameters for the time step; updating the current state of the external memory using the memory state parameters for the time step; reading data from the external memory in accordance with the updated state of the external memory; and combining the data read from the external memory with a system input for the next time step to generate the neural network input for the next time step.