Invention Grant
- Patent Title: Associative long short-term memory neural network layers
-
Application No.: US15395553Application Date: 2016-12-30
-
Publication No.: US11010663B2Publication Date: 2021-05-18
- Inventor: Ivo Danihelka , Nal Emmerich Kalchbrenner , Gregory Duncan Wayne , Benigno Uría-Martínez , Alexander Benjamin Graves
- Applicant: DeepMind Technologies Limited
- Applicant Address: GB London
- Assignee: DeepMind Technologies Limited
- Current Assignee: DeepMind Technologies Limited
- Current Assignee Address: GB London
- Agency: Fish & Richardson P.C.
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04

Abstract:
Systems, methods, and apparatus, including computer programs encoded on a computer storage medium, related to associative long short-term memory (LSTM) neural network layers configured to maintain N copies of an internal state for the associative LSTM layer, N being an integer greater than one. In one aspect, a system includes a recurrent neural network including an associative LSTM layer, wherein the associative LSTM layer is configured to, for each time step, receive a layer input, update each of the N copies of the internal state using the layer input for the time step and a layer output generated by the associative LSTM layer for a preceding time step, and generate a layer output for the time step using the N updated copies of the internal state.
Public/Granted literature
- US20170228642A1 ASSOCIATIVE LONG SHORT-TERM MEMORY NEURAL NETWORK LAYERS Public/Granted day:2017-08-10
Information query