-
公开(公告)号:US20230196146A1
公开(公告)日:2023-06-22
申请号:US18168123
申请日:2023-02-13
Applicant: DeepMind Technologies Limited
Inventor: Yujia Li , Victor Constant Bapst , Vinicius Zambaldi , David Nunes Raposo , Adam Anthony Santoro
Abstract: A neural network system is proposed, including an input network for extracting, from state data, respective entity data for each a plurality of entities which are present, or at least potentially present, in the environment. The entity data describes the entity. The neural network contains a relational network for parsing this data, which includes one or more attention blocks which may be stacked to perform successive actions on the entity data. The attention blocks each include a respective transform network for each of the entities. The transform network for each entity is able to transform data which the transform network receives for the entity into modified entity data for the entity, based on data for a plurality of the other entities. An output network is arranged to receive data output by the relational network, and use the received data to select a respective action.
-
2.
公开(公告)号:US20240020972A1
公开(公告)日:2024-01-18
申请号:US18029980
申请日:2021-10-01
Applicant: DeepMind Technologies Limited
Inventor: Fengning Ding , Adam Anthony Santoro , Felix George Hill , Matthew Botvinick , Luis Piloto
IPC: G06V20/40 , G06V10/26 , G06V10/82 , G06V10/776
CPC classification number: G06V20/41 , G06V10/26 , G06V10/82 , G06V10/776
Abstract: A video processing system configured to analyze a sequence of video frames to detect objects in the video frames and provide information relating to the detected objects in response to a query. The query may comprise, for example, a request for a prediction of a future event, or of the location of an object, or a request for a prediction of what would happen if an object were modified. The system uses a transformer neural network subsystem to process representations of objects in the video.
-
公开(公告)号:US11836596B2
公开(公告)日:2023-12-05
申请号:US17107621
申请日:2020-11-30
Applicant: DeepMind Technologies Limited
Inventor: Mike Chrzanowski , Jack William Rae , Ryan Faulkner , Theophane Guillaume Weber , David Nunes Raposo , Adam Anthony Santoro
IPC: G06N3/08 , G06N3/042 , G06N3/04 , G06N20/00 , G06F18/2413
CPC classification number: G06N3/042 , G06F18/24137 , G06N3/04 , G06N3/08 , G06N20/00
Abstract: A system including one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to implement a memory and memory-based neural network is described. The memory is configured to store a respective memory vector at each of a plurality of memory locations in the memory. The memory-based neural network is configured to: at each of a plurality of time steps: receive an input; determine an update to the memory, wherein determining the update comprising applying an attention mechanism over the memory vectors in the memory and the received input; update the memory using the determined update to the memory; and generate an output for the current time step using the updated memory.
-
公开(公告)号:US20250093970A1
公开(公告)日:2025-03-20
申请号:US18967935
申请日:2024-12-04
Applicant: DeepMind Technologies Limited
Inventor: Peter Conway Humphreys , Timothy Paul Lillicrap , Tobias Markus Pohlen , Adam Anthony Santoro
IPC: G06F3/033 , G06F3/023 , G06F40/284
Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.
-
公开(公告)号:US11977967B2
公开(公告)日:2024-05-07
申请号:US17113669
申请日:2020-12-07
Applicant: DeepMind Technologies Limited
IPC: G06N3/06 , G06N3/0455 , G06N3/049 , G06N20/00 , G06F16/908 , G06N3/084
CPC classification number: G06N3/06 , G06N3/0455 , G06N3/049 , G06N20/00 , G05B2219/33025 , G06F16/908 , G06N3/084
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating sequences of predicted observations, for example images. In one aspect, a system comprises a controller recurrent neural network, and a decoder neural network to process a set of latent variables to generate an observation. An external memory and a memory interface subsystem is configured to, for each of a plurality of time steps, receive an updated hidden state from the controller, generate a memory context vector by reading data from the external memory using the updated hidden state, determine a set of latent variables from the memory context vector, generate a predicted observation by providing the set of latent variables to the decoder neural network, write data to the external memory using the latent variables, the updated hidden state, or both, and generate a controller input for a subsequent time step from the latent variables.
-
公开(公告)号:US20190354885A1
公开(公告)日:2019-11-21
申请号:US16417580
申请日:2019-05-20
Applicant: DeepMind Technologies Limited
Inventor: Yujia Li , Victor Constant Bapst , Vinicius Zambaldi , David Nunes Raposo , Adam Anthony Santoro
Abstract: A neural network system is proposed, including an input network for extracting, from state data, respective entity data for each a plurality of entities which are present, or at least potentially present, in the environment. The entity data describes the entity. The neural network contains a relational network for parsing this data, which includes one or more attention blocks which may be stacked to perform successive actions on the entity data. The attention blocks each include a respective transform network for each of the entities. The transform network for each entity is able to transform data which the transform network receives for the entity into modified entity data for the entity, based on data for a plurality of the other entities. An output network is arranged to receive data output by the relational network, and use the received data to select a respective action.
-
公开(公告)号:US20210089968A1
公开(公告)日:2021-03-25
申请号:US17113669
申请日:2020-12-07
Applicant: DeepMind Technologies Limited
IPC: G06N20/00
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating sequences of predicted observations, for example images. In one aspect, a system comprises a controller recurrent neural network, and a decoder neural network to process a set of latent variables to generate an observation. An external memory and a memory interface subsystem is configured to, for each of a plurality of time steps, receive an updated hidden state from the controller, generate a memory context vector by reading data from the external memory using the updated hidden state, determine a set of latent variables from the memory context vector, generate a predicted observation by providing the set of latent variables to the decoder neural network, write data to the external memory using the latent variables, the updated hidden state, or both, and generate a controller input for a subsequent time step from the latent variables.
-
公开(公告)号:US10885426B2
公开(公告)日:2021-01-05
申请号:US15396289
申请日:2016-12-30
Applicant: DeepMind Technologies Limited
Inventor: Adam Anthony Santoro , Daniel Pieter Wiestra , Timothy Paul Lillicrap , Sergey Bartunov , Ivo Danihelka
IPC: G06N3/063 , G06N3/04 , G06N3/08 , G06F12/123
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for augmenting neural networks with an external memory. One of the systems includes a controller neural network that includes a Least Recently Used Access (LRUA) subsystem configured to: maintain a respective usage weight for each of a plurality of locations in the external memory, and for each of the plurality of time steps: generate a respective reading weight for each location using a read key, read data from the locations in accordance with the reading weights, generate a respective writing weight for each of the locations from a respective reading weight from a preceding time step and the respective usage weight for the location, write a write vector to the locations in accordance with the writing weights, and update the respective usage weight from the respective reading weight and the respective writing weight.
-
公开(公告)号:US12189870B2
公开(公告)日:2025-01-07
申请号:US18103309
申请日:2023-01-30
Applicant: DeepMind Technologies Limited
Inventor: Peter Conway Humphreys , Timothy Paul Lillicrap , Tobias Markus Pohlen , Adam Anthony Santoro
IPC: G06F3/023 , G06F3/033 , G06F40/284
Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.
-
公开(公告)号:US20230244325A1
公开(公告)日:2023-08-03
申请号:US18103309
申请日:2023-01-30
Applicant: DeepMind Technologies Limited
Inventor: Peter Conway Humphreys , Timothy Paul Lillicrap , Tobias Markus Pohlen , Adam Anthony Santoro
IPC: G06F3/033 , G06F3/023 , G06F40/284
CPC classification number: G06F3/033 , G06F3/023 , G06F40/284
Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.
-
-
-
-
-
-
-
-
-