公开(公告)号：US12159221B2

公开(公告)日：2024-12-03

申请号：US16766945

申请日：2019-03-11

Applicant: DeepMind Technologies Limited

Inventor： Gregory Duncan Wayne ,  Chia-Chun Hung ,  David Antony Amos ,  Mehdi Mirza Mohammadi ,  Arun Ahuja ,  Timothy Paul Lillicrap

IPC: G06N3/08 ,  G06N3/045

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.

公开(公告)号：US20210034969A1

公开(公告)日：2021-02-04

申请号：US16766945

申请日：2019-03-11

Applicant: DeepMind Technologies Limited

Inventor： Gregory Duncan Wayne ,  Chia-Chun Hung ,  David Antony Amos ,  Mehdi Mirza Mohammadi ,  Arun Ahuja ,  Timothy Paul Lillicrap

IPC: G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.

公开(公告)号：US20250051289A1

公开(公告)日：2025-02-13

申请号：US18929321

申请日：2024-10-28

Applicant: DeepMind Technologies Limited

Inventor： Gregory Duncan Wayne ,  Chia-Chun Hung ,  David Antony Amos ,  Mehdi Mirza Mohammadi ,  Arun Ahuja ,  Timothy Paul Lillicrap

IPC: C07D239/47 ,  A61P35/00 ,  C07C275/36

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.