-
公开(公告)号:US20250147810A1
公开(公告)日:2025-05-08
申请号:US18936711
申请日:2024-11-04
Applicant: DeepMind Technologies Limited
Inventor: Bernardino Romera-Paredes , Alexander Novikov , Mohammadamin Barekatain , Matej Balog , Pawan Kumar Mudigonda , Emilien Dupont , Francisco Jesus Rodriguez Ruiz , Alhussein Fawzi
IPC: G06F9/50
Abstract: Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for scheduling jobs across a plurality of computational resources. Scheduling jobs (e.g., compute jobs) on a plurality of computational resources (e.g., a cluster that includes physical machines, virtual machines or both) can include assigning jobs to computational resources using respective scores for the computational resources that take into account several attributes, including central processing unit (CPU) requirements, memory requirements, and availability. That is, by generating a score that more accurately reflects the likelihood that a given computational resource is the optimal computational resource to place a given job, the resulting job schedule significantly minimizes idle time of the set of computational resources and enhances the throughput of completed jobs.
-
公开(公告)号:US12288547B2
公开(公告)日:2025-04-29
申请号:US17339834
申请日:2021-06-04
Applicant: DeepMind Technologies Limited
Inventor: Jeffrey Donahue , Karen Simonyan , Sander Etienne Lea Dieleman , Mikolaj Binkowski , Erich Konrad Elsen
IPC: G10L13/047 , G06N3/04 , G06N3/08
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a generative neural network to convert conditioning text inputs to audio outputs. The generative neural network includes an alignment neural network that is configured to receive a generative input that includes the conditioning text input and to process the generative input to generate an aligned conditioning sequence that comprises a respective feature representation at each of a plurality of first time steps and that is temporally aligned with the audio output.
-
公开(公告)号:US20250131254A1
公开(公告)日:2025-04-24
申请号:US18924844
申请日:2024-10-23
Applicant: DeepMind Technologies Limited
Inventor: Kaitlin Marguerite-Lois Maile , Andrea Gesmundo
IPC: G06N3/0499 , G06F17/16 , G06N3/084
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. In one aspect, the method includes: obtaining a baseline architecture for the neural network; generating an expanded architecture for the neural network; and training the neural network having the expanded architecture.
-
公开(公告)号:US20250103856A1
公开(公告)日:2025-03-27
申请号:US18832817
申请日:2023-01-30
Applicant: DeepMind Technologies Limited
Inventor: Joao Carreira , Andrew Coulter Jaegle , Skanda Kumar Koppula , Daniel Zoran , Adrià Recasens Continente , Catalin-Dumitru Ionescu , Olivier Jean Hénaff , Evan Gerard Shelhamer , Relja Arandjelovic , Matthew Botvinick , Oriol Vinyals , Karen Simonyan , Andrew Zisserman
IPC: G06N3/045
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for using a neural network to generate a network output that characterizes an entity. In one aspect, a method includes: obtaining a representation of the entity as a set of data element embeddings, obtaining a set of latent embeddings, and processing: (i) the set of data element embeddings, and (ii) the set of latent embeddings, using the neural network to generate the network output. The neural network includes a sequence of neural network blocks including: (i) one or more local cross-attention blocks, and (ii) an output block. Each local cross-attention block partitions the set of latent embeddings and the set of data element embeddings into proper subsets, and updates each proper subset of the set of latent embeddings using attention over only the corresponding proper subset of the set of data element embeddings.
-
公开(公告)号:US12260334B2
公开(公告)日:2025-03-25
申请号:US18497924
申请日:2023-10-30
Applicant: DeepMind Technologies Limited
Inventor: Scott Ellison Reed , Joao Ferdinando Gomes de Freitas
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for neural programming. One of the methods includes processing a current neural network input using a core recurrent neural network to generate a neural network output; determining, from the neural network output, whether or not to end a currently invoked program and to return to a calling program from the set of programs; determining, from the neural network output, a next program to be called; determining, from the neural network output, contents of arguments to the next program to be called; receiving a representation of a current state of the environment; and generating a next neural network input from an embedding for the next program to be called and the representation of the current state of the environment.
-
公开(公告)号:US12189688B2
公开(公告)日:2025-01-07
申请号:US18373870
申请日:2023-09-27
Applicant: DeepMind Technologies Limited
Inventor: Sivaramakrishnan Swaminathan , Meet Kirankumar Dave , Miguel Lazaro-Gredilla , Dileep George
IPC: G06F16/901 , G06F17/12
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a graph model representing an environment being interacted with by an agent. In one aspect, one of the methods include: obtaining experience data; using the experience data to update a visitation count for each of one or more state-action pairs represented by the graph model; and at each of multiple environment exploration steps: computing a utility measure for each of the one or more state-action pairs represented by the graph model; determining, based on the utility measures, a sequence of one or more planned actions that have an information gain that satisfies a threshold; and controlling the agent to perform the sequence of one or more planned actions to cause the environment to transition from a state characterized by a last observation received after a last action in the experience data into a different state.
-
公开(公告)号:US12159221B2
公开(公告)日:2024-12-03
申请号:US16766945
申请日:2019-03-11
Applicant: DeepMind Technologies Limited
Inventor: Gregory Duncan Wayne , Chia-Chun Hung , David Antony Amos , Mehdi Mirza Mohammadi , Arun Ahuja , Timothy Paul Lillicrap
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a memory-based prediction system configured to receive an input observation characterizing a state of an environment interacted with by an agent and to process the input observation and data read from a memory to update data stored in the memory and to generate a latent representation of the state of the environment. The method comprises: for each of a plurality of time steps: processing an observation for the time step and data read from the memory to: (i) update the data stored in the memory, and (ii) generate a latent representation of the current state of the environment as of the time step; and generating a predicted return that will be received by the agent as a result of interactions with the environment after the observation for the time step is received.
-
公开(公告)号:US20240394504A1
公开(公告)日:2024-11-28
申请号:US18637279
申请日:2024-04-16
Applicant: DeepMind Technologies Limited
Inventor: Misha Man Ray Denil , Sergio Gomez Colmenarejo , Serkan Cabi , David William Saxton , Joao Ferdinando Gomes de Freitas
Abstract: A reinforcement learning system is proposed comprising a plurality of property detector neural networks. Each property detector neural network is arranged to receive data representing an object within an environment, and to generate property data associated with a property of the object. A processor is arranged to receive an instruction indicating a task associated with an object having an associated property, and process the output of the plurality of property detector neural networks based upon the instruction to generate a relevance data item. The relevance data item indicates objects within the environment associated with the task. The processor also generates a plurality of weights based upon the relevance data item, and, based on the weights, generates modified data representing the plurality of objects within the environment. A neural network is arranged to receive the modified data and to output an action associated with the task.
-
公开(公告)号:US20240386334A1
公开(公告)日:2024-11-21
申请号:US18668101
申请日:2024-05-17
Applicant: DeepMind Technologies Limited
Inventor: Christopher Mattern
IPC: G06N20/20
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media. for making sequential predictions using hierarchical forecasting models.
-
公开(公告)号:US12147899B2
公开(公告)日:2024-11-19
申请号:US18528640
申请日:2023-12-04
Applicant: DeepMind Technologies Limited
Inventor: Karen Simonyan , David Silver , Julian Schrittwieser
Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media, for training an action selection neural network. One of the methods includes receiving an observation characterizing a current state of the environment; determining a target network output for the observation by performing a look ahead search of possible future states of the environment starting from the current state until the environment reaches a possible future state that satisfies one or more termination criteria, wherein the look ahead search is guided by the neural network in accordance with current values of the network parameters; selecting an action to be performed by the agent in response to the observation using the target network output generated by performing the look ahead search; and storing, in an exploration history data store, the target network output in association with the observation for use in updating the current values of the network parameters.
-
-
-
-
-
-
-
-
-