公开(公告)号：US20250103856A1

公开(公告)日：2025-03-27

申请号：US18832817

申请日：2023-01-30

Applicant: DeepMind Technologies Limited

Inventor： Joao Carreira ,  Andrew Coulter Jaegle ,  Skanda Kumar Koppula ,  Daniel Zoran ,  Adrià Recasens Continente ,  Catalin-Dumitru Ionescu ,  Olivier Jean Hénaff ,  Evan Gerard Shelhamer ,  Relja Arandjelovic ,  Matthew Botvinick ,  Oriol Vinyals ,  Karen Simonyan ,  Andrew Zisserman

IPC: G06N3/045

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for using a neural network to generate a network output that characterizes an entity. In one aspect, a method includes: obtaining a representation of the entity as a set of data element embeddings, obtaining a set of latent embeddings, and processing: (i) the set of data element embeddings, and (ii) the set of latent embeddings, using the neural network to generate the network output. The neural network includes a sequence of neural network blocks including: (i) one or more local cross-attention blocks, and (ii) an output block. Each local cross-attention block partitions the set of latent embeddings and the set of data element embeddings into proper subsets, and updates each proper subset of the set of latent embeddings using attention over only the corresponding proper subset of the set of data element embeddings.