公开(公告)号：US20230350936A1

公开(公告)日：2023-11-02

申请号：US18141337

申请日：2023-04-28

Applicant: DeepMind Technologies Limited

Inventor： Jean-Baptiste Alayrac ,  Jeffrey Donahue ,  Karel Lenc ,  Karen Simonyan ,  Malcolm Kevin Campbell Reynolds ,  Pauline Luc ,  Arthur Mensch ,  Iain Barr ,  Antoine Miech ,  Yana Elizabeth Hasson ,  Katherine Elizabeth Millican ,  Roman Ring

IPC: G06F16/432 ,  G06F40/284 ,  G06F16/438

CPC classification number: G06F16/432 ,  G06F16/438 ,  G06F40/284

Abstract: A query processing system is described which receives a query input comprising an input token string and also at least one data item having a second, different modality, and generates a corresponding output token string.

公开(公告)号：US20230053618A1

公开(公告)日：2023-02-23

申请号：US17797198

申请日：2021-02-08

Applicant: DeepMind Technologies Limited

Inventor： Pauline Luc ,  Aidan Clark ,  Sander Etienne Lea Dieleman ,  Karen Simonyan

IPC: G06T11/00 ,  G06T3/00 ,  G06T7/10 ,  G06V10/764 ,  G06V10/82 ,  G06T3/40

Abstract: A recurrent unit is proposed which, at each of a series of time steps receives a corresponding input vector and generates an output at the time step having at least one component for each of a two-dimensional array of pixels. The recurrent unit is configured, at each of the series of time steps except the first, to receive the output of the recurrent unit at the preceding time step, and to apply to the output of the recurrent unit at the preceding time step at least one convolution which depends on the input vector at the time step. The convolution further depends upon the output of the recurrent unit at the preceding time step. This convolution generates a warped dataset which has at least one component for each pixel of the array. The output of the recurrent unit at each time step is based on the warped dataset and the input vector.