-
公开(公告)号:US20220019807A1
公开(公告)日:2022-01-20
申请号:US17295329
申请日:2019-11-20
Applicant: DeepMind Technologies Limited
Inventor: Joao Carreira , Carl Doersch , Andrew Zisserman
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for classifying actions in a video. One of the methods obtaining a feature representation of a video clip; obtaining data specifying a plurality of candidate agent bounding boxes in the key video frame; and for each candidate agent bounding box: processing the feature representation through an action transformer neural network.
-
公开(公告)号:US20220004883A1
公开(公告)日:2022-01-06
申请号:US17295286
申请日:2019-11-21
Applicant: DeepMind Technologies Limited
Inventor: Yusuf Aytar , Debidatta Dwibedi , Andrew Zisserman , Jonathan Tompson , Pierre Sermanet
Abstract: An encoder neural network is described which can encode a data item, such as a frame of a video, to form a respective encoded data item. Data items of a first data sequence are associated with respective data items of a second sequence, by determining which of the encoded data items of the second sequence is closest to the encoded data item produced from each data item of the first sequence. Thus, the two data sequences are aligned. The encoder neural network is trained automatically using a training set of data sequences, by an iterative process of successively increasing cycle consistency between pairs of the data sequences.
-
公开(公告)号:US20210406680A1
公开(公告)日:2021-12-30
申请号:US16951362
申请日:2020-11-18
Applicant: DeepMind Technologies Limited
Inventor: Xiaohong Gong , Arturo Bajuelos Castillo , Sanjeev Jagannatha Rao , Xueliang Lu , Amogh S. Asgekar , Anton Alexandrov , Carsten Miklos Steinebach
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network used to generate a ranking score for a network input. One of the methods includes generating training data and training the neural network on the training data. The training data includes a plurality of training pairs. The generating comprising: obtaining data indicating that a plurality of training network inputs were displayed in a user interface according to a presentation order, obtaining data indicating that a first training network input of the plurality of training network inputs has a positive label, determining that a second training network input of the plurality of training network inputs (i) has a negative label and (ii) is higher than the first training network input in the presentation order, and generating a training pair that includes the first training network input and the second training network input.
-
公开(公告)号:US20210319316A1
公开(公告)日:2021-10-14
申请号:US17356935
申请日:2021-06-24
Applicant: DeepMind Technologies Limited
Inventor: Hado Philip van Hasselt
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network using normalized target outputs. One of the methods includes updating current values of the normalization parameters to account for the target output for the training item; determining a normalized target output for the training item by normalizing the target output for the training item in accordance with the updated normalization parameter values; processing the training item using the neural network to generate a normalized output for the training item in accordance with current values of main parameters of the neural network; determining an error for the training item using the normalized target output and the normalized output; and using the error to adjust the current values of the main parameters of the neural network.
-
公开(公告)号:US20210313008A1
公开(公告)日:2021-10-07
申请号:US17265708
申请日:2019-09-16
Applicant: DeepMind Technologies Limited
Inventor: Andrew W. Senior , James Kirkpatrick , Laurent Sifre , Richard Andrew Evans , Hugo Penedones , Chongli Qin , Ruoxi Sun , Karen Simonyan , John Jumper
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing protein structure prediction and protein domain segmentation. In one aspect, a method comprises generating a plurality of predicted structures of a protein, wherein generating a predicted structure of the protein comprises: updating initial values of a plurality of structure parameters of the protein, comprising, at each of a plurality of update iterations: determining a gradient of a quality score for the current values of the structure parameters with respect to the current values of the structure parameters; and updating the current values of the structure parameters using the gradient.
-
86.
公开(公告)号:US20210271968A1
公开(公告)日:2021-09-02
申请号:US16967597
申请日:2019-02-11
Applicant: DeepMind Technologies Limited
Inventor: Iaroslav Ganin , Tejas Dattatraya Kulkarni , Oriol Vinyals , Seyed Mohammadali Eslami
Abstract: A generative adversarial neural network system to provide a sequence of actions for performing a task. The system comprises a reinforcement learning neural network subsystem coupled to a simulator and a discriminator neural network. The reinforcement learning neural network subsystem includes a policy recurrent neural network to, at each of a sequence of time steps, select one or more actions to be performed according to an action selection policy, each action comprising one or more control commands for a simulator. The simulator is configured to implement the control commands for the time steps to generate a simulator output. The discriminator neural network is configured to discriminate between the simulator output and training data, to provide a reward signal for the reinforcement learning. The simulator may be non-differentiable simulator, for example a computer program to produce an image or audio waveform or a program to control a robot or vehicle.
-
公开(公告)号:US11080587B2
公开(公告)日:2021-08-03
申请号:US15016160
申请日:2016-02-04
Applicant: DeepMind Technologies Limited
Inventor: Karol Gregor , Ivo Danihelka
Abstract: Methods, and systems, including computer programs encoded on computer storage media for generating data items. A method includes reading a glimpse from a data item using a decoder hidden state vector of a decoder for a preceding time step, providing, as input to a encoder, the glimpse and decoder hidden state vector for the preceding time step for processing, receiving, as output from the encoder, a generated encoder hidden state vector for the time step, generating a decoder input from the generated encoder hidden state vector, providing the decoder input to the decoder for processing, receiving, as output from the decoder, a generated a decoder hidden state vector for the time step, generating a neural network output update from the decoder hidden state vector for the time step, and combining the neural network output update with a current neural network output to generate an updated neural network output.
-
公开(公告)号:US20210166131A1
公开(公告)日:2021-06-03
申请号:US16972491
申请日:2019-06-06
Applicant: DeepMind Technologies Limited
Inventor: David Benjamin Pfau , Stig Petersen , Ashish Agarwal , David Barrett , Kimberly Stachenfeld
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network having a plurality of network parameters and being configured to process an input data item to generate a feature representation comprising a values for each of a plurality of features of the input data item.
-
公开(公告)号:US20210152835A1
公开(公告)日:2021-05-20
申请号:US17137255
申请日:2020-12-29
Applicant: DeepMind Technologies Limited
Inventor: Nicholas Watters , Razvan Pascanu , Peter William Battaglia , Daniel Zorn , Theophane Guillaume Weber
IPC: H04N19/174 , H04N19/105 , H04N19/139 , H04N19/46 , H04N19/52 , H04N19/577 , H04N19/61
Abstract: A system implemented by one or more computers comprises a visual encoder component configured to receive as input data representing a sequence of image frames, in particular representing objects in a scene of the sequence, and to output a sequence of corresponding state codes, each state code comprising vectors, one for each of the objects. Each vector represents a respective position and velocity of its corresponding object. The system also comprises a dynamic predictor component configured to take as input a sequence of state codes, for example from the visual encoder, and predict a state code for a next unobserved frame. The system further comprises a state decoder component configured to convert the predicted state code, to a state, the state comprising a respective position and velocity vector for each object in the scene. This state may represent a predicted position and velocity vector for each of the objects.
-
公开(公告)号:US10949734B2
公开(公告)日:2021-03-16
申请号:US15396319
申请日:2016-12-30
Applicant: DeepMind Technologies Limited
Inventor: Neil Charles Rabinowitz , Guillaume Desjardins , Andrei-Alexandru Rusu , Koray Kavukcuoglu , Raia Thais Hadsell , Razvan Pascanu , James Kirkpatrick , Hubert Josef Soyer
Abstract: Methods and systems for performing a sequence of machine learning tasks. One system includes a sequence of deep neural networks (DNNs), including: a first DNN corresponding to a first machine learning task, wherein the first DNN comprises a first plurality of indexed layers, and each layer in the first plurality of indexed layers is configured to receive a respective layer input and process the layer input to generate a respective layer output; and one or more subsequent DNNs corresponding to one or more respective machine learning tasks, wherein each subsequent DNN comprises a respective plurality of indexed layers, and each layer in a respective plurality of indexed layers with index greater than one receives input from a preceding layer of the respective subsequent DNN, and one or more preceding layers of respective preceding DNNs, wherein a preceding layer is a layer whose index is one less than the current index.
-
-
-
-
-
-
-
-
-