公开(公告)号：US11568207B2

公开(公告)日：2023-01-31

申请号：US16586323

申请日：2019-09-27

Applicant: DeepMind Technologies Limited

Inventor： Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Oriol Vinyals

IPC: G06N3/08 ,  G06N3/04 ,  G06F17/16 ,  G06K9/62

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an encoder neural network that is configured to process an input observation to generate a latent representation of the input observation. In one aspect, a method includes: obtaining a sequence of observations; for each observation in the sequence of observations, processing the observation using the encoder neural network to generate a latent representation of the observation; for each of one or more given observations in the sequence of observations: generating a context latent representation of the given observation; and generating, from the context latent representation of the given observation, a respective estimate of the latent representations of one or more particular observations that are after the given observation in the sequence of observations.

公开(公告)号：US20240273333A1

公开(公告)日：2024-08-15

申请号：US18640741

申请日：2024-04-19

Applicant: DeepMind Technologies Limited

Inventor： Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Oriol Vinyals

IPC: G06N3/006 ,  G06F17/16 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06N3/08 ,  G06V10/764 ,  G06V10/77 ,  G06V10/82

CPC classification number: G06N3/006 ,  G06F17/16 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06N3/08 ,  G06V10/764 ,  G06V10/7715 ,  G06V10/82

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an encoder neural network that is configured to process an input observation to generate a latent representation of the input observation. In one aspect, a method includes: obtaining a sequence of observations; for each observation in the sequence of observations, processing the observation using the encoder neural network to generate a latent representation of the observation; for each of one or more given observations in the sequence of observations: generating a context latent representation of the given observation; and generating, from the context latent representation of the given observation, a respective estimate of the latent representations of one or more particular observations that are after the given observation in the sequence of observations.

公开(公告)号：US11995528B2

公开(公告)日：2024-05-28

申请号：US18090243

申请日：2022-12-28

Applicant: DeepMind Technologies Limited

Inventor： Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Oriol Vinyals

IPC: G06N3/006 ,  G06F17/16 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06N3/08 ,  G06V10/764 ,  G06V10/77 ,  G06V10/82

CPC classification number: G06N3/006 ,  G06F17/16 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06N3/08 ,  G06V10/764 ,  G06V10/7715 ,  G06V10/82

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an encoder neural network that is configured to process an input observation to generate a latent representation of the input observation. In one aspect, a method includes: obtaining a sequence of observations; for each observation in the sequence of observations, processing the observation using the encoder neural network to generate a latent representation of the observation; for each of one or more given observations in the sequence of observations: generating a context latent representation of the given observation; and generating, from the context latent representation of the given observation, a respective estimate of the latent representations of one or more particular observations that are after the given observation in the sequence of observations.

公开(公告)号：US11756561B2

公开(公告)日：2023-09-12

申请号：US17674752

申请日：2022-02-17

Applicant: DeepMind Technologies Limited

Inventor： Cristina Garbacea ,  Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Sze Chie Lim ,  Alejandro Luebs ,  Oriol Vinyals ,  Thomas Chadwick Walters

IPC: G10L19/16 ,  G10L19/032 ,  G10L25/30 ,  G06N3/08

CPC classification number: G10L19/16 ,  G06N3/08 ,  G10L19/032 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating discrete latent representations of input audio data. Only the discrete latent representation needs to be transmitted from an encoder system to a decoder system in order for the decoder system to be able to effectively to decode, i.e., reconstruct, the input audio data.

公开(公告)号：US20230274125A1

公开(公告)日：2023-08-31

申请号：US18090243

申请日：2022-12-28

Applicant: DeepMind Technologies Limited

Inventor： Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Oriol Vinyals

IPC: G06N3/006 ,  G06F17/16 ,  G06N3/08 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06V10/764 ,  G06V10/77 ,  G06V10/82

CPC classification number: G06N3/006 ,  G06F17/16 ,  G06N3/08 ,  G06F18/22 ,  G06N3/045 ,  G06N3/048 ,  G06V10/764 ,  G06V10/7715 ,  G06V10/82

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an encoder neural network that is configured to process an input observation to generate a latent representation of the input observation. In one aspect, a method includes: obtaining a sequence of observations; for each observation in the sequence of observations, processing the observation using the encoder neural network to generate a latent representation of the observation; for each of one or more given observations in the sequence of observations: generating a context latent representation of the given observation; and generating, from the context latent representation of the given observation, a respective estimate of the latent representations of one or more particular observations that are after the given observation in the sequence of observations.

公开(公告)号：US20200234725A1

公开(公告)日：2020-07-23

申请号：US16746703

申请日：2020-01-17

Applicant: DeepMind Technologies Limited

Inventor： Cristina Garbacea ,  Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Sze Chie Lim ,  Alejandro Luebs ,  Oriol Vinyals ,  Thomas Chadwick Walters

IPC: G10L19/16 ,  G10L19/032 ,  G10L25/30 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating discrete latent representations of input audio data. Only the discrete latent representation needs to be transmitted from an encoder system to a decoder system in order for the decoder system to be able to effectively to decode, i.e., reconstruct, the input audio data.

公开(公告)号：US20240119302A1

公开(公告)日：2024-04-11

申请号：US18475972

申请日：2023-09-27

Applicant: DeepMind Technologies Limited

Inventor： Yazhe Li ,  Jorg Bornschein ,  Marcus Hutter

IPC: G06N3/092

CPC classification number: G06N3/092

Abstract: A method of automatically selecting a neural network from a plurality of computer-implemented candidate neural networks, each candidate neural network comprising at least an encoder neural network trained to encode an input value as a latent representation. The method comprises: obtaining a sequence of data items, each of the data items comprising an input value and a target value; and determining a respective score for each of the candidate neural networks, comprising evaluating the encoder neural network of the candidate neural network using a plurality of read-out heads. Each read-out head comprises parameters for predicting a target value from a latent representation of an input value of a data item encoded using the encoder neural network of the candidate neural network. The method further comprises selecting the neural network from the plurality of candidate neural networks using the respective scores.

公开(公告)号：US20220319527A1

公开(公告)日：2022-10-06

申请号：US17674752

申请日：2022-02-17

Applicant: DeepMind Technologies Limited

Inventor： Cristina Garbacea ,  Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Sze Chie Lim ,  Alejandro Luebs ,  Oriol Vinyals ,  Thomas Chadwick Walters

IPC: G10L19/16 ,  G06N3/08 ,  G10L19/032 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating discrete latent representations of input audio data. Only the discrete latent representation needs to be transmitted from an encoder system to a decoder system in order for the decoder system to be able to effectively to decode, i.e., reconstruct, the input audio data.

公开(公告)号：US11257507B2

公开(公告)日：2022-02-22

申请号：US16746703

申请日：2020-01-17

Applicant: DeepMind Technologies Limited

Inventor： Cristina Garbacea ,  Aaron Gerard Antonius van den Oord ,  Yazhe Li ,  Sze Chie Lim ,  Alejandro Luebs ,  Oriol Vinyals ,  Thomas Chadwick Walters

IPC: G10L19/16 ,  G10L19/032 ,  G10L25/30 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating discrete latent representations of input audio data. Only the discrete latent representation needs to be transmitted from an encoder system to a decoder system in order for the decoder system to be able to effectively to decode, i.e., reconstruct, the input audio data.