中科微点-全球专利检索

  1. Login
  2. Sign Up

Search Results

45 records (took 0.021 seconds)

    GENERATING AUDIO USING NEURAL NETWORKS
    21.
    发明申请
    GENERATING AUDIO USING NEURAL NETWORKS 审中-公开

    公开(公告)号：US20180322891A1

    公开(公告)日：2018-11-08

    申请号：US16030742

    申请日：2018-07-09

    Applicant: DeepMind Technologies Limited

    Inventor： Aaron Gerard Antonius van den Oord ,  Sander Etienne Lea Dieleman ,  Nal Emmerich Kalchbrenner ,  Karen Simonyan ,  Oriol Vinyals

    IPC: G10L25/30 ,  G06N3/04

    CPC classification number: G10L25/30 ,  G06N3/04 ,  G06N3/0454 ,  G06N3/0481 ,  G10H2250/311 ,  G10L13/06

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating an output sequence of audio data that comprises a respective audio sample at each of a plurality of time steps. One of the methods includes, for each of the time steps: providing a current sequence of audio data as input to a convolutional subnetwork, wherein the current sequence comprises the respective audio sample at each time step that precedes the time step in the output sequence, and wherein the convolutional subnetwork is configured to process the current sequence of audio data to generate an alternative representation for the time step; and providing the alternative representation for the time step as input to an output layer, wherein the output layer is configured to: process the alternative representation to generate an output that defines a score distribution over a plurality of possible audio samples for the time step.

    Generating output examples using recurrent neural networks conditioned on bit values
    22.
    发明授权
    Generating output examples using recurrent neural networks conditioned on bit values 有权

    公开(公告)号：US12141691B2

    公开(公告)日：2024-11-12

    申请号：US16968413

    申请日：2019-02-11

    Applicant: DeepMind Technologies Limited

    Inventor： Nal Emmerich Kalchbrenner ,  Karen Simonyan ,  Erich Konrad Elsen

    IPC: G06N3/08 ,  G06F18/2113 ,  G06N3/045 ,  G06N3/063 ,  H03K19/173

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating output examples using neural networks. Each output example includes multiple N-bit output values. To generate a given N-bit output value, a first recurrent input comprising the preceding N-bit output value is processed using a recurrent neural network and in accordance with a hidden state to generate a first score distribution. Then, values for the first half of the N bits are selected. A second recurrent input comprising (i) the preceding N-bit output value and (ii) the values for the first half of the N bits are processed using the recurrent neural network and in accordance with the same hidden state to generate a second score distribution. The values for the second half of the N bits of the output value are then selected using the second score distribution.

    Contiguous sparsity pattern neural networks
    23.
    发明授权
    Contiguous sparsity pattern neural networks 有权

    公开(公告)号：US11693627B2

    公开(公告)日：2023-07-04

    申请号：US16955420

    申请日：2019-02-11

    Applicant: DeepMind Technologies Limited

    Inventor： Karen Simonyan ,  Nal Emmerich Kalchbrenner ,  Erich Konrad Elsen

    IPC: G06F7/00 ,  G06F7/523 ,  G06N3/08

    CPC classification number: G06F7/523 ,  G06N3/08

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using neural networks having contiguous sparsity patterns. One of the methods includes storing a first parameter matrix of a neural network having a contiguous sparsity pattern in storage associated with a computing device. The computing device performs an inference pass of the neural network to generate an output vector, including reading, from the storage associated with the computing device, one or more activation values from the input vector, reading, from the storage associated with the computing device, a block of non-zero parameter values, and multiplying each of the one or more activation values by one or more of the block of non-zero parameter values.

    Generating video frames using neural networks
    25.
    发明授权
    Generating video frames using neural networks 有权

    公开(公告)号：US11144782B2

    公开(公告)日：2021-10-12

    申请号：US16338338

    申请日：2017-09-29

    Applicant: DeepMind Technologies Limited

    Inventor： Nal Emmerich Kalchbrenner ,  Aaron Gerard Antonius van den Oord ,  Karen Simonyan

    IPC: G06K9/62 ,  G06K9/46 ,  G06N3/04 ,  G06K9/00

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating video frames using neural networks. One of the methods includes processing a sequence of video frames using an encoder neural network to generate an encoded representation; and generating a predicted next frame pixel by pixel according to a pixel order and a channel order, comprising: for each color channel of each pixel, providing as input to a decoder neural network (i) the encoded representation, (ii) color values for any pixels before the pixel in the pixel order, and (iii) color values for the pixel for any color channels before the color channel in the channel order, wherein the decoder neural network is configured to generate an output defining a score distribution over a plurality of possible color values, and determining the color value for the color channel of the pixel by sampling from the score distribution.

    Processing text sequences using neural networks
    29.
    发明授权
    Processing text sequences using neural networks 有权

    公开(公告)号：US10733390B2

    公开(公告)日：2020-08-04

    申请号：US16434459

    申请日：2019-06-07

    Applicant: DeepMind Technologies Limited

    Inventor： Nal Emmerich Kalchbrenner ,  Karen Simonyan ,  Lasse Espeholt

    IPC: G06F40/58 ,  G06N3/04 ,  G06F40/44 ,  G06N3/08 ,  G10L15/197

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for language modeling. In one aspect, a system comprises: a masked convolutional decoder neural network that comprises a plurality of masked convolutional neural network layers and is configured to generate a respective probability distribution over a set of possible target embeddings at each of a plurality of time steps; and a modeling engine that is configured to use the respective probability distribution generated by the decoder neural network at each of the plurality of time steps to estimate a probability that a string represented by the target embeddings corresponding to the plurality of time steps belongs to the natural language.

    PROCESSING TEXT SEQUENCES USING NEURAL NETWORKS
    30.
    发明申请
    PROCESSING TEXT SEQUENCES USING NEURAL NETWORKS 审中-公开

    公开(公告)号：US20190286708A1

    公开(公告)日：2019-09-19

    申请号：US16434459

    申请日：2019-06-07

    Applicant: DeepMind Technologies Limited

    Inventor： Nal Emmerich Kalchbrenner ,  Karen Simonyan ,  Lasse Espeholt

    IPC: G06F17/28 ,  G10L15/197 ,  G06N3/08 ,  G06N3/04

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for neural machine translation. In one aspect, a system is configured to receive an input sequence of source embeddings representing a source sequence of words in a source natural language and to generate an output sequence of target embeddings representing a target sequence of words that is a translation of the source sequence into a target natural language, the system comprising: a dilated convolutional neural network configured to process the input sequence of source embeddings to generate an encoded representation of the source sequence, and a masked dilated convolutional neural network configured to process the encoded representation of the source sequence to generate the output sequence of target embeddings.

Patent Agency Ranking