公开(公告)号：US20170200076A1

公开(公告)日：2017-07-13

申请号：US15406557

申请日：2017-01-13

Applicant: Google Inc.

Inventor： Oriol Vinyals ,  Samuel Bengio

IPC: G06N3/04 ,  G06N3/08

CPC classification number: G06N3/0445 ,  G06N3/0454

Abstract: In one aspect, this specification describes a recurrent neural network system implemented by one or more computers that is configured to process input sets to generate neural network outputs for each input set. The input set can be a collection of multiple inputs for which the recurrent neural network should generate the same neural network output regardless of the order in which the inputs are arranged in the collection. The recurrent neural network system can include a read neural network, a process neural network, and a write neural network. In another aspect, this specification describes a system implemented as computer programs on one or more computers in one or more locations that is configured to train a recurrent neural network that receives a neural network input and sequentially emits outputs to generate an output sequence for the neural network input.

公开(公告)号：US20170140753A1

公开(公告)日：2017-05-18

申请号：US15349245

申请日：2016-11-11

Applicant: Google Inc.

Inventor： Navdeep Jaitly ,  Quoc V. Le ,  Oriol Vinyals ,  Samuel Bengio ,  Ilya Sutskever

IPC: G10L15/16 ,  G10L15/02 ,  G06F17/28

CPC classification number: G10L15/16 ,  G05B13/027 ,  G06F17/276 ,  G06F17/289 ,  G06N3/0445 ,  G10L15/02 ,  G10L15/26 ,  G10L2015/025

Abstract: A system can be configured to perform tasks such as converting recorded speech to a sequence of phonemes that represent the speech, converting an input sequence of graphemes into a target sequence of phonemes, translating an input sequence of words in one language into a corresponding sequence of words in another language, or predicting a target sequence of words that follow an input sequence of words in a language (e.g., a language model). In a speech recognizer, the RNN system may be used to convert speech to a target sequence of phonemes in real-time so that a transcription of the speech can be generated and presented to a user, even before the user has completed uttering the entire speech input.