公开(公告)号：US10083169B1

公开(公告)日：2018-09-25

申请号：US15248966

申请日：2016-08-26

Applicant: Google LLC

Inventor： Shalini Ghosh ,  Oriol Vinyals ,  Brian Patrick Strope ,  Howard Scott Roy ,  Thomas L. Dean ,  Larry Paul Heck

IPC: G10L15/00 ,  G06F17/27 ,  G06N3/08 ,  G06N3/04

CPC classification number: G06F17/279 ,  G06F17/2881 ,  G06N3/0445 ,  G06N3/084

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing word sequences using neural networks. One of the methods includes receiving a first sequence of words arranged according to a first order; and for each word in the first sequence, beginning with a first word in the first order: determining a topic vector that is associated with the word; generating a combined input from the word and the topic vector, and processing the combined input through one or more sequence modeling layers to generate a sequence modeling output for the word; and processing one or more of the sequence modeling outputs through an output layer to generate a neural network output for the first sequence of words.