公开(公告)号：US20220310067A1

公开(公告)日：2022-09-29

申请号：US17650566

申请日：2022-02-10

申请人： Google LLC

发明人： Ronny Huang ,  Tara N. Sainath ,  Trevor Strohman ,  Shankar Kumar

IPC分类号： G10L15/08 ,  G10L15/26 ,  G10L15/187 ,  G06N3/04 ,  G10L15/16

摘要： A computer-implemented method includes receiving audio data that corresponds to an utterance spoken by a user and captured by a user device. The method also includes processing the audio data to determine a candidate transcription that includes a sequence of tokens for the spoken utterance. Tor each token in the sequence of tokens, the method includes determining a token embedding for corresponding token, determining a n-gram token embedding for a previous sequence of n-gram tokens, and concatenating the token embedding and the n-gram token embedding to generate a concatenated output for the corresponding token. The method also includes rescoring the candidate transcription for the spoken utterance by processing the concatenated output generated for each corresponding token in the sequence of tokens.

公开(公告)号：US20220310062A1

公开(公告)日：2022-09-29

申请号：US17316198

申请日：2021-05-10

申请人： Google LLC

发明人： Tara Sainath ,  Arun Narayanan ,  Rami Botros ,  Yangzhang He ,  Ehsan Variani ,  Cyrill Allauzen ,  David Rybach ,  Ruorning Pang ,  Trevor Strohman

IPC分类号： G10L15/06 ,  G10L15/02 ,  G10L15/30 ,  G10L15/22

摘要： An ASR model includes a first encoder configured to receive a sequence of acoustic frames and generate a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The ASR model also includes a second encoder configured to receive the first higher order feature representation generated by the first encoder at each of the plurality of output steps and generate a second higher order feature representation for a corresponding first higher order feature frame. The ASR model also includes a decoder configured to receive the second higher order feature representation generated by the second encoder at each of the plurality of output steps and generate a first probability distribution over possible speech recognition hypothesis. The ASR model also includes a language model configured to receive the first probability distribution over possible speech hypothesis and generate a rescored probability distribution.