Context-dependent modeling of phonemes

    公开(公告)号:US09818409B2

    公开(公告)日:2017-11-14

    申请号:US14877673

    申请日:2015-10-07

    Applicant: Google Inc.

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for modeling phonemes. One method includes receiving an acoustic sequence, the acoustic sequence representing an utterance, and the acoustic sequence comprising a respective acoustic feature representation at each of a plurality of time steps; for each of the plurality of time steps: processing the acoustic feature representation through each of one or more recurrent neural network layers to generate a recurrent output; processing the recurrent output using a softmax output layer to generate a set of scores, the set of scores comprising a respective score for each of a plurality of context dependent vocabulary phonemes, the score for each context dependent vocabulary phoneme representing a likelihood that the context dependent vocabulary phoneme represents the utterance at the time step; and determining, from the scores for the plurality of time steps, a context dependent phoneme representation of the sequence.

    PROCESSING AUDIO WAVEFORMS
    3.
    发明申请
    PROCESSING AUDIO WAVEFORMS 审中-公开
    处理音频波形

    公开(公告)号:US20160284347A1

    公开(公告)日:2016-09-29

    申请号:US15080927

    申请日:2016-03-25

    Applicant: Google Inc.

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing audio waveforms. In some implementations, a time-frequency feature representation is generated based on audio data. The time-frequency feature representation is input to an acoustic model comprising a trained artificial neural network. The trained artificial neural network comprising a frequency convolution layer, a memory layer, and one or more hidden layers. An output that is based on output of the trained artificial neural network is received. A transcription is provided, where the transcription is determined based on the output of the acoustic model.

    Abstract translation: 方法,系统和装置,包括在计算机存储介质上编码的用于处理音频波形的计算机程序。 在一些实现中,基于音频数据生成时间 - 频率特征表示。 时频特征表示被输入到包括经训练的人造神经网络的声学模型。 经训练的人造神经网络包括频率卷积层,存储层和一个或多个隐藏层。 接收基于训练的人造神经网络的输出的输出。 提供转录,其中基于声学模型的输出确定转录。

    ASYNCHRONOUS OPTIMIZATION FOR SEQUENCE TRAINING OF NEURAL NETWORKS
    5.
    发明申请
    ASYNCHRONOUS OPTIMIZATION FOR SEQUENCE TRAINING OF NEURAL NETWORKS 有权
    神经网络序列训练的异步优化

    公开(公告)号:US20150127337A1

    公开(公告)日:2015-05-07

    申请号:US14258139

    申请日:2014-04-22

    Applicant: Google Inc.

    CPC classification number: G10L15/063 G06N3/0454 G10L15/16 G10L15/183

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for obtaining, by a first sequence-training speech model, a first batch of training frames that represent speech features of first training utterances; obtaining, by the first sequence-training speech model, one or more first neural network parameters; determining, by the first sequence-training speech model, one or more optimized first neural network parameters based on (i) the first batch of training frames and (ii) the one or more first neural network parameters; obtaining, by a second sequence-training speech model, a second batch of training frames that represent speech features of second training utterances; obtaining one or more second neural network parameters; and determining, by the second sequence-training speech model, one or more optimized second neural network parameters based on (i) the second batch of training frames and (ii) the one or more second neural network parameters.

    Abstract translation: 方法,系统和装置,包括在计算机存储介质上编码的计算机程序,用于通过第一序列训练语音模型获得表示第一训练话语的语音特征的第一批训练帧; 通过所述第一序列训练语音模型获得一个或多个第一神经网络参数; 基于(i)第一批训练帧和(ii)所述一个或多个第一神经网络参数,通过所述第一序列训练语音模型确定一个或多个优化的第一神经网络参数; 通过第二序列训练语音模型获得表示第二训练语音的语音特征的第二批训练帧; 获得一个或多个第二神经网络参数; 以及通过所述第二序列训练语音模型,基于(i)第二批训练帧和(ii)所述一个或多个第二神经网络参数来确定一个或多个优化的第二神经网络参数。

    Caching speech recognition scores

    公开(公告)号:US09858922B2

    公开(公告)日:2018-01-02

    申请号:US14311557

    申请日:2014-06-23

    Applicant: Google Inc.

    CPC classification number: G10L15/08 G10L15/285

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for caching speech recognition scores. In some implementations, one or more values comprising data about an utterance are received. An index value is determined for the one or more values. An acoustic model score for the one or more received values is selected, from a cache of acoustic model scores that were computed before receiving the one or more values, based on the index value. A transcription for the utterance is determined using the selected acoustic model score.

    Generating representations of acoustic sequences

    公开(公告)号:US09721562B2

    公开(公告)日:2017-08-01

    申请号:US14559113

    申请日:2014-12-03

    Applicant: Google Inc.

    CPC classification number: G10L15/16 G10L15/02 G10L15/142 G10L2015/025

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating representation of acoustic sequences. One of the methods includes: receiving an acoustic sequence, the acoustic sequence comprising a respective acoustic feature representation at each of a plurality of time steps; processing the acoustic feature representation at an initial time step using an acoustic modeling neural network; for each subsequent time step of the plurality of time steps: receiving an output generated by the acoustic modeling neural network for a preceding time step, generating a modified input from the output generated by the acoustic modeling neural network for the preceding time step and the acoustic representation for the time step, and processing the modified input using the acoustic modeling neural network to generate an output for the time step; and generating a phoneme representation for the utterance from the outputs for each of the time steps.

Patent Agency Ranking