公开(公告)号：US20210304769A1

公开(公告)日：2021-09-30

申请号：US15931788

申请日：2020-05-14

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Guoli Ye ,  Yan Huang ,  Wenning Wei ,  Lei He ,  Eva Sharma ,  Jian Wu ,  Yao Tian ,  Edward C. Lin ,  Yifan Gong ,  Rui Zhao ,  Jinyu Li ,  William Maxwell Gale

IPC: G10L15/26 ,  G10L15/16 ,  G10L15/06 ,  G10L13/08

Abstract: Systems, methods, and devices are provided for generating and using text-to-speech (TTS) data for improved speech recognition models. A main model is trained with keyword independent baseline training data. In some instances, acoustic and language model sub-components of the main model are modified with new TTS training data. In some instances, the new TTS training is obtained from a multi-speaker neural TTS system for a keyword that is underrepresented in the baseline training data. In some instances, the new TTS training data is used for pronunciation learning and normalization of keyword dependent confidence scores in keyword spotting (KWS) applications. In some instances, the new TTS training data is used for rapid speaker adaptation in speech recognition models.

公开(公告)号：US12205596B2

公开(公告)日：2025-01-21

申请号：US18108316

申请日：2023-02-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Guoli Ye ,  Yan Huang ,  Wenning Wei ,  Lei He ,  Eva Sharma ,  Jian Wu ,  Yao Tian ,  Edward C. Lin ,  Yifan Gong ,  Rui Zhao ,  Jinyu Li ,  William Maxwell Gale

IPC: G10L15/26 ,  G10L13/08 ,  G10L15/06 ,  G10L15/16

Abstract: Systems, methods, and devices are provided for generating and using text-to-speech (TTS) data for improved speech recognition models. A main model is trained with keyword independent baseline training data. In some instances, acoustic and language model sub-components of the main model are modified with new TTS training data. In some instances, the new TTS training is obtained from a multi-speaker neural TTS system for a keyword that is underrepresented in the baseline training data. In some instances, the new TTS training data is used for pronunciation learning and normalization of keyword dependent confidence scores in keyword spotting (KWS) applications. In some instances, the new TTS training data is used for rapid speaker adaptation in speech recognition models.

公开(公告)号：US11587569B2

公开(公告)日：2023-02-21

申请号：US15931788

申请日：2020-05-14

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Guoli Ye ,  Yan Huang ,  Wenning Wei ,  Lei He ,  Eva Sharma ,  Jian Wu ,  Yao Tian ,  Edward C. Lin ,  Yifan Gong ,  Rui Zhao ,  Jinyu Li ,  William Maxwell Gale

IPC: G10L15/26 ,  G10L13/08 ,  G10L15/06 ,  G10L15/16

Abstract: Systems, methods, and devices are provided for generating and using text-to-speech (TTS) data for improved speech recognition models. A main model is trained with keyword independent baseline training data. In some instances, acoustic and language model sub-components of the main model are modified with new TTS training data. In some instances, the new TTS training is obtained from a multi-speaker neural TTS system for a keyword that is underrepresented in the baseline training data. In some instances, the new TTS training data is used for pronunciation learning and normalization of keyword dependent confidence scores in keyword spotting (KWS) applications. In some instances, the new TTS training data is used for rapid speaker adaptation in speech recognition models.