公开(公告)号：US09865247B2

公开(公告)日：2018-01-09

申请号：US14631583

申请日：2015-02-25

Applicant: Google LLC

Inventor： Ioannis Agiomyrgiannakis ,  Byung Ha Chun

IPC: G10L13/08 ,  G10L25/75 ,  G10L13/02

CPC classification number: G10L13/02 ,  G10L13/08 ,  G10L25/75

Abstract: A device may receive a speech signal. The device may determine acoustic feature parameters for the speech signal. The acoustic feature parameters may include phase data. The device may determine circular space representations for the phase data based on an alignment of the phase data with given axes of the circular space representations. The device may map the phase data to linguistic features based on the circular space representations. The linguistic features may be associated with linguistic content that includes phonemic content or text content. The device may provide a synthetic audio pronunciation of the linguistic content based on the mapping.

公开(公告)号：US20250078809A1

公开(公告)日：2025-03-06

申请号：US18951397

申请日：2024-11-18

Applicant: Google LLC

Inventor： Samuel Bengio ,  Yuxuan Wang ,  Zongheng Yang ,  Zhifeng Chen ,  Yonghui Wu ,  Ioannis Agiomyrgiannakis ,  Ron J. Weiss ,  Navdeep Jaitly ,  Ryan M. Rifkin ,  Robert Andrew James Clark ,  Quoc V. Le ,  Russell J. Ryan ,  Ying Xiao

IPC: G10L13/08 ,  G06N3/045 ,  G06N3/08 ,  G06N3/084 ,  G10L13/04 ,  G10L15/16 ,  G10L25/18 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating speech from text. One of the systems includes one or more computers and one or more storage devices storing instructions that when executed by one or more computers cause the one or more computers to implement: a sequence-to-sequence recurrent neural network configured to: receive a sequence of characters in a particular natural language, and process the sequence of characters to generate a spectrogram of a verbal utterance of the sequence of characters in the particular natural language; and a subsystem configured to: receive the sequence of characters in the particular natural language, and provide the sequence of characters as input to the sequence-to-sequence recurrent neural network to obtain as output the spectrogram of the verbal utterance of the sequence of characters in the particular natural language.

公开(公告)号：US12154543B2

公开(公告)日：2024-11-26

申请号：US18479785

申请日：2023-10-02

Applicant: Google LLC

Inventor： Ioannis Agiomyrgiannakis ,  Fergus James Henderson

IPC: G10L13/10 ,  G06F3/16 ,  G10L13/033 ,  G10L21/013

Abstract: A device may identify a plurality of sources for outputs that the device is configured to provide. The plurality of sources may include at least one of a particular application in the device, an operating system of the device, a particular area within a display of the device, or a particular graphical user interface object. The device may also assign a set of distinct voices to respective sources of the plurality of sources. The device may also receive a request for speech output. The device may also select a particular source that is associated with the requested speech output. The device may also generate speech having particular voice characteristics of a particular voice assigned to the particular source.

公开(公告)号：US11282496B2

公开(公告)日：2022-03-22

申请号：US16900839

申请日：2020-06-12

Applicant: Google LLC

Inventor： Ioannis Agiomyrgiannakis ,  Fergus James Henderson

IPC: G10L13/033 ,  G06F3/16 ,  G10L13/10 ,  G10L21/013

Abstract: A device may identify a plurality of sources for outputs that the device is configured to provide. The plurality of sources may include at least one of a particular application in the device, an operating system of the device, a particular area within a display of the device, or a particular graphical user interface object. The device may also assign a set of distinct voices to respective sources of the plurality of sources. The device may also receive a request for speech output. The device may also select a particular source that is associated with the requested speech output. The device may also generate speech having particular voice characteristics of a particular voice assigned to the particular source.

公开(公告)号：US10971170B2

公开(公告)日：2021-04-06

申请号：US16058640

申请日：2018-08-08

Applicant: Google LLC

Inventor： Yonghui Wu ,  Jonathan Shen ,  Ruoming Pang ,  Ron J. Weiss ,  Michael Schuster ,  Navdeep Jaitly ,  Zongheng Yang ,  Zhifeng Chen ,  Yu Zhang ,  Yuxuan Wang ,  Russell John Wyatt Skerry-Ryan ,  Ryan M. Rifkin ,  Ioannis Agiomyrgiannakis

IPC: G10L25/30 ,  G10L13/047 ,  G10L13/08 ,  G06N7/00 ,  G06N3/08 ,  G06N3/04 ,  G06N5/04 ,  G10L25/18

Abstract: Methods, systems, and computer program products for generating, from an input character sequence, an output sequence of audio data representing the input character sequence. The output sequence of audio data includes a respective audio output sample for each of a number of time steps. One example method includes, for each of the time steps: generating a mel-frequency spectrogram for the time step by processing a representation of a respective portion of the input character sequence using a decoder neural network; generating a probability distribution over a plurality of possible audio output samples for the time step by processing the mel-frequency spectrogram for the time step using a vocoder neural network; and selecting the audio output sample for the time step from the possible audio output samples in accordance with the probability distribution.

公开(公告)号：US10923103B2

公开(公告)日：2021-02-16

申请号：US15824122

申请日：2017-11-28

Applicant: Google LLC

Inventor： Ioannis Agiomyrgiannakis

IPC: G10L13/07 ,  G10L13/08 ,  G10L13/06 ,  G10L13/047

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selecting units for speech synthesis. One of the methods includes determining a sequence of text units that each represent a respective portion of text for speech synthesis; and determining multiple paths of speech units that each represent the sequence of text units by selecting a first speech unit that includes speech synthesis data representing a first text unit; selecting multiple second speech units including speech synthesis data representing a second text unit based on (i) a join cost to concatenate the second speech unit with a first speech unit and (ii) a target cost indicating a degree that the second speech unit corresponds to the second text unit; and defining paths from the selected first speech unit to each of the multiple second speech units to include in the multiple paths of speech units.

公开(公告)号：US12190860B2

公开(公告)日：2025-01-07

申请号：US18516069

申请日：2023-11-21

Applicant: Google LLC

Inventor： Samuel Bengio ,  Yuxuan Wang ,  Zongheng Yang ,  Zhifeng Chen ,  Yonghui Wu ,  Ioannis Agiomyrgiannakis ,  Ron J. Weiss ,  Navdeep Jaitly ,  Ryan M. Rifkin ,  Robert Andrew James Clark ,  Quoc V. Le ,  Russell J. Ryan ,  Ying Xiao

IPC: G10L13/06 ,  G06N3/045 ,  G06N3/08 ,  G06N3/084 ,  G10L13/04 ,  G10L13/08 ,  G10L15/16 ,  G10L25/18 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating speech from text. One of the systems includes one or more computers and one or more storage devices storing instructions that when executed by one or more computers cause the one or more computers to implement: a sequence-to-sequence recurrent neural network configured to: receive a sequence of characters in a particular natural language, and process the sequence of characters to generate a spectrogram of a verbal utterance of the sequence of characters in the particular natural language; and a subsystem configured to: receive the sequence of characters in the particular natural language, and provide the sequence of characters as input to the sequence-to-sequence recurrent neural network to obtain as output the spectrogram of the verbal utterance of the sequence of characters in the particular natural language.

公开(公告)号：US12148444B2

公开(公告)日：2024-11-19

申请号：US17222736

申请日：2021-04-05

Applicant: Google LLC

Inventor： Yonghui Wu ,  Jonathan Shen ,  Ruoming Pang ,  Ron J. Weiss ,  Michael Schuster ,  Navdeep Jaitly ,  Zongheng Yang ,  Zhifeng Chen ,  Yu Zhang ,  Yuxuan Wang ,  Russell John Wyatt Skerry-Ryan ,  Ryan M. Rifkin ,  Ioannis Agiomyrgiannakis

IPC: G10L13/047 ,  G06N3/045 ,  G06N3/08 ,  G06N5/046 ,  G06N7/01 ,  G10L13/08 ,  G10L25/18 ,  G10L25/30

Abstract: Methods, systems, and computer program products for generating, from an input character sequence, an output sequence of audio data representing the input character sequence. The output sequence of audio data includes a respective audio output sample for each of a number of time steps. One example method includes, for each of the time steps: generating a mel-frequency spectrogram for the time step by processing a representation of a respective portion of the input character sequence using a decoder neural network; generating a probability distribution over a plurality of possible audio output samples for the time step by processing the mel-frequency spectrogram for the time step using a vocoder neural network; and selecting the audio output sample for the time step from the possible audio output samples in accordance with the probability distribution.

公开(公告)号：US20240127791A1

公开(公告)日：2024-04-18

申请号：US18516069

申请日：2023-11-21

Applicant: Google LLC

Inventor： Samuel Bengio ,  Yuxuan Wang ,  Zongheng Yang ,  Zhifeng Chen ,  Yonghui Wu ,  Ioannis Agiomyrgiannakis ,  Ron J. Weiss ,  Navdeep Jaitly ,  Ryan M. Rifkin ,  Robert Andrew James Clark ,  Quoc V. Le ,  Russell J. Ryan ,  Ying Xiao

IPC: G10L13/08 ,  G06N3/045 ,  G06N3/08 ,  G06N3/084 ,  G10L13/04 ,  G10L15/16 ,  G10L25/18 ,  G10L25/30

CPC classification number: G10L13/08 ,  G06N3/045 ,  G06N3/08 ,  G06N3/084 ,  G10L13/04 ,  G10L15/16 ,  G10L25/18 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating speech from text. One of the systems includes one or more computers and one or more storage devices storing instructions that when executed by one or more computers cause the one or more computers to implement: a sequence-to-sequence recurrent neural network configured to: receive a sequence of characters in a particular natural language, and process the sequence of characters to generate a spectrogram of a verbal utterance of the sequence of characters in the particular natural language; and a subsystem configured to: receive the sequence of characters in the particular natural language, and provide the sequence of characters as input to the sequence-to-sequence recurrent neural network to obtain as output the spectrogram of the verbal utterance of the sequence of characters in the particular natural language.

公开(公告)号：US20210295858A1

公开(公告)日：2021-09-23

申请号：US17222736

申请日：2021-04-05

Applicant: Google LLC

Inventor： Yonghui Wu ,  Jonathan Shen ,  Ruoming Pang ,  Ron J. Weiss ,  Michael Schuster ,  Navdeep Jaitly ,  Zongheng Yang ,  Zhifeng Chen ,  Yu Zhang ,  Yuxuan Wang ,  Russell John Wyatt Skerry-Ryan ,  Ryan M. Rifkin ,  Ioannis Agiomyrgiannakis

IPC: G10L25/30 ,  G10L13/047 ,  G10L13/08 ,  G06N7/00 ,  G06N3/08 ,  G06N3/04 ,  G06N5/04 ,  G10L25/18

Abstract: Methods, systems, and computer program products for generating, from an input character sequence, an output sequence of audio data representing the input character sequence. The output sequence of audio data includes a respective audio output sample for each of a number of time steps. One example method includes, for each of the time steps: generating a mel-frequency spectrogram for the time step by processing a representation of a respective portion of the input character sequence using a decoder neural network; generating a probability distribution over a plurality of possible audio output samples for the time step by processing the mel-frequency spectrogram for the time step using a vocoder neural network; and selecting the audio output sample for the time step from the possible audio output samples in accordance with the probability distribution.