-
公开(公告)号:US11741970B2
公开(公告)日:2023-08-29
申请号:US17570246
申请日:2022-01-06
Applicant: Google LLC
Inventor: Andrew E. Rubin , Johan Schalkwyk , Maria Carolina Parada San Martin
CPC classification number: G10L17/24 , G06F21/32 , G06F21/46 , G10L15/06 , G10L15/08 , G10L15/22 , G10L25/51 , G10L2015/0638 , G10L2015/088 , G10L2015/225
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
-
62.
公开(公告)号:US11705106B2
公开(公告)日:2023-07-18
申请号:US17479285
申请日:2021-09-20
Applicant: Google LLC
Inventor: Françoise Beaufays , Johan Schalkwyk , Khe Chai Sim
IPC: G10L13/047 , G10L15/06
CPC classification number: G10L13/047 , G10L15/063 , G10L2015/0635
Abstract: Processor(s) of a client device can: identify a textual segment stored locally at the client device; process the textual segment, using a speech synthesis model stored locally at the client device, to generate synthesized speech audio data that includes synthesized speech of the identified textual segment; process the synthesized speech, using an on-device speech recognition model that is stored locally at the client device, to generate predicted output; and generate a gradient based on comparing the predicted output to ground truth output that corresponds to the textual segment. In some implementations, the generated gradient is used, by processor(s) of the client device, to update weights of the on-device speech recognition model. In some implementations, the generated gradient is additionally or alternatively transmitted to a remote system for use in remote updating of global weights of a global speech recognition model.
-
公开(公告)号:US20220130399A1
公开(公告)日:2022-04-28
申请号:US17570246
申请日:2022-01-06
Applicant: Google LLC
Inventor: Andrew E. Rubin , Johan Schalkwyk , Maria Carolina Parada San Martin
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
-
64.
公开(公告)号:US20220115000A1
公开(公告)日:2022-04-14
申请号:US17082518
申请日:2020-10-28
Applicant: Google LLC
Inventor: Françoise Beaufays , Johan Schalkwyk , Khe Chai Sim
IPC: G10L13/047 , G10L13/10 , G10L13/033
Abstract: Processor(s) of a client device can: identify a textual segment stored locally at the client device; process the textual segment, using an on-device TTS generator model, to generate synthesized speech audio data that includes synthesized speech of the textual segment; process the synthesized speech, using an on-device ASR model to generate predicted ASR output; and generate a gradient based on comparing the predicted ASR output to ground truth output corresponding to the textual segment. Processor(s) of the client device can also: process the synthesized speech audio data using an on-device TTS generator model to make a prediction; and generate a gradient based on the prediction. In these implementations, the generated gradient(s) can be used to update weight(s) of the respective on-device model(s) and/or transmitted to a remote system for use in remote updating of respective global model(s). The updated weight(s) and/or the updated model(s) can be transmitted to client device(s).
-
公开(公告)号:US20210074292A1
公开(公告)日:2021-03-11
申请号:US17100109
申请日:2020-11-20
Applicant: Google LLC
Inventor: Alexander H. Gruenstein , Johan Schalkwyk , Matthew Sharifi
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for hotword trigger suppression are disclosed. In one aspect, a method includes the actions of receiving, by a microphone of a computing device, audio corresponding to playback of an item of media content, the audio including an utterance of a predefined hotword that is associated with performing an operation on the computing device. The actions further include processing the audio. The actions further include in response to processing the audio, suppressing performance of the operation on the computing device.
-
公开(公告)号:US10713010B2
公开(公告)日:2020-07-14
申请号:US16169279
申请日:2018-10-24
Applicant: Google LLC
Inventor: Brandon M. Ballinger , Johan Schalkwyk , Michael H. Cohen , William J. Byrne , Gudmundur Hafsteinsson , Michael J. Lebeau
IPC: G06F17/40 , G06F3/16 , G10L15/183 , G10L15/26 , G10L15/30 , G06F40/58 , G06F40/284 , G10L15/18 , G06F3/0488 , G10L15/00 , G10L15/22 , G10L15/197
Abstract: A computer-implemented input-method editor process includes receiving a request from a user for an application-independent input method editor having written and spoken input capabilities, identifying that the user is about to provide spoken input to the application-independent input method editor, and receiving a spoken input from the user. The spoken input corresponds to input to an application and is converted to text that represents the spoken input. The text is provided as input to the application.
-
公开(公告)号:US10706851B2
公开(公告)日:2020-07-07
申请号:US16392829
申请日:2019-04-24
Applicant: Google LLC
Inventor: Alexander H. Gruenstein , Petar Aleksic , Johan Schalkwyk , Pedro J. Moreno Mengibar
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting hotwords using a server. One of the methods includes receiving an audio signal encoding one or more utterances including a first utterance; determining whether at least a portion of the first utterance satisfies a first threshold of being at least a portion of a key phrase; in response to determining that at least the portion of the first utterance satisfies the first threshold of being at least a portion of a key phrase, sending the audio signal to a server system that determines whether the first utterance satisfies a second threshold of being the key phrase, the second threshold being more restrictive than the first threshold; and receiving tagged text data representing the one or more utterances encoded in the audio signal when the server system determines that the first utterance satisfies the second threshold.
-
公开(公告)号:US20190056909A1
公开(公告)日:2019-02-21
申请号:US16169279
申请日:2018-10-24
Applicant: Google LLC
Inventor: Brandon M Ballinger , Johan Schalkwyk , Michael H. Cohen , William J. Byrne , Gudmundur Hafsteinsson , Michael J. Lebeau
IPC: G06F3/16 , G06F17/27 , G10L15/30 , G10L15/26 , G06F17/28 , G06F3/0488 , G10L15/183 , G10L15/18 , G10L15/00 , G10L15/22 , G10L15/197
Abstract: A computer-implemented input-method editor process includes receiving a request from a user for an application-independent input method editor having written and spoken input capabilities, identifying that the user is about to provide spoken input to the application-independent input method editor, and receiving a spoken input from the user. The spoken input corresponds to input to an application and is converted to text that represents the spoken input. The text is provided as input to the application.
-
-
-
-
-
-
-