-
公开(公告)号：US11699443B2
公开(公告)日：2023-07-11
申请号：US17337182
申请日：2021-06-02
Applicant: GOOGLE LLC
Inventor： Alexander H. Gruenstein , Petar Aleksic , Johan Schalkwyk , Pedro J. Moreno Mengibar
CPC classification number: G10L15/30 , G10L15/26 , G10L15/32 , G10L15/183 , G10L2015/088 , G10L2015/223
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting hotwords using a server. One of the methods includes receiving an audio signal encoding one or more utterances including a first utterance; determining whether at least a portion of the first utterance satisfies a first threshold of being at least a portion of a key phrase; in response to determining that at least the portion of the first utterance satisfies the first threshold of being at least a portion of a key phrase, sending the audio signal to a server system that determines whether the first utterance satisfies a second threshold of being the key phrase, the second threshold being more restrictive than the first threshold; and receiving tagged text data representing the one or more utterances encoded in the audio signal when the server system determines that the first utterance satisfies the second threshold.
-
22.发明申请公开(公告)号：US20230068897A1
公开(公告)日：2023-03-02
申请号：US17983671
申请日：2022-11-09
Applicant: GOOGLE LLC
Inventor： Françoise Beaufays , Johan Schalkwyk , Khe Chai Sim
IPC: G10L13/047 , G10L13/033 , G10L13/10
Abstract: Processor(s) of a client device can: identify a textual segment stored locally at the client device; process the textual segment, using an on-device TTS generator model, to generate synthesized speech audio data that includes synthesized speech of the textual segment; process the synthesized speech, using an on-device ASR model to generate predicted ASR output; and generate a gradient based on comparing the predicted ASR output to ground truth output corresponding to the textual segment. Processor(s) of the client device can also: process the synthesized speech audio data using an on-device TTS generator model to make a prediction; and generate a gradient based on the prediction. In these implementations, the generated gradient(s) can be used to update weight(s) of the respective on-device model(s) and/or transmitted to a remote system for use in remote updating of respective global model(s). The updated weight(s) and/or the updated model(s) can be transmitted to client device(s).
-
公开(公告)号：US11573698B2
公开(公告)日：2023-02-07
申请号：US17469622
申请日：2021-09-08
Applicant: Google LLC
Inventor： Shumin Zhai , Thomas Breuel , Ouais Alsharif , Yu Ouyang , Francoise Beaufays , Johan Schalkwyk
IPC: G06F3/02 , G06F3/04886 , G06N3/04 , G06F40/232 , G06F40/274 , G06F40/279 , G06F3/023 , G06F3/04895 , G06F3/0482 , G06F3/04883 , G06N3/08
Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
-
公开(公告)号：US20230037085A1
公开(公告)日：2023-02-02
申请号：US17788183
申请日：2021-01-07
Applicant: GOOGLE LLC
Inventor： Fadi Biadsy , Johan Schalkwyk , Jason Pelecanos
Abstract: Implementations disclosed herein are directed to techniques for selectively enabling and/or disabling non-transient storage of one or more instances of assistant interaction data for turn(s) of a dialog between a user and an automated assistant. Implementations are additionally or alternatively directed to techniques for retroactive wiping of non-transiently stored assistant interaction data from previous assistant interaction(s).
-
公开(公告)号：US11545133B2
公开(公告)日：2023-01-03
申请号：US17082518
申请日：2020-10-28
Applicant: Google LLC
Inventor： Françoise Beaufays , Johan Schalkwyk , Khe Chai Sim
IPC: G10L15/18 , G10L15/07 , G10L13/047 , G10L13/033 , G10L13/10
Abstract: Processor(s) of a client device can: identify a textual segment stored locally at the client device; process the textual segment, using an on-device TTS generator model, to generate synthesized speech audio data that includes synthesized speech of the textual segment; process the synthesized speech, using an on-device ASR model to generate predicted ASR output; and generate a gradient based on comparing the predicted ASR output to ground truth output corresponding to the textual segment. Processor(s) of the client device can also: process the synthesized speech audio data using an on-device TTS generator model to make a prediction; and generate a gradient based on the prediction. In these implementations, the generated gradient(s) can be used to update weight(s) of the respective on-device model(s) and/or transmitted to a remote system for use in remote updating of respective global model(s). The updated weight(s) and/or the updated model(s) can be transmitted to client device(s).
-
Patent Agency Ranking
公开(公告)号：US11416214B2
公开(公告)日：2022-08-16
申请号：US16892749
申请日：2020-06-04
Applicant: Google LLC
Inventor： Brandon M. Ballinger , Johan Schalkwyk , Michael H. Cohen , William J. Byrne , Gudmundur Hafsteinsson , Michael J. Lebeau
IPC: G06F40/284 , G06F3/16 , G10L15/183 , G10L15/30 , G06F40/58 , G10L15/18 , G10L15/26 , G06F3/04886 , G10L15/00 , G10L15/22 , G10L15/197
Abstract: A computer-implemented input-method editor process includes receiving a request from a user for an application-independent input method editor having written and spoken input capabilities, identifying that the user is about to provide spoken input to the application-independent input method editor, and receiving a spoken input from the user. The spoken input corresponds to input to an application and is converted to text that represents the spoken input. The text is provided as input to the application.
-
公开(公告)号：US11086597B2
公开(公告)日：2021-08-10
申请号：US16758144
申请日：2018-08-14
Applicant: GOOGLE LLC
Inventor： Yuan Yuan , Johan Schalkwyk , Kenneth Mixter
Abstract: The various implementations described herein include methods, devices, and systems for attending to a presenting user. In one aspect, a method is performed at an electronic device that includes an image sensor, microphones, a display, processor(s), and memory. The device (1) obtains audio signals by concurrently receiving audio data at each microphone; (2) determines based on the obtained audio signals that a person is speaking in a vicinity of the device; (3) obtains video data from the image sensor; (4) determines via the video data that the person is not within a field of view of the image sensor; (5) reorients the electronic device based on differences in the received audio data; (6) after reorienting the electronic device, obtains second video data from the image sensor and determines that the person is within the field of view; and (7) attends to the person by directing the display toward the person.
-
公开(公告)号：US11049504B2
公开(公告)日：2021-06-29
申请号：US16885151
申请日：2020-05-27
Applicant: Google LLC
Inventor： Alexander H. Gruenstein , Petar Aleksic , Johan Schalkwyk , Pedro J. Moreno Mengibar
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting hotwords using a server. One of the methods includes receiving an audio signal encoding one or more utterances including a first utterance; determining whether at least a portion of the first utterance satisfies a first threshold of being at least a portion of a key phrase; in response to determining that at least the portion of the first utterance satisfies the first threshold of being at least a portion of a key phrase, sending the audio signal to a server system that determines whether the first utterance satisfies a second threshold of being the key phrase, the second threshold being more restrictive than the first threshold; and receiving tagged text data representing the one or more utterances encoded in the audio signal when the server system determines that the first utterance satisfies the second threshold.
-
公开(公告)号：US10671281B2
公开(公告)日：2020-06-02
申请号：US16261640
申请日：2019-01-30
Applicant: Google LLC
Inventor： Shumin Zhai , Thomas Breuel , Ouais Alsharif , Yu Ouyang , Francoise Beaufays , Johan Schalkwyk
IPC: G06F3/02 , G06F3/0488 , G06N3/04 , G06F40/232 , G06F40/274 , G06F40/279 , G06F3/023 , G06F3/0489 , G06F3/0482 , G06N3/08
Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.
-
公开(公告)号：US10311876B2
公开(公告)日：2019-06-04
申请号：US15432358
申请日：2017-02-14
Applicant: Google LLC
Inventor： Alexander H. Gruenstein , Petar Aleksic , Johan Schalkwyk , Pedro J. Moreno Mengibar
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting hotwords using a server. One of the methods includes receiving an audio signal encoding one or more utterances including a first utterance; determining whether at least a portion of the first utterance satisfies a first threshold of being at least a portion of a key phrase; in response to determining that at least the portion of the first utterance satisfies the first threshold of being at least a portion of a key phrase, sending the audio signal to a server system that determines whether the first utterance satisfies a second threshold of being the key phrase, the second threshold being more restrictive than the first threshold; and receiving tagged text data representing the one or more utterances encoded in the audio signal when the server system determines that the first utterance satisfies the second threshold.
-
-
-
-
-
-
-
-
-
Search Results
68
records
(took 0.025 seconds)
