-
公开(公告)号:US20230359818A1
公开(公告)日:2023-11-09
申请号:US18246326
申请日:2020-12-18
Applicant: Google LLC
Inventor: Matthew Sharifi , Sebastian Millius , Qi Wang , Yunpeng Li , Shankar Kumar , Lukas Zilka , Simon Tong , Martin Sundermeyer
IPC: G06F40/253
CPC classification number: G06F40/253
Abstract: A computing device may receive inputted text and perform, using one or more neural networks, on-device grammar checking of a sequence of words in the inputted text, including determining, using the one or more neural networks, a grammatically correct version of the sequence of words and determining that the sequence of words does not match the grammatically correct version of the sequence of words. The computing device may, in response to determining that the sequence of words does not match the grammatically correct version of the sequence of words, output, for display at a display device, at least a portion of the grammatically correct version of the sequence of words as a suggested replacement for at least a sequence of the sequence of words in the inputted text.
-
262.
公开(公告)号:US20230251877A1
公开(公告)日:2023-08-10
申请号:US17665643
申请日:2022-02-07
Applicant: GOOGLE LLC
Inventor: Victor Carbune , Matthew Sharifi
Abstract: Automated content switching rules may be generated and/or utilized for automatically switching away from certain interactive content during presentation of that interactive content when one or more switch conditions are met. In some instances, automated content switching rules may define one or more non-temporal switch conditions, e.g., based upon reaching certain points or milestones in certain interactive content, that may be used to initiate actions that switch away from the interactive content. In addition, in some instances, automated content switching rules may be used to not only switch away from particular interactive content, but additionally switch to other interactive content, thereby enabling a user to effectively schedule a workflow across different interactive content, applications and/or other computer-related tasks.
-
公开(公告)号:US11694685B2
公开(公告)日:2023-07-04
申请号:US17118251
申请日:2020-12-10
Applicant: Google LLC
Inventor: Victor Carbune , Matthew Sharifi
IPC: G10L15/00 , G10L15/16 , G10L15/22 , G06F16/2452 , G06F1/3231 , G10L15/28 , G10L15/08
CPC classification number: G10L15/22 , G06F1/3231 , G06F16/24522 , G10L15/16 , G10L15/285 , G10L2015/088 , G10L2015/223
Abstract: A method includes receiving audio data corresponding to an utterance spoken by the user and captured by the user device. The utterance includes a command for a digital assistant to perform an operation. The method also includes determining, using a hotphrase detector configured to detect each trigger word in a set of trigger words associated with a hotphrase, whether any of the trigger words in the set of trigger words are detected in the audio data during the corresponding fixed-duration time window. The method also includes determining identifying, in the audio corresponding to the utterance, the hotphrase when each other trigger word in the set of trigger words was also detected in the audio data. The method also includes triggering an automated speech recognizer to perform speech recognition on the audio data when the hotphrase is identified in the audio data corresponding to the utterance.
-
公开(公告)号:US20230169980A1
公开(公告)日:2023-06-01
申请号:US18097157
申请日:2023-01-13
Applicant: GOOGLE LLC
Inventor: Victor Carbune , Matthew Sharifi
CPC classification number: G10L15/32 , G10L15/22 , G10L2015/223
Abstract: Techniques are described herein for detecting and handling failures in other automated assistants. A method includes: executing a first automated assistant in an inactive state at least in part on a computing device operated by a user; while in the inactive state, determining, by the first automated assistant, that a second automated assistant failed to fulfill a request of the user; in response to determining that the second automated assistant failed to fulfill the request of the user, the first automated assistant processing cached audio data that captures a spoken utterance of the user comprising the request that the second automated assistant failed to fulfill, or features of the cached audio data, to determine a response that fulfills the request of the user; and providing, by the first automated assistant to the user, the response that fulfills the request of the user.
-
公开(公告)号:US20230169976A1
公开(公告)日:2023-06-01
申请号:US18160342
申请日:2023-01-27
Applicant: Google LLC
Inventor: Matthew Sharifi , Victor Carbune
CPC classification number: G10L15/22 , G06F3/167 , G10L15/075 , G10L15/083 , G10L2015/223
Abstract: A method for streaming action fulfillment receives audio data corresponding to an utterance where the utterance includes a query to perform an action that requires performance of a sequence of sub-actions in order to fulfill the action. While receiving the audio data, but before receiving an end of speech condition, the method processes the audio data to generate intermediate automated speech recognition (ASR) results, performs partial query interpretation on the intermediate ASR results to determine whether the intermediate ASR results identify an application type needed to perform the action and, when the intermediate ASR results identify a particular application type, performs a first sub-action in the sequence of sub-actions by launching a first application to execute on the user device where the first application is associated with the particular application type. The method, in response to receiving an end of speech condition, fulfills performance of the action.
-
公开(公告)号:US20230169963A1
公开(公告)日:2023-06-01
申请号:US17538766
申请日:2021-11-30
Applicant: GOOGLE LLC
Inventor: Matthew Sharifi , Victor Carbune
CPC classification number: G10L15/1815 , G06F21/62 , G06N5/043 , G10L15/22 , G10L2015/223
Abstract: Systems and methods for obfuscating and/or omitting potentially sensitive information in a spoken query before providing the query to a secondary automated assistant. A general automated assistant may be invoked by a user, followed by a query. The audio data can be processed to omit and/or obfuscate potentially sensitive information before providing one or more processed queries to secondary automated assistants based on a trust metric associated with each of the secondary automated assistants. The trust metric for a secondary automated assistant is indicative of trust in being provided with sensitive information. In response, the automated assistants can generate responses, which can be filtered to provide a response to the user.
-
公开(公告)号:US20230160710A1
公开(公告)日:2023-05-25
申请号:US17251244
申请日:2020-08-12
Applicant: Google LLC
Inventor: Victor Carbune , Matthew Sharifi , Blaise Aguera-Arcas
CPC classification number: G01C21/3608 , G10L15/22 , G06F3/165 , G01C21/3415 , G10L2015/228 , G10L2015/223 , G10L2015/225 , G10L15/30
Abstract: The present disclosure is directed to interactive voice navigation. In particular, a computing system can provide audio information including one or more navigation instructions to a user via a computing system associated with the user. The computing system can activate an audio sensor associated with the computing system. The computing system can collect, using the audio sensor, audio data associated with the user. The computing system can determine, based on the audio data, whether the audio data is associated with one or more navigation instructions. The computing system can, in accordance with a determination that the audio data is associated with one or more navigation instructions, determine a context-appropriate audio response. The computing system can provide the context-appropriate audio response to the user.
-
公开(公告)号:US20230158683A1
公开(公告)日:2023-05-25
申请号:US17533873
申请日:2021-11-23
Applicant: GOOGLE LLC
Inventor: Victor Carbune , Matthew Sharifi
CPC classification number: B25J13/003 , B25J9/1653 , B25J9/162 , B25J9/0003 , B25J9/1664 , B25J9/161 , B25J11/0005
Abstract: Implementations set forth herein relate to a robotic computing device that can perform certain operations, such as communicating between users in a common space, according to certain preferences of the users. When interacting with a particular user, the robotic computing device can perform an operation at a preferred location relative to the particular user based on an express or implied preference of that particular user. For instance, certain types of operations can be performed at a first location within a room, and other types of operations can be performed at a second location within the room. When an operation involves following or guiding a user, parameters for driving the robotic computing device can be selected based on preferences of the user and/or a context in which the robotic computing device is interacting with the user (e.g., whether or not the context indicates some amount of urgency).
-
公开(公告)号:US11657817B2
公开(公告)日:2023-05-23
申请号:US17100013
申请日:2020-11-20
Applicant: Google LLC
Inventor: Matthew Sharifi , Victor Carbune
IPC: G10L15/22 , G06F3/04886 , G10L25/78 , G06F3/16
CPC classification number: G10L15/22 , G06F3/04886 , G06F3/167 , G10L25/78 , G10L2015/223 , G10L2015/228
Abstract: Implementations set forth relate to suggesting an alternate interface modality when an automated assistant and/or a user is expected to not understand a particular interaction between the user and the automated assistant. In some instances, the automated assistant can pre-emptively determine that a forthcoming and/or ongoing interaction between a user and an automated assistant may experience interference. Based on this determination, the automated assistant can provide an indication that the interaction may not be successful and/or that the user should interact with the automated assistant through a different modality. For example, the automated assistant can render a keyboard interface at a portable computing device when the automated assistant determines that an audio interface of the portable computing device is experiencing interference.
-
公开(公告)号:US20230153410A1
公开(公告)日:2023-05-18
申请号:US17648095
申请日:2022-01-14
Applicant: Google LLC
Inventor: Matthew Sharifi , Victor Carbune
CPC classification number: G06F21/32 , G10L17/24 , G10L17/02 , G10L17/14 , G06F21/6245 , G06F3/0481
Abstract: A method for sharing assistant profiles includes receiving, at a profile service, from an assistant service interacting with a user device of a user, a request requesting the profile service to release personal information associated with the user to the assistant service. The operations also include performing, through the assistant service, a verification process to verify that the user consents to releasing the requested personal information by: instructing the assistant service to prompt the user to recite a unique token prescribed to the user; receiving audio data characterizing a spoken utterance captured by the user device of the user; processing the audio data to determine whether a transcription of the spoken utterance recites the unique token; and when the transcription of the spoken utterance recites the unique token, releasing, to the assistant service, the requested personal information stored on a centralized data store managed by the profile service.
-
-
-
-
-
-
-
-
-