公开(公告)号：US20250124929A1

公开(公告)日：2025-04-17

申请号：US18999855

申请日：2024-12-23

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/30 ,  G10L15/00 ,  G10L15/06 ,  G10L15/22

Abstract: Implementations are directed to dynamically adapting which assistant on-device model(s) are locally stored at assistant devices of an assistant device group and/or dynamically adapting the assistant processing role(s) of the assistant device(s) of the assistant device group. In some of those implementations, the corresponding on-device model(s) and/or corresponding processing role(s), for each of the assistant devices of the group, is determined based on collectively considering individual processing capabilities of the assistant devices of the group. Implementations are additionally or alternatively directed to cooperatively utilizing assistant devices of a group, and their associated post-adaptation on-device model(s) and/or post-adaptation processing role(s), in cooperatively processing assistant requests that are directed to any one of the assistant devices of the group.

公开(公告)号：US12260858B2

公开(公告)日：2025-03-25

申请号：US17532276

申请日：2021-11-22

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/22

Abstract: Systems and methods for providing dialog data, from an initially invoked automated assistant to a subsequently invoked automated assistant. A first automated assistant may be invoked by a user utterance, followed by a dialog with the user that is processed by the first automated assistant. During the dialog, a request to transfer dialog data to a second automated assistant is received. The request may originate with the user, by the first automated assistant, and/or by the second automated assistant. Once authorized, the first automated assistant provides the previous dialog data to the second automated assistant. The second automated assistant performs one or more actions based on the dialog data.

公开(公告)号：US20250093164A1

公开(公告)日：2025-03-20

申请号：US18468338

申请日：2023-09-15

Applicant: Google LLC

Inventor： Victor Carbune ,  Polina Zablotskaia ,  Matthew Sharifi ,  Manuel Tragut

IPC: G01C21/34 ,  G06N3/0455 ,  G06N3/084 ,  G10L15/06 ,  G10L15/18 ,  G10L15/183 ,  G10L15/30

Abstract: Training data is obtained. The training data includes (a) route information indicative of a route from a starting location to a destination location, wherein the route comprises a plurality of route segments comprising a first subset of route segments and a second subset of route segments, and (b) route characteristic information descriptive of one or more route characteristics. At least the first subset of route segments and a portion of the route characteristic information associated with the first subset of route segments is processed with a machine-learned semantic routing model to obtain one or more predicted route segments for the second subset of route segments. One or more parameters of the machine-learned semantic routing model are adjusted based on an optimization function that evaluates a difference between the one or more predicted route segments and the second subset of route segments.

公开(公告)号：US12254885B2

公开(公告)日：2025-03-18

申请号：US18097157

申请日：2023-01-13

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/32 ,  G10L15/22

Abstract: Techniques are described herein for detecting and handling failures in other automated assistants. A method includes: executing a first automated assistant in an inactive state at least in part on a computing device operated by a user; while in the inactive state, determining, by the first automated assistant, that a second automated assistant failed to fulfill a request of the user; in response to determining that the second automated assistant failed to fulfill the request of the user, the first automated assistant processing cached audio data that captures a spoken utterance of the user comprising the request that the second automated assistant failed to fulfill, or features of the cached audio data, to determine a response that fulfills the request of the user; and providing, by the first automated assistant to the user, the response that fulfills the request of the user.

公开(公告)号：US12246676B2

公开(公告)日：2025-03-11

申请号：US17642175

申请日：2021-06-23

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi

IPC: G01C21/34 ,  B60R25/25 ,  G01C21/36 ,  G06F21/32

Abstract: To determine whether a user is authorized to make a particular audio request during navigation, a client device receives a request for navigation directions from a starting location to a destination location. The client device provides a set of navigation directions for traversing to the destination location along a route. During a navigation session, an audio request related to the route is received from a user. The client device determines an authorization level of the user based on the audio request, and provides a response to the request based on the authorization level of the user.

公开(公告)号：US20250054495A1

公开(公告)日：2025-02-13

申请号：US18446798

申请日：2023-08-09

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/19 ,  G10L15/22 ,  G10L21/028 ,  G10L25/51

Abstract: Implementations set forth herein relate to an automated assistant that can selectively communicate audio data to a recipient when a user solicits the automated assistant to send a text message to the recipient. The audio data can include a snippet of audio that characterizes content of the text message, and the automated assistant can communicate the audio data to the recipient when score data for a speech recognition hypothesis does not satisfy a confidence threshold. The score data can correspond to an entirety of content of a text message and/or speech recognition hypothesis, and/or less than an entirety of the content. A recipient device can optionally re-process the audio data using a model that is associated with the recipient device. This can provide more accurate transcripts in some instances, thereby improving accuracy of communications and decreasing a number of corrective messages sent between users.

公开(公告)号：US20250052587A1

公开(公告)日：2025-02-13

申请号：US18287332

申请日：2022-09-28

Applicant: Google LLC

Inventor： Matthew Sharifi

IPC: G01C21/34 ,  H04L67/52

Abstract: The technology is generally directed to providing a next suggested action based on a first user's request for location information of a second user and the location information of the second user. Location information may be shared between the first and second user after each user authorizes location sharing with specific users. The second user's location information may be provided to the first user in response to a request for the first user. Based on the request from the first user and the location information of the second user, a next suggested action may be automatically determined and provided to the first or second user. The suggested next action may be for the first user to send a message to the second user, the second user to send a message to the first user or another user, updating a navigation route, providing an update to a scheduled event, etc.

公开(公告)号：US20250047930A1

公开(公告)日：2025-02-06

申请号：US18923464

申请日：2024-10-22

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: H04N21/422 ,  G06V20/40 ,  G10L15/22 ,  G10L25/57 ,  H04N21/472

Abstract: Voice-based interaction with video content being presented by a media player application is enhanced through the use of an automated assistant capable of identifying when a spoken utterance by a user is a request to playback a specific scene in the video content. A query identified in a spoken utterance may be used to access stored scene metadata associated with video content being presented in the vicinity of the user to identify one or more locations in the video content that correspond to the query, such that a media control command may be issued to the media player application to cause the media player application to seek to a particular location in the video content that satisfies the query.

公开(公告)号：US20250045326A1

公开(公告)日：2025-02-06

申请号：US18919620

申请日：2024-10-18

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F16/632 ,  G06F16/638 ,  G10L17/02 ,  G10L17/06

Abstract: A method for handling contradictory queries on a shared device includes receiving a first query issued by a first user, the first query specifying a first long-standing operation for a digital assistant to perform, and while the digital assistant is performing the first long-standing operation, receiving a second query, the second query specifying a second long-standing operation for the digital assistant to perform. The method also includes determining that the second query was issued by another user different than the first user and determining, using a query resolver, that performing the second long-standing operation would conflict with the first long-standing operation. The method further includes identifying one or more compromise operations for the digital assistant to perform, and instructing the digital assistant to perform a selected compromise operation among the identified one or more compromise operations.

公开(公告)号：US12217751B2

公开(公告)日：2025-02-04

申请号：US17644394

申请日：2021-12-15

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F16/9032 ,  G10L15/26 ,  G10L25/78

Abstract: A method includes instructing an always-on first processor to operate in a follow-on query detection mode, and while the always-on first processor operates in the follow-on query detection mode: receiving follow-on audio data captured by the assistant-enabled device; determining, using a voice activity detection (VAD) model executing on the always-on first processor, whether or not the VAD model detects voice activity in the follow-on audio data; performing, using a speaker identification (SID) model executing on the always-on first processor, speaker verification on the follow-on audio data to determine whether the follow-on audio data includes an utterance spoken by the same user. The method also includes initiating a wake-up process on a second processor to determine whether the utterance includes a follow-on query.