公开(公告)号：US12111875B2

公开(公告)日：2024-10-08

申请号：US18081372

申请日：2022-12-14

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G06F16/95 ,  G06F16/9537

CPC classification number: G06F16/9537

Abstract: Implementations described herein relate to pairing a location-based automated assistant with a user device. The user device can include, for example, a headphones apparatus and/or a device that is paired with the headphones apparatus. The user device provides an indication that it is present at a location that is associated with a location-based automated assistant. A trust measure is determined that is indicative of trust between the user device and the location-based automated assistant. User information is provided by the user device to the location-based automated assistant. The location-based automated assistant determines response data to provide, via one or more speakers associated with the user device, that is specific to the location and further based on the user information.

公开(公告)号：US12111834B1

公开(公告)日：2024-10-08

申请号：US18390768

申请日：2023-12-20

Applicant: Google LLC

Inventor： Victor Carbune ,  Arash Sadr ,  Matthew Sharifi

IPC: G06F16/00 ,  G06F16/2455 ,  G06F16/248

CPC classification number: G06F16/24553 ,  G06F16/248

Abstract: Systems and methods for generating and providing outputs in a multi-device system can include leveraging environment-based prompt generation and generative model response generation to provide dynamic response generation and display. The systems and methods can obtain input data associated with one or more computing devices within an environment, can obtain environment data descriptive of the plurality of computing devices within the environment, and can generate a prompt based on the input data and environment data. The prompt can be processed with a generative model to generate a model-generated output. The model-generated output can then be transmitted to a particular computing device of the plurality of computing devices.

公开(公告)号：US20240328808A1

公开(公告)日：2024-10-03

申请号：US18740870

申请日：2024-06-12

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G01C21/36 ,  G10L15/05 ,  G10L15/22

CPC classification number: G01C21/3629 ,  G01C21/3655 ,  G10L15/05 ,  G10L15/22

Abstract: To provide content-aware audio navigation instructions, a client device executing a mapping application obtains one or more audio navigation directions for traversing from a starting location to a destination location along a route. The client device also identifies electronic media content playing from a source different from the mapping application which is executing at the client device or in proximity to the client device. The client device determines characteristics of the electronic media content and adjusts the audio navigation directions in accordance with the characteristics of the electronic media content. Then the client device presents the adjusted audio navigation directions to a user.

公开(公告)号：US20240318971A1

公开(公告)日：2024-09-26

申请号：US18592261

申请日：2024-02-29

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi ,  Blaise Aguera-Arcas

IPC: G01C21/36 ,  G01C21/34 ,  G06F3/16 ,  G10L15/22 ,  G10L15/30

CPC classification number: G01C21/3608 ,  G01C21/3415 ,  G06F3/165 ,  G10L15/22 ,  G10L2015/223 ,  G10L2015/225 ,  G10L2015/228 ,  G10L15/30

Abstract: The present disclosure is directed to interactive voice navigation. In particular, a computing system can provide audio information including one or more navigation instructions to a user via a computing system associated with the user. The computing system can activate an audio sensor associated with the computing system. The computing system can collect, using the audio sensor, audio data associated with the user. The computing system can determine, based on the audio data, whether the audio data is associated with one or more navigation instructions. The computing system can, in accordance with a determination that the audio data is associated with one or more navigation instructions, determine a context-appropriate audio response. The computing system can provide the context-appropriate audio response to the user.

公开(公告)号：US20240290324A1

公开(公告)日：2024-08-29

申请号：US18659224

申请日：2024-05-09

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/065 ,  G10L15/01 ,  G10L15/06 ,  G10L15/18 ,  G10L15/26 ,  G10L15/30

CPC classification number: G10L15/065 ,  G10L15/01 ,  G10L15/063 ,  G10L15/18 ,  G10L15/26 ,  G10L15/30

Abstract: A method includes receiving user queries directed toward a cloud-based assistant service. For each received user query directed toward the cloud-based assistant service, the method also includes extracting one or more attributes from the user query and logging the user query into one or more of a plurality of category buckets based on the one or more attributes extracted from the user query. The method also includes determining when at least one of the plurality of category buckets includes a threshold number of the user queries logged into the at least one category bucket, and when the at least one of the plurality of category buckets includes the threshold number of the user queries, generating a distilled model of the cloud-based assistant service. The distilled model of the cloud-based assistant service is configured to execute on one or more target client devices.

公开(公告)号：US12050110B2

公开(公告)日：2024-07-30

申请号：US17057079

申请日：2020-09-11

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G01C21/00 ,  G01C21/36 ,  G10L15/22

CPC classification number: G01C21/3661 ,  G10L15/22 ,  G10L2015/228

Abstract: A first computing device can implement a method for providing navigation instructions. The method includes initiating a first navigation session for providing a first set of navigation instructions to a user from a starting location to a destination location along a first route. The method also includes detecting a second computing device in proximity to the first computing device, and determining that the second computing device is implementing a second navigation session for providing a second set of navigation instructions to the destination location along a second route. Further, the method includes adjusting the first navigation session in accordance with the second navigation session.

公开(公告)号：US20240233735A1

公开(公告)日：2024-07-11

申请号：US18617072

申请日：2024-03-26

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L17/22 ,  G06F3/16 ,  G10L19/018 ,  G10L25/51

CPC classification number: G10L17/22 ,  G06F3/165 ,  G10L19/018 ,  G10L25/51

Abstract: Techniques are described herein for detecting and suppressing commands in media that may trigger another automated assistant. A method includes: determining, for each of a plurality of automated assistant devices in an environment that are each executing at least one automated assistant, an active capability of the automated assistant device; initiating playback of digital media by an automated assistant; in response to initiating playback, processing the digital media to identify an audio segment in the digital media that, upon playback, is expected to trigger activation of at least one automated assistant executing on at least one of the plurality of automated assistant devices in the environment, based on the active capability of the at least one of the plurality of automated assistant devices; and in response to identifying the audio segment in the digital media, modifying the digital media to suppress the activation of the at least one automated assistant.

公开(公告)号：US20240221748A1

公开(公告)日：2024-07-04

申请号：US18608559

申请日：2024-03-18

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/22 ,  G06F16/9032 ,  G06F16/9035 ,  G06F21/12 ,  G10L15/26 ,  G06F3/04812

CPC classification number: G10L15/22 ,  G06F16/90332 ,  G06F16/9035 ,  G06F21/121 ,  G10L15/26 ,  G06F3/04812

Abstract: Implementations relate to generating a proficiency measure, and utilizing the proficiency measure to adapt one or more automated assistant functionalities. The generated proficiency measure is for a particular class of automated assistant actions, and is specific to an assistant device and/or is specific to a particular user. A generated proficiency measure for a class can reflect a degree of proficiency, of a user and/or of an assistant device, for that class. Various automated assistant functionalities can be adapted, for a particular class, responsive to determining the proficiency measure satisfies a threshold, or fails to satisfy the threshold (or an alternate threshold). The adaptation(s) can make automated assistant processing more efficient and/or improve (e.g., shorten the duration of) user-assistant interaction(s).

公开(公告)号：US20240203410A1

公开(公告)日：2024-06-20

申请号：US18081557

申请日：2022-12-14

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F3/16 ,  G06T17/00 ,  G06V10/74

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06T17/00 ,  G06V10/761 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant application that can be accessible via a virtual environment and can streamline certain assistant interactions by rendering certain virtual features within the virtual environment. When the automated assistant determines that a user is accessing a portion of a virtual environment that includes a particular virtual object, the automated assistant can identify application operations that may be associated with the particular virtual object. Based on these identified operations, the automated assistant can cause rendering of certain virtual features in the virtual environment for initializing and/or otherwise controlling the operations. In some instances, these operations can affect the virtual environment and/or devices in a physical environment, as well as any other users that may be accessing the virtual environment. Virtual features can thereafter be adapted, by the automated assistant, to streamline interactions that a user may be repeatedly occurring.

公开(公告)号：US20240202490A1

公开(公告)日：2024-06-20

申请号：US18589391

申请日：2024-02-27

Applicant: GOOGLE LLC

Inventor： Thomas Deselaers ,  Victor Carbune

IPC: G06N3/006 ,  B60W30/18 ,  G06F18/21 ,  G06N20/00 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58

CPC classification number: G06N3/006 ,  B60W30/18163 ,  G06F18/217 ,  G06N20/00 ,  G06V10/764 ,  G06V10/82 ,  G06V20/58 ,  G06V20/588 ,  B60W2420/403 ,  B60W2520/10 ,  B60W2552/10 ,  B60W2555/20

Abstract: To select a lane in a multi-lane road segment for a vehicle travelling on the road segment, a system identifies, in multiple lanes and in a region ahead of the vehicle, another vehicle defining a target; the system applies an optical flow technique to track the target during a period of time, to generate an estimate of how fast traffic moves; and the system applies the estimate to machine learning (ML) model to generate a recommendation which one of the plurality of lanes the vehicle is to choose