公开(公告)号：US12038299B2

公开(公告)日：2024-07-16

申请号：US17273672

申请日：2020-10-22

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G01C21/36 ,  G10L15/05 ,  G10L15/22

CPC classification number: G01C21/3629 ,  G01C21/3655 ,  G10L15/05 ,  G10L15/22

Abstract: To provide content-aware audio navigation instructions, a client device executing a mapping application obtains one or more audio navigation directions for traversing from a starting location to a destination location along a route. The client device also identifies electronic media content playing from a source different from the mapping application which is executing at the client device or in proximity to the client device. The client device determines characteristics of the electronic media content and adjusts the audio navigation directions in accordance with the characteristics of the electronic media content. Then the client device presents the adjusted audio navigation directions to a user.

公开(公告)号：US20240203413A1

公开(公告)日：2024-06-20

申请号：US18083429

申请日：2022-12-16

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/22 ,  G10L15/30

CPC classification number: G10L15/22 ,  G10L15/30 ,  G10L2015/223

Abstract: Implementations related to selecting a primary automated assistant for a given automated assistant device that is connected to one or more other automated assistant devices in an ecosystem of connected devices. An affinity score is generated for each of a plurality of candidate automated assistants that are capable of executing on the automated assistant device. The affinity score of a given automated assistant for an automated assistant device is indicative of suitability of the automated assistant for the automated assistant device. One of the candidate automated assistants is selected as the primary automated assistant for the device. The primary automated assistant is prioritized when resources of the automated assistant device are allocated to automated assistants executing on the automated assistant device.

公开(公告)号：US20240185849A1

公开(公告)日：2024-06-06

申请号：US18075214

申请日：2022-12-05

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F3/01 ,  G06T19/00

CPC classification number: G10L15/22 ,  G06F3/011 ,  G06T19/006 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can be accessible via a virtual environment for controlling features of the virtual environment and/or devices in a physical environment of the user. When the automated assistant is invoked, the automated assistant can materialize in the virtual environment according to any request that the automated assistant has been invoked to fulfill. For example, depending on the request from the user, the automated assistant can cause rendering of a virtual object for fulfilling the request and/or controlling an ongoing operation of the automated assistant. When the virtual object is rendered to control an operation of the automated assistant, or another application, the virtual object can include a virtual feature that the user can interact with to control the virtual environment and/or devices in a physical environment of the user.

公开(公告)号：US20240185848A1

公开(公告)日：2024-06-06

申请号：US18075155

申请日：2022-12-05

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22

CPC classification number: G10L15/22 ,  G10L2015/223 ,  G10L2015/225 ,  G10L2015/228

Abstract: Systems and methods for creating a group automated assistant session and processing requests that are intended for the users that are included in the group. A plurality of users can indicate intentions to create a group session that includes selecting an automated assistant, from the automated assistants executing on the devices of the user and providing the selected automated assistant with audio data that is captured by microphones of the user devices. In response, the selected automated assistant processes the audio data and generates a response that is provided, via one or more speakers of the device that is executing the selected automated assistant. Further, fulfillment data is provided to the automated assistants executing on other devices and, in response to being provided the fulfillment data, each automated assistant causes audio data to be rendered, via one or more speakers of each respective device, that is responsive to the request.

公开(公告)号：US20240184867A1

公开(公告)日：2024-06-06

申请号：US18061207

申请日：2022-12-02

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F21/32 ,  G06F9/451 ,  G06V40/16 ,  G10L17/22

CPC classification number: G06F21/32 ,  G06F9/453 ,  G06V40/172 ,  G10L17/22 ,  G06F3/167

Abstract: A method for adapting a guest mode for portable speakers includes obtaining a current state of an assistant-enabled device while a guest mode is enabled. Here, the assistant-enabled device is configured to allow a digital assistant to fulfill queries spoken by speakers who are not enrolled users when the guest mode is enabled. Based on the current state of the assistant-enabled device, the method includes disabling the guest mode to suppress fulfillment of queries spoken by speakers who are not enrolled users. While the guest mode is disabled, the method includes receiving audio data corresponding to a query, the query including a command for the digital assistant to perform an action, performing speaker identification to determine that a speaker of the query is not an enrolled user, and based on determining that the speaker of the query is not an enrolled user, suppressing fulfillment of the action.

公开(公告)号：US11996094B2

公开(公告)日：2024-05-28

申请号：US16947030

申请日：2020-07-15

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/16 ,  G10L15/183 ,  G10L15/26

CPC classification number: G10L15/22 ,  G06F3/165 ,  G10L15/16 ,  G10L15/183 ,  G10L15/26

Abstract: User interaction may be supported with an audio presentation by an automated assistant, and in particular with the spoken content of such an audio presentation that is presented at particular points within the audio presentation. Analysis of an audio presentation may be performed to identify one or more entities addressed by, mentioned by, or otherwise associated with the audio presentation, and utterance classification may be performed to determine whether an utterance received during playback of the audio presentation is directed to the audio presentation, and in some instances, to a particular entity and/or point of playback in the audio presentation, thereby enabling a suitable response to be generated to the utterance.

公开(公告)号：US20240119083A1

公开(公告)日：2024-04-11

申请号：US18538773

申请日：2023-12-13

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F16/432 ,  G06F3/16 ,  G06F40/30 ,  G10L15/22

CPC classification number: G06F16/433 ,  G06F3/167 ,  G06F40/30 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations described herein relate to receiving user input directed to an automated assistant, processing the user input to determine whether data from a server and/or third-party application is needed to perform certain fulfillment of an assistant command included in the user input, and generating a prompt that requests a user consent to transmitting of a request to the server and/or the third-party application to obtain the data needed to perform the certain fulfillment. In implementations where the user consents, the data can be obtained and utilized to perform the certain fulfillment. In implementations where the user does not consent, client data can be generated locally at a client device and utilized to perform alternate fulfillment of the assistant command. In various implementations, the request transmitted to the server and/or third-party application can be modified based on ambient noise captured when the user input is received.

公开(公告)号：US20240111352A1

公开(公告)日：2024-04-04

申请号：US17637989

申请日：2021-07-19

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F1/3212 ,  G01C21/36

CPC classification number: G06F1/3212 ,  G01C21/3667 ,  G01C21/3691

Abstract: Techniques for saving mobile device power during turn by turn navigation sessions are provided. An example method includes receiving an indication of an origin location and a destination location via a navigation application operating on a mobile computing device; generating a navigation route based on the origin location and the destination location using the navigation application, including indications of one or more maneuvers required to be performed by a user; comparing a remaining battery power level associated with the mobile computing device to a predicted processing power required for the navigation application to perform one or more functions related to the navigation route; and causing the navigation application to operate in a power-saving mode based on the comparison. Operating the navigation application in the power-saving mode may include temporarily suspending at least one of the one or more functions of related to the navigation route.

公开(公告)号：US11924149B2

公开(公告)日：2024-03-05

申请号：US16949150

申请日：2020-10-15

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: H04L51/02 ,  G10L15/06 ,  G10L15/22

CPC classification number: H04L51/02 ,  G10L15/063 ,  G10L15/22 ,  G10L2015/0631 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that facilitates the creation of complex messages from user input(s) to the automated assistant. Each message can be created according to a respective template that is selected based on user input that directs the automated assistant to communicate a message to a recipient. Furthermore, sections of a template can be designated for certain content based on prior messages communicated by one or more users to one or more recipients. In this way, in response to a user requesting that the automated assistant send a message, the automated assistant can select a related template and fill out the template accordingly. In some instances, content that is assigned to certain sections of the selected template can come from a variety of different sources and/or may not be explicitly specified in the request from the user to the automated assistant.

公开(公告)号：US11838582B1

公开(公告)日：2023-12-05

申请号：US18064921

申请日：2022-12-12

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F15/16 ,  H04N21/442 ,  H04N21/258 ,  H04W4/029

CPC classification number: H04N21/44209 ,  H04N21/25891 ,  H04W4/029

Abstract: A method using media arbitration includes, while a first assistant-enabled device is performing a first long-standing operation, determining the first assistant-enabled device satisfies a co-presence condition with a second assistant-enabled device, and determining that the second assistant-enabled device is performing a second long-standing operation that conflicts with the first long-standing operation performed by the first assistant-enabled device. Based on determining that the first long-standing operation and the second long-standing operation conflict, the method also includes executing an operation arbitration routine to identify one or more compromise operations for at least one of the first assistant-enabled device or the second assistant-enabled device to perform, and instructing the first assistant-enabled device or the second assistant-enabled device to perform a selected compromise operation among the identified compromise operations.