公开(公告)号：US12112754B2

公开(公告)日：2024-10-08

申请号：US18514730

申请日：2023-11-20

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G10L15/18 ,  H04L51/56

CPC classification number: G10L15/22 ,  G10L15/1815 ,  H04L51/56 ,  G10L2015/223

Abstract: Implementations relate to an automated assistant that can respond to communications received via a third party application and/or other third party communication modality. The automated assistant can determine that the user is participating in multiple different conversations via multiple different third party communication services. In some implementations, conversations can be processed to identify particular features of the conversations. When the automated assistant is invoked to provide input to a conversation, the automated assistant can compare the input to the identified conversation features in order to select the particular conversation that is most relevant to the input. In this way, the automated assistant can assist with any of multiple disparate conversations that are each occurring via a different third party application.

公开(公告)号：US12096321B2

公开(公告)日：2024-09-17

申请号：US17695163

申请日：2022-03-15

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Jakob Foerster

IPC: H04W4/50 ,  G06Q10/107 ,  H04L51/04 ,  H04L51/52 ,  H04L65/403 ,  H04L67/01 ,  H04M1/72427 ,  H04M1/72448 ,  H04W4/14 ,  H04W88/02

CPC classification number: H04W4/50 ,  G06Q10/107 ,  H04L51/04 ,  H04L51/52 ,  H04L65/403 ,  H04L67/01 ,  H04M1/72427 ,  H04M1/72448 ,  H04W4/14 ,  H04W88/02

Abstract: A computer-implemented technique can include detecting, by a first computing device, a set of user communications at least one of transmitted to and received by from a second computing device via a first communication mode, identifying a second communication mode that is available for communication between the first and second computing devices, and obtaining an appropriateness score for the first and second communication modes based on a contextual feature of the set of user communications, wherein the contextual feature relates an appropriateness of a particular communication mode for the set of user communications, and wherein each appropriateness score is indicative of a level of the appropriateness of a particular communication mode for the set of user communications. The technique can also include selectively outputting a suggestion to switch from the first communication mode to the second communication mode.

公开(公告)号：US12067997B2

公开(公告)日：2024-08-20

申请号：US17444557

申请日：2021-08-05

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Aleksandar Kracun

IPC: G10L13/027 ,  G06F18/21 ,  G10L13/08 ,  G10L17/24 ,  G10L21/00 ,  G10L25/87

CPC classification number: G10L21/00 ,  G06F18/217 ,  G10L13/027 ,  G10L13/086 ,  G10L17/24 ,  G10L25/87

Abstract: A method includes receiving text input data for conversion into synthesized speech and determining, using a hotword-aware model trained to detect a presence of a hotword assigned to a user device, whether a pronunciation of the text input data includes the hotword. The hotword is configured to initiate a wake-up process on the user device for processing the hotword and/or one or more other terms following the hotword in the audio input data. When the pronunciation of the text input data includes the hotword, the method also includes generating an audio output signal from the text input data and providing the audio output signal to an audio output device to output the audio output signal. The audio output signal when captured by an audio capture device of the user device, configured to prevent initiation of the wake-up process on the user device.

公开(公告)号：US12046239B2

公开(公告)日：2024-07-23

申请号：US18200518

申请日：2023-05-22

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/22 ,  G06F3/04886 ,  G06F3/16 ,  G10L25/78

CPC classification number: G10L15/22 ,  G06F3/04886 ,  G06F3/167 ,  G10L25/78 ,  G10L2015/223 ,  G10L2015/228

Abstract: Implementations set forth relate to suggesting an alternate interface modality when an automated assistant and/or a user is expected to not understand a particular interaction between the user and the automated assistant. In some instances, the automated assistant can pre-emptively determine that a forthcoming and/or ongoing interaction between a user and an automated assistant may experience interference. Based on this determination, the automated assistant can provide an indication that the interaction may not be successful and/or that the user should interact with the automated assistant through a different modality. For example, the automated assistant can render a keyboard interface at a portable computing device when the automated assistant determines that an audio interface of the portable computing device is experiencing interference.

公开(公告)号：US12038299B2

公开(公告)日：2024-07-16

申请号：US17273672

申请日：2020-10-22

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G01C21/36 ,  G10L15/05 ,  G10L15/22

CPC classification number: G01C21/3629 ,  G01C21/3655 ,  G10L15/05 ,  G10L15/22

Abstract: To provide content-aware audio navigation instructions, a client device executing a mapping application obtains one or more audio navigation directions for traversing from a starting location to a destination location along a route. The client device also identifies electronic media content playing from a source different from the mapping application which is executing at the client device or in proximity to the client device. The client device determines characteristics of the electronic media content and adjusts the audio navigation directions in accordance with the characteristics of the electronic media content. Then the client device presents the adjusted audio navigation directions to a user.

公开(公告)号：US12026593B2

公开(公告)日：2024-07-02

申请号：US17071330

申请日：2020-10-15

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Daniel Ramage ,  David Petrou

IPC: G06N20/00 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/04895 ,  G06F9/451 ,  G06F16/245 ,  G06F16/332 ,  G06N5/02

CPC classification number: G06N20/00 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/04895 ,  G06F9/453 ,  G06F16/245 ,  G06F16/3322 ,  G06N5/02

Abstract: Systems and methods are provided for suggesting actions for selected text based on content displayed on a mobile device. An example method can include converting a selection made via a display device into a query, providing the query to an action suggestion model that is trained to predict an action given a query, each action being associated with a mobile application, receiving one or more predicted actions, and initiating display of the one or more predicted actions on the display device. Another example method can include identifying, from search records, queries where a website is highly ranked, the website being one of a plurality of websites in a mapping of websites to mobile applications. The method can also include generating positive training examples for an action suggestion model from the identified queries, and training the action suggestion model using the positive training examples.

公开(公告)号：US20240210197A1

公开(公告)日：2024-06-27

申请号：US17919967

申请日：2022-05-31

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi

IPC: G01C21/36

CPC classification number: G01C21/3641

Abstract: A computing device may implement a method for creating and providing reminders during navigation sessions. The method may include initiating a navigation session for providing a set of navigation instructions to a user from a starting location to a destination location along a route, and receiving, from a user during the navigation session, an input including a request to create a reminder. The method may further include analyzing the input to determine: (i) a content of the reminder, and (ii) a trigger condition for providing the reminder, the trigger condition including a trigger location on the route, and storing the reminder, including the content and the trigger condition. The method may also include, detecting, during a subsequent navigation session, the trigger condition, and, in response to detecting the trigger condition, providing the reminder.

公开(公告)号：US20240203413A1

公开(公告)日：2024-06-20

申请号：US18083429

申请日：2022-12-16

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L15/22 ,  G10L15/30

CPC classification number: G10L15/22 ,  G10L15/30 ,  G10L2015/223

Abstract: Implementations related to selecting a primary automated assistant for a given automated assistant device that is connected to one or more other automated assistant devices in an ecosystem of connected devices. An affinity score is generated for each of a plurality of candidate automated assistants that are capable of executing on the automated assistant device. The affinity score of a given automated assistant for an automated assistant device is indicative of suitability of the automated assistant for the automated assistant device. One of the candidate automated assistants is selected as the primary automated assistant for the device. The primary automated assistant is prioritized when resources of the automated assistant device are allocated to automated assistants executing on the automated assistant device.

公开(公告)号：US20240185849A1

公开(公告)日：2024-06-06

申请号：US18075214

申请日：2022-12-05

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F3/01 ,  G06T19/00

CPC classification number: G10L15/22 ,  G06F3/011 ,  G06T19/006 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can be accessible via a virtual environment for controlling features of the virtual environment and/or devices in a physical environment of the user. When the automated assistant is invoked, the automated assistant can materialize in the virtual environment according to any request that the automated assistant has been invoked to fulfill. For example, depending on the request from the user, the automated assistant can cause rendering of a virtual object for fulfilling the request and/or controlling an ongoing operation of the automated assistant. When the virtual object is rendered to control an operation of the automated assistant, or another application, the virtual object can include a virtual feature that the user can interact with to control the virtual environment and/or devices in a physical environment of the user.

公开(公告)号：US20240185848A1

公开(公告)日：2024-06-06

申请号：US18075155

申请日：2022-12-05

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22

CPC classification number: G10L15/22 ,  G10L2015/223 ,  G10L2015/225 ,  G10L2015/228

Abstract: Systems and methods for creating a group automated assistant session and processing requests that are intended for the users that are included in the group. A plurality of users can indicate intentions to create a group session that includes selecting an automated assistant, from the automated assistants executing on the devices of the user and providing the selected automated assistant with audio data that is captured by microphones of the user devices. In response, the selected automated assistant processes the audio data and generates a response that is provided, via one or more speakers of the device that is executing the selected automated assistant. Further, fulfillment data is provided to the automated assistants executing on other devices and, in response to being provided the fulfillment data, each automated assistant causes audio data to be rendered, via one or more speakers of each respective device, that is responsive to the request.