公开(公告)号：US11537931B2

公开(公告)日：2022-12-27

申请号：US15825551

申请日：2017-11-29

Applicant: Google LLC

Inventor： Sandro Feuz ,  Victor Carbune

IPC: G06N20/00

Abstract: The present disclosure provides an on-device machine learning platform that enables sharing of machine-learned models between applications on a computing device. For example, a first application which has a machine-learned model for a specific task can expose the model to other applications through a system level application programming interface (API) for the other applications to use. Communications using the API can be handled by the on-device machine learning platform. In some implementations, some exchange of resources (e.g., computing resources) can be provided so that the first application is compensated for sharing the machine-learned model (e.g., on a per model invocation basis).

公开(公告)号：US11521618B2

公开(公告)日：2022-12-06

申请号：US16716654

申请日：2019-12-17

Applicant: Google LLC

Inventor： Victor Carbune ,  Pedro Gonnet Anders ,  Thomas Deselaers ,  Sandro Feuz

IPC: G10L15/30 ,  G10L15/22 ,  G10L13/08 ,  G10L15/08 ,  H04W4/80 ,  G10L13/033

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for collaboration between multiple voice controlled devices are disclosed. In one aspect, a method includes the actions of identifying, by a first computing device, a second computing device that is configured to respond to a particular, predefined hotword; receiving audio data that corresponds to an utterance; receiving a transcription of additional audio data outputted by the second computing device in response to the utterance; based on the transcription of the additional audio data and based on the utterance, generating a transcription that corresponds to a response to the additional audio data; and providing, for output, the transcription that corresponds to the response.

公开(公告)号：US11495217B2

公开(公告)日：2022-11-08

申请号：US16728582

申请日：2019-12-27

Applicant: Google LLC

Inventor： Pedro Gonnet Anders ,  Victor Carbune ,  Daniel Keysers ,  Thomas Deselaers ,  Sandro Feuz

IPC: G10L15/18 ,  G10L15/22 ,  G10L15/19

Abstract: Techniques are described herein for enabling an automated assistant to adjust its behavior depending on a detected age range and/or “vocabulary level” of a user who is engaging with the automated assistant. In various implementations, data indicative of a user's utterance may be used to estimate one or more of the user's age range and/or vocabulary level. The estimated age range/vocabulary level may be used to influence various aspects of a data processing pipeline employed by an automated assistant. In various implementations, aspects of the data processing pipeline that may be influenced by the user's age range/vocabulary level may include one or more of automated assistant invocation, speech-to-text (“STT”) processing, intent matching, intent resolution (or fulfillment), natural language generation, and/or text-to-speech (“TTS”) processing. In some implementations, one or more tolerance thresholds associated with one or more of these aspects, such as grammatical tolerances, vocabularic tolerances, etc., may be adjusted.

公开(公告)号：US20220351227A1

公开(公告)日：2022-11-03

申请号：US17865051

申请日：2022-07-14

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G06Q30/02 ,  G06Q30/06 ,  G10L15/30

Abstract: Group actions may be performed on behalf of multiple users based in part on the suitability of the various user devices of the different users to perform such group actions. Different user devices may also be used to generate different query intent determinations for a query such that the query intent determination made by a particular user device may be used to fulfill the query.

公开(公告)号：US11488597B2

公开(公告)日：2022-11-01

申请号：US16948186

申请日：2020-09-08

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  G06F3/16 ,  G10L13/02 ,  G10L15/06 ,  G10L15/18 ,  G10L25/54

Abstract: Implementations set forth herein relate to an automated assistant that allows a user to create, edit, and/or share documents without directly interfacing with a document editing application. The user can provide an input to the automated assistant in order to cause the automated assistant to interface with the document editing application and create a document. In order to identify a particular action to perform with respect to a document, and/or identify a particular subsection within the document to direct the action, the automated assistant can rely on semantic annotations. As a user continues to interact with the automated assistant to edit a document, the semantic annotations can be updated according to how the document is changing and/or how the user refers to the document. This can allow the automated assistant to more readily fulfill document-related requests that may lack express details.

公开(公告)号：US20220301129A1

公开(公告)日：2022-09-22

申请号：US17273063

申请日：2020-09-02

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06T5/50 ,  G06V10/82 ,  G06V10/764 ,  G06V10/774 ,  G06V10/74 ,  G06T3/00

Abstract: System and methods are provided for generating panoramic imagery. An example method may be performed by one or more processors and includes obtaining first panoramic imagery depicting a geographic area. The method also includes obtaining an image depicting one or more physical objects absent from the first panoramic imagery. Further, the method includes transforming the first panoramic imagery into second panoramic imagery depicting the one or more physical objects and including at least a portion of the first panoramic imagery.

公开(公告)号：US20220299335A1

公开(公告)日：2022-09-22

申请号：US17273672

申请日：2020-10-22

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G01C21/36 ,  G10L15/05 ,  G10L15/22

Abstract: To provide content-aware audio navigation instructions, a client device executing a mapping application obtains one or more audio navigation directions for traversing from a starting location to a destination location along a route. The client device also identifies electronic media content playing from a source different from the mapping application which is executing at the client device or in proximity to the client device. The client device determines characteristics of the electronic media content and adjusts the audio navigation directions in accordance with the characteristics of the electronic media content. Then the client device presents the adjusted audio navigation directions to a user.

公开(公告)号：US11410192B2

公开(公告)日：2022-08-09

申请号：US17004851

申请日：2020-08-27

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G06Q30/02 ,  G06Q30/06 ,  G10L15/30

Abstract: Group actions may be performed on behalf of multiple users based in part on the suitability of the various user devices of the different users to perform such group actions. Different user devices may also be used to generate different query intent determinations for a query such that the query intent determination made by a particular user device may be used to fulfill the query.

公开(公告)号：US20220245182A1

公开(公告)日：2022-08-04

申请号：US17727237

申请日：2022-04-22

Applicant: GOOGLE LLC

Inventor： Victor Carbune ,  Pedro Gonnet Anders

IPC: G06F16/33 ,  G06F16/93 ,  G06F16/332 ,  G06F16/338 ,  G06F40/40 ,  H04L51/02 ,  G06V30/418

Abstract: Techniques are described herein for determining an information gain score for one or more documents of interest to the user and present information from the documents based on the information gain score. An information gain score for a given document is indicative of additional information that is included in the document beyond information contained in documents that were previously viewed by the user. In some implementations, the information gain score may be determined for one or more documents by applying data from the documents across a machine learning model to generate an information gain score. Based on the information gain scores of a set of documents, the documents can be provided to the user in a manner that reflects the likely information gain that can be attained by the user if the user were to view the documents.

公开(公告)号：US20220236857A1

公开(公告)日：2022-07-28

申请号：US17157178

申请日：2021-01-25

Applicant: GOOGLE LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F3/0484 ,  G06F3/0481 ,  G06F3/16 ,  G06F3/01 ,  G10L15/22

Abstract: Implementations set forth herein relate to an automated assistant that can perform operations to revert various applications to prior states that the applications may have arrived at via certain user inputs. The user can provide a spoken utterance such as, “undo,” in order to cause the automated assistant to identify a particular application that the user may want to affect with the “undo” command. When the particular application is identified, the automated assistant can identify one or more operations recently performed using the particular application. In some implementations, the automated assistant can provide the user with a variety of undo options in response to an “undo” command. For instance, the automated assistant can prompt the user to select one of a first cluster of operations and/or a second cluster of operations to be undone, and each cluster can refer to different operations.