公开(公告)号：US11468052B2

公开(公告)日：2022-10-11

申请号：US16912298

申请日：2020-06-25

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F17/00 ,  G06F16/242 ,  G06F16/2457 ,  G06K9/62 ,  G06F16/248 ,  G06F16/23

Abstract: Methods, systems, and computer readable media related to generating a combined search query based on search parameters of a current search query of a user and search parameters of one or more previously submitted search quer(ies) of the user that are determined to be of the same line of inquiry as the current search query. Two or more search queries may be determined to share a line of inquiry when it is determined that they are within a threshold level of semantic similarity to one another. Once a shared line of inquiry has been identified and a combined search query generated, users may interact with the search parameters and/or the search results to update the search parameters of the combined search query.

公开(公告)号：US20220292128A1

公开(公告)日：2022-09-15

申请号：US17200238

申请日：2021-03-12

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G06F16/432 ,  G10L15/22 ,  G06F40/30 ,  G06F3/16

Abstract: Implementations described herein relate to receiving user input directed to an automated assistant, processing the user input to determine whether data from a server and/or third-party application is needed to perform certain fulfillment of an assistant command included in the user input, and generating a prompt that requests a user consent to transmitting of a request to the server and/or the third-party application to obtain the data needed to perform the certain fulfillment. In implementations where the user consents, the data can be obtained and utilized to perform the certain fulfillment. In implementations where the user does not consent, client data can be generated locally at a client device and utilized to perform alternate fulfillment of the assistant command. In various implementations, the request transmitted to the server and/or third-party application can be modified based on ambient noise captured when the user input is received.

公开(公告)号：US20220277773A1

公开(公告)日：2022-09-01

申请号：US17745252

申请日：2022-05-16

Applicant: Google LLC

Inventor： Yossi Matias ,  Matthew Sharifi ,  Thomas Bugnon ,  Dominik Roblek ,  Annie Chen

IPC: G11B27/031 ,  G11B27/034 ,  G11B27/10 ,  G11B27/28 ,  G06V20/40 ,  G06F16/44 ,  G11B27/30 ,  H04N5/232

Abstract: Systems and methods for media aggregation are disclosed herein. The system includes a media system that can transform media items into one aggregated media item. A synchronization component synchronizes media items with respect to time. The synchronized media items can be analyzed and transformed into an aggregated media item for storage and/or display. In one implementation, the aggregated media item is capable of being displayed in multiple ways to create an enhanced and customizable viewing and/or listening experience.

公开(公告)号：US11423885B2

公开(公告)日：2022-08-23

申请号：US16349871

申请日：2019-02-20

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Tom Hume ,  Mohamad Hassan Mohamad Rom ,  Jan Althaus ,  Diego Melendo Casado

IPC: G10L15/18 ,  G10L15/22 ,  G10L15/08

Abstract: Techniques are described herein for selectively processing a user's utterances captured prior to and after an event that invokes an automated assistant to determine the user's intent and/or any parameters required for resolving the user's intent. In various implementations, respective measures of fitness for triggering responsive action by the automated assistant may be determined for pre-event and a post-event input streams. Based on the respective measures of fitness, one or both of the pre-event input stream or post-event input stream may be selected and used to cause the automated assistant to perform one or more responsive actions.

公开(公告)号：US20220189466A1

公开(公告)日：2022-06-16

申请号：US17120033

申请日：2020-12-11

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Aleksandar Kracun

IPC: G10L15/16 ,  G10L25/90

Abstract: A method for optimizing speech recognition includes receiving a first acoustic segment characterizing a hotword detected by a hotword detector in streaming audio captured by a user device, extracting one or more hotword attributes from the first acoustic segment, and adjusting, based on the one or more hotword attributes extracted from the first acoustic segment, one or more speech recognition parameters of an automated speech recognition (ASR) model. After adjusting the speech recognition parameters of the ASR model, the method also includes processing, using the ASR model, a second acoustic segment to generate a speech recognition result. The second acoustic segment characterizes a spoken query/command that follows the first acoustic segment in the streaming audio captured by the user device.

公开(公告)号：US20220172715A1

公开(公告)日：2022-06-02

申请号：US17110046

申请日：2020-12-02

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/22 ,  H04L12/58 ,  G10L15/18

Abstract: Implementations relate to an automated assistant that can respond to communications received via a third party application and/or other third party communication modality. The automated assistant can determine that the user is participating in multiple different conversations via multiple different third party communication services. In some implementations, conversations can be processed to identify particular features of the conversations. When the automated assistant is invoked to provide input to a conversation, the automated assistant can compare the input to the identified conversation features in order to select the particular conversation that is most relevant to the input. In this way, the automated assistant can assist with any of multiple disparate conversations that are each occurring via a different third party application.

公开(公告)号：US11347385B1

公开(公告)日：2022-05-31

申请号：US17192248

申请日：2021-03-04

Applicant: Google LLC

Inventor： Matthew Sharifi ,  David Petrou

IPC: G06F3/04842 ,  H04L67/06

Abstract: Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.

公开(公告)号：US20220167049A1

公开(公告)日：2022-05-26

申请号：US17103908

申请日：2020-11-24

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: H04N21/458 ,  H04N21/442 ,  H04N21/439 ,  H04N21/45 ,  H04N21/466 ,  H04N21/472

Abstract: While an assistant-enabled device is playing back media content, a method includes receiving a contextual signal from an environment of the assistant-enabled device and executing an event recognition routine to determine whether the received contextual signal is indicative of an event that conflicts with the playback of the media content from the assistant-enabled device. When the event recognition routine determines that the received contextual signal is indicative of the event that conflicts with the playback of the media content, the method also includes adjusting content playback settings of the assistant-enabled device.

公开(公告)号：US20220157321A1

公开(公告)日：2022-05-19

申请号：US16952830

申请日：2020-11-19

Applicant: Google LLC

Inventor： Matthew Sharifi ,  Victor Carbune

IPC: G10L17/06

Abstract: Implementations are directed to biasing speaker authentication on a per-user basis and on a device-by-device basis and/or contextual feature(s) basis. In some of those implementations, in performing speaker authentication based on a spoken utterance, different biasing parameters are determined for each of multiple different registered users of an assistant device at which the spoken utterance was detected. In those implementations, each of the biasing parameters can be used to make it more likely or less likely (in dependence of the biasing parameter) that a corresponding registered user will be verified using the speaker authentication. Through utilization of biasing parameter(s) in performing speaker authentication, accuracy and/or robustness of speaker authentication can be increased.

公开(公告)号：US20220122610A1

公开(公告)日：2022-04-21

申请号：US17087358

申请日：2020-11-02

Applicant: Google LLC

Inventor： Victor Carbune ,  Matthew Sharifi

IPC: G10L15/32 ,  G10L15/22

Abstract: Techniques are described herein for detecting and handling failures in other automated assistants. A method includes: executing a first automated assistant in an inactive state at least in part on a computing device operated by a user; while in the inactive state, determining, by the first automated assistant, that a second automated assistant failed to fulfill a request of the user; in response to determining that the second automated assistant failed to fulfill the request of the user, the first automated assistant processing cached audio data that captures a spoken utterance of the user comprising the request that the second automated assistant failed to fulfill, or features of the cached audio data, to determine a response that fulfills the request of the user; and providing, by the first automated assistant to the user, the response that fulfills the request of the user.