公开(公告)号：US12243533B2

公开(公告)日：2025-03-04

申请号：US18623853

申请日：2024-04-01

Applicant: GOOGLE LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G06F3/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  H04L67/01 ,  H04L67/568 ,  H04N23/60

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US12073835B2

公开(公告)日：2024-08-27

申请号：US18241745

申请日：2023-09-01

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L2015/223 ,  G10L2015/227

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US11996102B2

公开(公告)日：2024-05-28

申请号：US18202236

申请日：2023-05-25

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey Nazarov ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve Cheng ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

CPC classification number: G10L15/22 ,  G10L15/083

Abstract: Implementations relate to receiving natural language input that requests an automated assistant to provide information and processing the natural language input to identify the requested information and to identify one or more predicted actions. Those implementations further cause a computing device, at which the natural language input is received, to render the requested information and the one or more predicted actions in response to the natural language input. Yet further, those implementations, in response to the user confirming a rendered predicted action, cause the automated assistant to initialize the predicted action.

公开(公告)号：US11631412B2

公开(公告)日：2023-04-18

申请号：US17521131

申请日：2021-11-08

Applicant: Google LLC

Inventor： Daniel Cotting ,  Zaheed Sabur ,  Lan Huo ,  Bryan Christopher Horling ,  Behshad Behzadi ,  Lucas Mirelmann ,  Michael Golikov ,  Denis Burakov ,  Steve Cheng ,  Bohdan Vlasyuk ,  Sergey Nazarov ,  Mario Bertschler ,  Luv Kothari

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/30 ,  H04L29/08 ,  H04L29/06 ,  H04L67/568 ,  H04L67/01

Abstract: Implementations can reduce the time required to obtain responses from an automated assistant through proactive caching, locally at a client device, of proactive assistant cache entries—and through on-device utilization of the proactive assistant cache entries. Different proactive cache entries can be provided to different client devices, and various implementations relate to technique(s) utilized in determining which proactive cache entries to provide to which client devices. In some of those implementations, in determining which proactive cache entries to provide (proactively or in response to a request) to a given client device, a remote system selects, from a superset of candidate proactive cache entries, a subset of the cache entries for providing to the given client device.

公开(公告)号：US20220130385A1

公开(公告)日：2022-04-28

申请号：US17569811

申请日：2022-01-06

Applicant: GOOGLE LLC

Inventor： Lucas Mirelmann ,  Zaheed Sabur ,  Bohdan Vlasyuk ,  Marie Patriarche Bledowski ,  Sergey NAZAROV ,  Denis Burakov ,  Behshad Behzadi ,  Michael Golikov ,  Steve CHENG ,  Daniel Cotting ,  Mario Bertschler

IPC: G10L15/22 ,  G10L15/08

Abstract: Implementations herein relate to pre-caching data, corresponding to predicted interactions between a user and an automated assistant, using data characterizing previous interactions between the user and the automated assistant. An interaction can be predicted based on details of a current interaction between the user and an automated assistant. One or more predicted interactions can be initialized, and/or any corresponding data pre-cached, prior to the user commanding the automated assistant in furtherance of the predicted interaction. Interaction predictions can be generated using a user-parameterized machine learning model, which can be used when processing input(s) that characterize a recent user interaction with the automated assistant. Should the user command the automated assistant in a way that is aligned with a pre-cached, predicted interaction, the automated assistant will exhibit instant fulfillment of the command, thereby eliminating any latency that the user would have otherwise experienced interacting with the automated assistant.

公开(公告)号：US20200021740A1

公开(公告)日：2020-01-16

申请号：US16585085

申请日：2019-09-27

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Gökhan Bakir ,  Daniel Kunkle ,  Kavin Karthik Ilangovan ,  Denis Burakov

IPC: H04N5/232 ,  G06K9/32 ,  G06K9/00 ,  G06F16/583 ,  H04N9/82 ,  H04N5/77 ,  G06F16/58 ,  H04N1/00 ,  H04N1/32 ,  H04N1/21

Abstract: The present disclosure relates to user-selected metadata related to images captured by a camera of a client device. User-selected metadata may include contextual information and/or information provided by a user when the images are captured. In various implementations, a free form input may be received at a first client device of one or more client devices operated by a user. A task request may be recognized from the free form input, and it may be determined that the task request includes a request to store metadata related to one or more images captured by a camera of the first client device. The metadata may be selected based on content of the task request. The metadata may then be stored, e.g., in association with one or more images captured by the camera, in computer-readable media. The computer-readable media may be searchable by the metadata.

公开(公告)号：US12028302B2

公开(公告)日：2024-07-02

申请号：US18215221

申请日：2023-06-28

Applicant: Google LLC

Inventor： Fredrik Bergenlid ,  Vladyslav Lysychkin ,  Denis Burakov ,  Behshad Behzadi ,  Andrea Terwisscha Van Scheltinga ,  Quentin Lascombes De Laroussilhe ,  Mikhail Golikov ,  Koa Metter ,  Ibrahim Badr ,  Zaheed Sabur

IPC: H04L51/10 ,  G06F16/44 ,  G10L15/22 ,  H04N7/15 ,  H04N21/439 ,  H04N21/4788 ,  G10L15/00 ,  G10L15/16 ,  G10L25/63

CPC classification number: H04L51/10 ,  G06F16/44 ,  G10L15/22 ,  H04N7/15 ,  H04N21/4394 ,  H04N21/4788 ,  G10L15/005 ,  G10L15/16 ,  G10L2015/223 ,  G10L25/63

Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.

公开(公告)号：US11972307B2

公开(公告)日：2024-04-30

申请号：US17049696

申请日：2019-08-06

Applicant: GOOGLE LLC

Inventor： Bohdan Vlasyuk ,  Behshad Behzadi ,  Mario Bertschler ,  Denis Burakov ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Sergey Nazarov ,  Zaheed Sabur ,  Jonathan Lee ,  Lucia Terrenghi ,  Adrian Zumbrunnen

IPC: G06F9/54 ,  G06F3/16 ,  G06F40/166 ,  G06F40/35 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F9/547 ,  G06F3/167 ,  G06F40/166 ,  G06F40/35 ,  G10L15/22 ,  G10L15/26 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.

公开(公告)号：US20230410804A1

公开(公告)日：2023-12-21

申请号：US18241745

申请日：2023-09-01

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L2015/223 ,  G10L2015/227

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.

公开(公告)号：US11749280B2

公开(公告)日：2023-09-05

申请号：US18086263

申请日：2022-12-21

Applicant: GOOGLE LLC

Inventor： Denis Burakov ,  Sergey Nazarov ,  Behshad Behzadi ,  Mario Bertschler ,  Bohdan Vlasyuk ,  Daniel Cotting ,  Michael Golikov ,  Lucas Mirelmann ,  Steve Cheng ,  Zaheed Sabur ,  Okan Kolak ,  Yan Zhong ,  Vinh Quoc Ly

IPC: G10L15/22 ,  G06F3/16

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L2015/223 ,  G10L2015/227

Abstract: Implementations set forth herein allow a user to access a first application in a foreground of a graphical interface, and simultaneously employ an automated assistant to respond to notifications arising from a second application. The user can provide an input, such as a spoken utterance, while viewing the first application in the foreground in order to respond to notifications from the second application without performing certain intervening steps that can arise under certain circumstances. Such intervening steps can include providing a user confirmation, which can be bypassed, and/or time-limited according to a timer, which can be displayed in response to the user providing a responsive input directed at the notification. A period for the timer can be set according to one or more characteristics that are associated with the notification, the user, and/or any other information that can be associated with the user receiving the notification.