公开(公告)号：US20240257817A1

公开(公告)日：2024-08-01

申请号：US18104748

申请日：2023-02-01

Applicant: GOOGLE LLC

Inventor： Marcin Nowak-Przygodzki ,  Andrei Giurgiu ,  Mugurel-Ionut Andreica ,  Joseph Lange

IPC: G10L17/22 ,  G06F3/16

CPC classification number: G10L17/22 ,  G06F3/167

Abstract: Techniques are described herein for delegation of request fulfillment, by an assistant, to other devices. A method includes: receiving, by a first device, a request from a first user; identifying, based on the request from the first user, (i) an action corresponding to the request and (ii) a first parameter corresponding to the action; determining that fulfillment of the action is to be delegated to a device other than the first device; in response: selecting, as the device other than the first device, a second device on which an application corresponding to the action is installed; identifying, by the first device, based on the first parameter and information associated with an account of the first user, a first disambiguated parameter corresponding to the action; and sending, to the second device, a command that specifies the action and the first disambiguated parameter, to cause the second device to fulfill the action.

公开(公告)号：US20230169134A1

公开(公告)日：2023-06-01

申请号：US18102037

申请日：2023-01-26

Applicant: GOOGLE LLC

Inventor： Mugurel-Ionut Andreica ,  Jonathan Small ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/955 ,  G06F16/957 ,  G06F16/958 ,  G06F40/169

CPC classification number: G06F16/9562 ,  G06F16/9574 ,  G06F16/972 ,  G06F40/169

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a first input associated with a bookmark and, in response to receiving the first input, obtaining context data for deriving annotations for the bookmark. An annotation engine of a system obtains multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark. The annotation engine generates an importance value for each annotation. The importance value characterizes a relationship between each annotation and at least one of: the information included in the context data; or the transcription of the first input. The annotation engine generates a set of annotations for retrieving the bookmark. Each annotation in the set of annotations is generated from the obtained multiple annotations and each annotation has an importance value that exceeds a threshold value.

公开(公告)号：US20240232272A1

公开(公告)日：2024-07-11

申请号：US18612174

申请日：2024-03-21

Applicant: GOOGLE LLC

Inventor： Gökhan Bakir ,  Andre Elisseeff ,  Torsten Marek ,  João Paulo Pagaime da Silva ,  Mathias Carlen ,  Dana Ritter ,  Lukasz Suder ,  Ernest Galbrun ,  Matthew Stokes ,  Marcin Nowak-Przygodzki ,  Mugurel-Ionut Andreica ,  Marius Dumitran

IPC: G06F16/9535 ,  G06F16/9032

CPC classification number: G06F16/9535 ,  G06F16/90332

Abstract: Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to abstract, validate, maintain, generalize, extend and/or distribute individual actions and “traces” of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party website without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

公开(公告)号：US11971936B2

公开(公告)日：2024-04-30

申请号：US17974086

申请日：2022-10-26

Applicant: GOOGLE LLC

Inventor： Gökhan Bakir ,  Andre Elisseeff ,  Torsten Marek ,  João Paulo Pagaime da Silva ,  Mathias Carlen ,  Dana Ritter ,  Lukasz Suder ,  Ernest Galbrun ,  Matthew Stokes ,  Marcin Nowak-Przygodzki ,  Mugurel-Ionut Andreica ,  Marius Dumitran

IPC: G06F16/00 ,  G06F16/9032 ,  G06F16/9535

CPC classification number: G06F16/9535 ,  G06F16/90332

Abstract: Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to extract, validate, maintain, generalize, extend and/or distribute individual actions and “traces” of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party website without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

公开(公告)号：US11487832B2

公开(公告)日：2022-11-01

申请号：US16619777

申请日：2019-05-09

Applicant: Google LLC

Inventor： Gökhan Bakir ,  Andre Elisseeff ,  Torsten Marek ,  João Paulo Pagaime da Silva ,  Mathias Carlen ,  Dana Ritter ,  Lukasz Suder ,  Ernest Galbrun ,  Matthew Stokes ,  Marcin Nowak-Przygodzki ,  Mugurel-Ionut Andreica ,  Marius Dumitran

IPC: G06F16/00 ,  G06F16/9535 ,  G06F16/9032

Abstract: Implementations are described herein for analyzing existing interactive web sites to facilitate automatic engagement with those web sites, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those websites. For example, in various implementations, techniques described herein may be used to abstract, validate, maintain, generalize, extend and/or distribute individual actions and “traces” of actions that are useable to navigate through various interactive websites. Additionally, techniques are described herein for leveraging these actions and/or traces to automate aspects of interaction with a third party website. For example, in some implementations, techniques described herein may enable users to engage with an automated assistant (via a spoken or typed dialog session) to interact with the third party web site without requiring the user to visually interact with the third party web site directly and without requiring the third party to implement their own third party agent.

公开(公告)号：US20250045082A1

公开(公告)日：2025-02-06

申请号：US18793675

申请日：2024-08-02

Applicant: GOOGLE LLC

Inventor： Cliff Kuang ,  Adam Coimbra ,  Bogdan Prisacari ,  Felix Weissenberger ,  Eric Stavarache ,  Mugurel-Ionut Andreica ,  Jonathan Splitlog ,  Caleb Misclevitz

IPC: G06F9/451 ,  G06F3/0484 ,  G06V40/20

Abstract: Implementations relate to determining a general routine when an automated assistant is not configured to fulfill a user request. When the user submits a request to an automated assistant to perform a routine and the automated assistant is not configured to fulfill the request, the user demonstrates the actions that are included in the routine. The automated assistant generates a routine based on the actions of the user and stores the routine with the request that was initially submitted by the user. In some implementations, a general routine can include one or more parameters and the user provides a value for the parameters with the request. General routines can additionally be generated based on previous routines performed by the user and/or other users.

公开(公告)号：US20250044913A1

公开(公告)日：2025-02-06

申请号：US18230564

申请日：2023-08-04

Applicant: GOOGLE LLC

Inventor： Sneha Ashok ,  Cliff Kuang ,  Mugurel-Ionut Andreica

IPC: G06F3/0482 ,  G06F3/0488 ,  G06F9/451

Abstract: Implementations relate to providing a macro to a user to instruct the user regarding how to perform an action. When a user submits a request to perform an action, an option is provided that indicates a macro is available. Upon selecting the macro, one or more elements are displayed, with a corresponding application displayed in the background. The next element is displayed after a period of time, depending on the user familiarity with the action.

公开(公告)号：US20230377572A1

公开(公告)日：2023-11-23

申请号：US18231112

申请日：2023-08-07

Applicant: GOOGLE LLC

Inventor： Mugurel-Ionut Andreica ,  Vladimir Vuskovic ,  Joseph Lange ,  Sharon Stovezky ,  Marcin Nowak-Przygodzki

IPC: G10L15/22 ,  G06N3/08 ,  G10L15/02

CPC classification number: G10L15/22 ,  G06N3/08 ,  G10L15/02 ,  G10L2015/223

Abstract: Implementations are set forth herein for creating an order of execution for actions that were requested by a user, via a spoken utterance to an automated assistant. The order of execution for the requested actions can be based on how each requested action can, or is predicted to, affect other requested actions. In some implementations, an order of execution for a series of actions can be determined based on an output of a machine learning model, such as a model that has been trained according to supervised learning. A particular order of execution can be selected to mitigate waste of processing, memory, and network resources—at least relative to other possible orders of execution. Using interaction data that characterizes past performances of automated assistants, certain orders of execution can be adapted over time, thereby allowing the automated assistant to learn from past interactions with one or more users.

公开(公告)号：US12287827B2

公开(公告)日：2025-04-29

申请号：US18230457

申请日：2023-08-04

Applicant: GOOGLE LLC

Inventor： Diana Avram ,  Mugurel-Ionut Andreica ,  Alice Liang ,  Andrea D'olimpio ,  Cliff Kuang ,  Andre Elisseeff ,  Dana Ritter ,  Florian Hasler ,  Radu Voroneanu

IPC: G06F16/638 ,  G06F16/635 ,  H04L67/50

Abstract: Implementations relate to identifying actions performed by a user while the user is interacting with multiple applications and providing a routine suggestion to the user based on the identified actions. While a user is interacting with one or more applications, the user actions are determined. The user actions are compared to one or more template routines and a template routine is selected that matches the actions of the user and provided to the user as a suggested routine. The suggested routine can be implemented by an automated assistant to perform the actions of the template by providing a corresponding command.

公开(公告)号：US12271742B2

公开(公告)日：2025-04-08

申请号：US18230561

申请日：2023-08-04

Applicant: GOOGLE LLC

Inventor： Cliff Kuang ,  Diana Avram ,  Mugurel-Ionut Andreica ,  Radu Voroneanu ,  Sneha Ashok ,  Deepak Goyal ,  Kyunghoon Lee ,  Alice Liang ,  Dana Ritter ,  Adam Coimbra ,  Anton Berezin ,  Andre Elisseeff

IPC: G06F9/451 ,  G06F3/0482 ,  G06F3/0484

Abstract: Implementations relate to determining a rendering type for an application that is executing automatically. Based on user interactions with an application that is associated with specified input from the user while the user is interacting with the application, a confidence metric is generated for each specified input and a rendering type is determined based on the confidence metrics. Subsequently, when the user requests that a sequence of actions be performed, the application will be displayed according to the rendering type.