公开(公告)号：US20230012852A1

公开(公告)日：2023-01-19

申请号：US17947359

申请日：2022-09-19

Applicant: GOOGLE LLC

Inventor： Jacek Szmigiel ,  Joseph Lange

IPC: G06F3/16 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22

Abstract: Implementations set forth herein relate to an automated assistant that can control graphical user interface (GUI) elements via voice input using natural language understanding of GUI content in order to resolve ambiguity and allow for condensed GUI voice input requests. When a user is accessing an application that is rendering various GUI elements at a display interface, the automated assistant can operate to process actionable data corresponding to the GUI elements. The actionable data can be processed in order to determine a correspondence between GUI voice input requests to the automated assistant and at least one of the GUI elements rendered at the display interface. When a particular spoken utterance from the user is determined to correspond to multiple GUI elements, an indication of ambiguity can be rendered at the display interface in order to encourage the user to provide a more specific spoken utterance.

公开(公告)号：US11449308B2

公开(公告)日：2022-09-20

申请号：US16972987

申请日：2019-08-12

Applicant: Google LLC

Inventor： Jacek Szmigiel ,  Joseph Lange

IPC: G06F3/16 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22

Abstract: Implementations set forth herein relate to an automated assistant that can control graphical user interface (GUI) elements via voice input using natural language understanding of GUI content in order to resolve ambiguity and allow for condensed GUI voice input requests. When a user is accessing an application that is rendering various GUI elements at a display interface, the automated assistant can operate to process actionable data corresponding to the GUI elements. The actionable data can be processed in order to determine a correspondence between GUI voice input requests to the automated assistant and at least one of the GUI elements rendered at the display interface. When a particular spoken utterance from the user is determined to correspond to multiple GUI elements, an indication of ambiguity can be rendered at the display interface in order to encourage the user to provide a more specific spoken utterance.

公开(公告)号：US20200342018A1

公开(公告)日：2020-10-29

申请号：US16617360

申请日：2018-05-07

Applicant: Google LLC

Inventor： Joseph Lange ,  Mugurel Ionut Andreica ,  Marcin Nowak-Przygodzki

IPC: G06F16/33 ,  G10L15/22 ,  G06F16/215 ,  G06F16/332 ,  G06F16/338

Abstract: Implementations are directed to determining, based on a submitted query that is a compound query, that a set of multiple sub-queries are collectively an appropriate interpretation of the compound query. Those implementations are further directed to providing, in response to such a determination, a corresponding command for each of the sub-queries of the determined set. Each of the commands is to a corresponding agent (of one or more agents), and causes the agent to generate and provide corresponding responsive content. Those implementations are further directed to causing content to be rendered in response to the submitted query, where the content is based on the corresponding responsive content received in response to the commands.

公开(公告)号：US20190095523A1

公开(公告)日：2019-03-28

申请号：US16135205

申请日：2018-09-19

Applicant: Google LLC

Inventor： Vladimir Vuskovic ,  Joseph Lange ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki

IPC: G06F17/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating subqueries from a query. In one aspect, a method includes obtaining a query, generating a set of two subqueries from the query, where the set includes a first subquery and a second subquery, determining a quality score for the set of two subqueries, determining whether the quality score for the set of two subqueries satisfies a quality threshold, and in response to determining that the quality score for the set of two subqueries satisfies the quality threshold, providing a first response to the first subquery that is responsive to a first operation that receives the first subquery as input and providing a second response to the second subquery that is responsive to a second operation that receives the second subquery as input.

公开(公告)号：US12229173B2

公开(公告)日：2025-02-18

申请号：US17116296

申请日：2020-12-09

Applicant: Google LLC

Inventor： Vladimir Vuskovic ,  Joseph Lange ,  Behshad Behzadi ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/332

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating subqueries from a query. In one aspect, a method includes obtaining a query, generating a set of two subqueries from the query, where the set includes a first subquery and a second subquery, determining a quality score for the set of two subqueries, determining whether the quality score for the set of two subqueries satisfies a quality threshold, and in response to determining that the quality score for the set of two subqueries satisfies the quality threshold, providing a first response to the first subquery that is responsive to a first operation that receives the first subquery as input and providing a second response to the second subquery that is responsive to a second operation that receives the second subquery as input.

公开(公告)号：US20240281205A1

公开(公告)日：2024-08-22

申请号：US18650938

申请日：2024-04-30

Applicant: GOOGLE LLC

Inventor： Jacek Szmigiel ,  Joseph Lange

IPC: G06F3/16 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can control graphical user interface (GUI) elements via voice input using natural language understanding of GUI content in order to resolve ambiguity and allow for condensed GUI voice input requests. When a user is accessing an application that is rendering various GUI elements at a display interface, the automated assistant can operate to process actionable data corresponding to the GUI elements. The actionable data can be processed in order to determine a correspondence between GUI voice input requests to the automated assistant and at least one of the GUI elements rendered at the display interface. When a particular spoken utterance from the user is determined to correspond to multiple GUI elements, an indication of ambiguity can be rendered at the display interface in order to encourage the user to provide a more specific spoken utterance.

公开(公告)号：US12067040B2

公开(公告)日：2024-08-20

申请号：US18103291

申请日：2023-01-30

Applicant: Google LLC

Inventor： Joseph Lange ,  Mugurel Ionut Andreica ,  Marcin Nowak-Przygodzki

IPC: G06F16/33 ,  G06F16/215 ,  G06F16/332 ,  G06F16/338 ,  G10L15/22 ,  G10L15/26

CPC classification number: G06F16/3344 ,  G06F16/215 ,  G06F16/3329 ,  G06F16/338 ,  G10L15/22 ,  G10L15/26

Abstract: Implementations are directed to determining, based on a submitted query that is a compound query, that a set of multiple sub-queries are collectively an appropriate interpretation of the compound query. Those implementations are further directed to providing, in response to such a determination, a corresponding command for each of the sub-queries of the determined set. Each of the commands is to a corresponding agent (of one or more agents), and causes the agent to generate and provide corresponding responsive content. Those implementations are further directed to causing content to be rendered in response to the submitted query, where the content is based on the corresponding responsive content received in response to the commands.

公开(公告)号：US20240193372A1

公开(公告)日：2024-06-13

申请号：US18064230

申请日：2022-12-09

Applicant: Google LLC

Inventor： Joseph Lange ,  Henry Scott Dlhopolsky ,  Vladimir Vuskovic

IPC: G06F40/35 ,  G06N20/00 ,  G06Q30/02

CPC classification number: G06F40/35 ,  G06N20/00 ,  G06Q30/0281

Abstract: A method for dynamically generating training data for a model includes receiving a transcript corresponding to a conversation between a customer and an agent, the transcript comprising a customer input and an agent input. The method includes receiving a logic model including a plurality of responses, each response of the plurality of responses representing a potential reply to the customer input. The method further includes selecting, based on the agent input, a response from the plurality of responses of the logic model. The method includes determining that a similarity score between the selected response and the agent input satisfies a similarity threshold, and, based on determining that the similarity score between the selected response and the agent input satisfies the similarity threshold, training a machine learning model using the customer input and the selected response.

公开(公告)号：US11995379B2

公开(公告)日：2024-05-28

申请号：US17947359

申请日：2022-09-19

Applicant: GOOGLE LLC

Inventor： Jacek Szmigiel ,  Joseph Lange

IPC: G06F3/16 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22

CPC classification number: G06F3/167 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22 ,  G10L2015/223

Abstract: Implementations set forth herein relate to an automated assistant that can control graphical user interface (GUI) elements via voice input using natural language understanding of GUI content in order to resolve ambiguity and allow for condensed GUI voice input requests. When a user is accessing an application that is rendering various GUI elements at a display interface, the automated assistant can operate to process actionable data corresponding to the GUI elements. The actionable data can be processed in order to determine a correspondence between GUI voice input requests to the automated assistant and at least one of the GUI elements rendered at the display interface. When a particular spoken utterance from the user is determined to correspond to multiple GUI elements, an indication of ambiguity can be rendered at the display interface in order to encourage the user to provide a more specific spoken utterance.

公开(公告)号：US11830487B2

公开(公告)日：2023-11-28

申请号：US17235104

申请日：2021-04-20

Applicant: GOOGLE LLC

Inventor： Joseph Lange ,  Marcin Nowak-Przygodzki

IPC: G10L15/00 ,  G10L15/22

CPC classification number: G10L15/22

Abstract: Implementations set forth herein relate to an automated assistant that can operate as an interface between a user and a separate application to search application content of the separate application. The automated assistant can interact with existing search filter features of another application and can also adapt in circumstances when certain filter parameters are not directly controllable at a search interface of the application. For instance, when a user requests that a search operation be performed using certain terms, those terms may refer to content filters that may not be available at a search interface of the application. However, the automated assistant can generate an assistant input based on those content filters in order to ensure that any resulting search results will be filtered accordingly. The assistant input can then be submitted into a search field of the application and a search operation can be executed.