Invention Grant
- Patent Title: Condensed spoken utterances for automated assistant control of an intricate application GUI
-
Application No.: US16972987Application Date: 2019-08-12
-
Publication No.: US11449308B2Publication Date: 2022-09-20
- Inventor: Jacek Szmigiel , Joseph Lange
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Middleton Reutlinger
- International Application: PCT/US2019/046145 WO 20190812
- International Announcement: WO2021/015801 WO 20210128
- Main IPC: G06F3/16
- IPC: G06F3/16 ; G06F3/0482 ; G06F3/04847 ; G06F3/04883 ; G10L15/22

Abstract:
Implementations set forth herein relate to an automated assistant that can control graphical user interface (GUI) elements via voice input using natural language understanding of GUI content in order to resolve ambiguity and allow for condensed GUI voice input requests. When a user is accessing an application that is rendering various GUI elements at a display interface, the automated assistant can operate to process actionable data corresponding to the GUI elements. The actionable data can be processed in order to determine a correspondence between GUI voice input requests to the automated assistant and at least one of the GUI elements rendered at the display interface. When a particular spoken utterance from the user is determined to correspond to multiple GUI elements, an indication of ambiguity can be rendered at the display interface in order to encourage the user to provide a more specific spoken utterance.
Public/Granted literature
- US20210182018A1 CONDENSED SPOKEN UTTERANCES FOR AUTOMATED ASSISTANT CONTROL OF AN INTRICATE APPLICATION GUI Public/Granted day:2021-06-17
Information query