公开(公告)号：US20230274737A1

公开(公告)日：2023-08-31

申请号：US18013083

申请日：2022-05-31

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Ilya Firman ,  Adam Miller Coimbra ,  Robert James Berry ,  Mugurel Ionut Andreica ,  Mikhail Reutov ,  Gabriel Oak Taubman ,  Cliff Shan Kuang ,  Michael Oh ,  Svetoslav Radoslavov Ganov ,  Kalyana Ram Desineni

IPC: G10L15/22 ,  G10L15/18

CPC classification number: G10L15/22 ,  G10L15/1822 ,  G10L2015/223

Abstract: The present disclosure is directed to automating user interactions in an application. In particular, the computing device can determine, based on the input data, an intent associated with performing an action on the computing device. Additionally, the computing device can invoke, using an application-level assistant component configured to provide an application-level interface on the computing device, execution of an application. Moreover, the computing device can transmit, to a system-level assistant component configured to provide a system-level interface with the computing device, instructions to interface with an actionable component of the application. The instructions can be transmitted using a trusted intermediary component configured to facilitate an interface between the system-level assistant component and the application-level assistant component. Furthermore, the computing device can engage, using the system-level assistant component, the actionable component of the application to perform the action.