-
公开(公告)号:US20230274737A1
公开(公告)日:2023-08-31
申请号:US18013083
申请日:2022-05-31
Applicant: Google LLC
Inventor: Keun Soo Yim , Ilya Firman , Adam Miller Coimbra , Robert James Berry , Mugurel Ionut Andreica , Mikhail Reutov , Gabriel Oak Taubman , Cliff Shan Kuang , Michael Oh , Svetoslav Radoslavov Ganov , Kalyana Ram Desineni
CPC classification number: G10L15/22 , G10L15/1822 , G10L2015/223
Abstract: The present disclosure is directed to automating user interactions in an application. In particular, the computing device can determine, based on the input data, an intent associated with performing an action on the computing device. Additionally, the computing device can invoke, using an application-level assistant component configured to provide an application-level interface on the computing device, execution of an application. Moreover, the computing device can transmit, to a system-level assistant component configured to provide a system-level interface with the computing device, instructions to interface with an actionable component of the application. The instructions can be transmitted using a trusted intermediary component configured to facilitate an interface between the system-level assistant component and the application-level assistant component. Furthermore, the computing device can engage, using the system-level assistant component, the actionable component of the application to perform the action.
-
公开(公告)号:US20230259254A1
公开(公告)日:2023-08-17
申请号:US17651057
申请日:2022-02-14
Applicant: Google LLC
Inventor: Keun Soo YIM , Ilya Firman
IPC: G06F3/0484 , G06F3/0481 , G06F40/30 , G06V20/70 , G06F40/205 , G10L15/22 , G10L15/18 , G06F3/16 , G06F9/451
CPC classification number: G06F3/0484 , G06F3/0481 , G06F40/30 , G06V20/70 , G06F40/205 , G10L15/22 , G10L15/1815 , G06F3/167 , G06F9/451
Abstract: A method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. The query includes a user intent for interacting with an application. The method includes obtaining, for the application, a set of categorized actions. Each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. For each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.
-
公开(公告)号:US20230110833A1
公开(公告)日:2023-04-13
申请号:US18070322
申请日:2022-11-28
Applicant: GOOGLE LLC
Inventor: Quazi Hussain , Adam Coimbra , Ilya Firman
Abstract: Dynamic interfacing with applications is provided. For example, a system receives a first input audio signal. The system processes, via a natural language processing technique, the first input audio signal to identify an application. The system activates the application for execution on the client computing device. The application declares a function the application is configured to perform. The system modifies the natural language processing technique responsive to the function declared by the application. The system receives a second input audio signal. The system processes, via the modified natural language processing technique, the second input audio signal to detect one or more parameters. The system determines that the one or more parameters are compatible for input into an input field of the application. The system generates an action data structure for the application. The system inputs the action data structure into the application, which executes the action data structure.
-
公开(公告)号:US20220413901A1
公开(公告)日:2022-12-29
申请号:US17898205
申请日:2022-08-29
Applicant: GOOGLE LLC
Inventor: Jason Douglas , Carey Radebaugh , Ilya Firman , Ulas Kirazci , Luv Kothari
Abstract: Systems and methods of invoking functions of agents via digital assistant applications are provided. Each action-inventory can have an address template for an action by an agent. The address template can include a portion having an input variable used to execute the action. A data processing system can parse an input audio signal from a client device to identify a request and a parameter to be executed by the agent. The data processing system can select an action-inventory for the action corresponding to the request. The data processing system can generate, using the address template, an address. The address can include a substring having the parameter used to control execution of the action. The data processing system can direct an action data structure including the address to the agent to cause the agent to execute the action and to provide output for presentation.
-
公开(公告)号:US11514907B2
公开(公告)日:2022-11-29
申请号:US16860679
申请日:2020-04-28
Applicant: Google LLC
Inventor: Gaurav Bhaya , Ulas Kirazci , Bradley Abrams , Adam Coimbra , Ilya Firman , Carey Radebaugh
IPC: G10L15/22 , G10L15/18 , G10L15/30 , G06F40/216 , G06F40/30 , G06F16/901 , G06F40/35
Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.
-
公开(公告)号:US11514896B2
公开(公告)日:2022-11-29
申请号:US16622805
申请日:2019-11-27
Applicant: Google LLC
Inventor: Quazi Hussain , Adam Coimbra , Ilya Firman
Abstract: Dynamic interfacing with applications is provided. For example, a system receives a first input audio signal. The system processes, via a natural language processing technique, the first input audio signal to identify an application. The system activates the application for execution on the client computing device. The application declares a function the application is configured to perform. The system modifies the natural language processing technique responsive to the function declared by the application. The system receives a second input audio signal. The system processes, via the modified natural language processing technique, the second input audio signal to detect one or more parameters. The system determines that the one or more parameters are compatible for input into an input field of the application. The system generates an action data structure for the application. The system inputs the action data structure into the application, which executes the action data structure.
-
公开(公告)号:US20210334305A1
公开(公告)日:2021-10-28
申请号:US16324605
申请日:2019-02-06
Applicant: GOOGLE LLC
Inventor: Anuj Thakkar , Chaitrali Amrutkar , Ognjen Nikolic , Jason Douglas , Ilya Firman , Steve Chen
IPC: G06F16/632 , G06F16/9532 , G06F3/16
Abstract: Consolidation of disparate data source queries is provided. An application intake component can receive an application package file, and process the file to identify one or more actions and entities for the application. A natural language processor component can receive an input audio signal to identify an action and an entity on which to perform the action. An application delivery component can identify applications that can perform the action and applications that have access to the entity, and then select an application that is configured to perform the action on the entity. The application delivery component can provide an indication of the application selected by the system to a client device.
-
公开(公告)号:US11024306B2
公开(公告)日:2021-06-01
申请号:US16131453
申请日:2018-09-14
Applicant: Google LLC
Inventor: Gaurav Bhaya , Ulas Kirazci , Bradley Abrams , Adam Coimbra , Ilya Firman , Carey Radebaugh
Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.
-
公开(公告)号:US10740813B2
公开(公告)日:2020-08-11
申请号:US16401415
申请日:2019-05-02
Applicant: Google LLC
Inventor: Ilya Firman , Jasper S. Lin , Mark D. Womack , Yu-Kuan Lin , Sheng-chi Hsieh , Juliana Tsang
Abstract: In one aspect, this application describes a method for determining a version of a software application targeted for a computing device. The method includes receiving, at an application marketplace system and from a user associated with a computing device that operates remotely from the application marketplace system, a request that corresponds to a software application distributed by the application marketplace system, the software application having multiple versions on the application marketplace system. The method also includes determining one or more device attributes that are associated with the computing device, and identifying a particular version of the software application, from among the multiple versions on the application marketplace system, that is targeted for the computing device based on the device attributes. The method also includes providing, for display to the user and in response to the request, information related to the particular version of the software application.
-
-
-
-
-
-
-
-