公开(公告)号：US11893993B2

公开(公告)日：2024-02-06

申请号：US18070322

申请日：2022-11-28

Applicant: GOOGLE LLC

Inventor： Quazi Hussain ,  Adam Coimbra ,  Ilya Firman

IPC: G10L15/22 ,  G06F9/451 ,  G06F9/54 ,  G10L15/18 ,  G06F3/16 ,  G10L15/06 ,  G10L15/08 ,  G06N20/00

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F9/453 ,  G06F9/54 ,  G10L15/063 ,  G10L15/083 ,  G10L15/1815 ,  G10L15/1822 ,  G06N20/00 ,  G10L2015/0635 ,  G10L2015/223

Abstract: Dynamic interfacing with applications is provided. For example, a system receives a first input audio signal. The system processes, via a natural language processing technique, the first input audio signal to identify an application. The system activates the application for execution on the client computing device. The application declares a function the application is configured to perform. The system modifies the natural language processing technique responsive to the function declared by the application. The system receives a second input audio signal. The system processes, via the modified natural language processing technique, the second input audio signal to detect one or more parameters. The system determines that the one or more parameters are compatible for input into an input field of the application. The system generates an action data structure for the application. The system inputs the action data structure into the application, which executes the action data structure.

公开(公告)号：US20230350550A1

公开(公告)日：2023-11-02

申请号：US18347374

申请日：2023-07-05

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Ilya Firman

IPC: G06F3/0484 ,  G06F3/0481 ,  G06F9/451 ,  G06F3/16 ,  G06F40/205 ,  G10L15/22 ,  G06V20/70 ,  G10L15/18 ,  G06F40/30

CPC classification number: G06F3/0484 ,  G06F3/0481 ,  G06F9/451 ,  G06F3/167 ,  G06F40/205 ,  G10L15/22 ,  G06V20/70 ,  G10L15/1815 ,  G06F40/30

Abstract: A method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. The query includes a user intent for interacting with an application. The method includes obtaining, for the application, a set of categorized actions. Each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. For each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.

公开(公告)号：US20230267928A1

公开(公告)日：2023-08-24

申请号：US18004971

申请日：2021-05-18

Applicant: Google LLC

Inventor： Quazi Hussain ,  Mubaraq Mishra ,  Vidhya Bhat ,  Adam Cohen ,  Sunny Goyal ,  Adam Coimbra ,  Sanjana Patel ,  Ilya Firman ,  Mehdi Alizadeh ,  Saurabh Kumar

IPC: G10L15/22 ,  G06F21/60 ,  G06F16/901 ,  H04L9/32 ,  G10L15/18

CPC classification number: G10L15/22 ,  G06F16/901 ,  G06F21/602 ,  G10L15/1822 ,  H04L9/3213 ,  G10L2015/223

Abstract: Indexing application actions for voice-based execution is provided. An indexer of a device receives, from an application executed by the device, an indication of an action and a deep link corresponding to the action declared by the application via an application programming interface. The indexer accesses an index stored in the memory of the device that is accessible to a plurality of applications. The indexer inputs, into a location in the index, the action and the deep link with a cryptographic token that prevents access to the deep link by unauthorized applications. A digital assistant of the device receives a voice query detected by a microphone and parses the voice query to determine the action. The digital assistant identifies in the index the deep link corresponding to the action. The digital assistant invokes, with the cryptographic token, the deep link to cause the application to perform the action.

公开(公告)号：US11726641B1

公开(公告)日：2023-08-15

申请号：US17651057

申请日：2022-02-14

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Ilya Firman

IPC: G06F3/0484 ,  G06F3/0481 ,  G06F40/30 ,  G06V20/70 ,  G06F9/451 ,  G10L15/22 ,  G10L15/18 ,  G06F3/16 ,  G06F40/205

CPC classification number: G06F3/0484 ,  G06F3/0481 ,  G06F3/167 ,  G06F9/451 ,  G06F40/205 ,  G06F40/30 ,  G06V20/70 ,  G10L15/1815 ,  G10L15/22

Abstract: A method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. The query includes a user intent for interacting with an application. The method includes obtaining, for the application, a set of categorized actions. Each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. For each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.

公开(公告)号：US20220309098A1

公开(公告)日：2022-09-29

申请号：US17840264

申请日：2022-06-14

Applicant: Google LLC

Inventor： Anuj Thakkar ,  Chaitrali Amrutkar ,  Ognjen Nikolic ,  Jason Douglas ,  Ilya Firman ,  Steve Chen

IPC: G06F16/632 ,  G06F16/9532 ,  G06F3/16

Abstract: Consolidation of disparate data source queries is provided. An application intake component can receive an application package file, and process the file to identify one or more actions and entities for the application. A natural language processor component can receive an input audio signal to identify an action and an entity on which to perform the action. An application delivery component can identify applications that can perform the action and applications that have access to the entity, and then select an application that is configured to perform the action on the entity. The application delivery component can provide an indication of the application selected by the system to a client device.

公开(公告)号：US11145300B2

公开(公告)日：2021-10-12

申请号：US16064961

申请日：2018-05-07

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Ulas Kirazci ,  Bradley Abrams ,  Adam Coimbra ,  Ilya Firman ,  Carey Radebaugh

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/30 ,  G06F40/216 ,  G06F40/30 ,  G06F16/901 ,  G06F40/35

Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.

公开(公告)号：US10290035B2

公开(公告)日：2019-05-14

申请号：US15417789

申请日：2017-01-27

Applicant: Google LLC

Inventor： Ilya Firman ,  Jasper S. Lin ,  Mark D. Womack ,  Yu-Kuan Lin ,  Sheng-chi Hsieh ,  Juliana Tsang

IPC: G06F9/44 ,  G06Q30/06 ,  G06F8/60 ,  G06F8/71 ,  G06Q20/12 ,  H04L29/08

Abstract: In one aspect, this application describes a method for determining a version of a software application targeted for a computing device. The method includes receiving, at an application marketplace system and from a user associated with a computing device that operates remotely from the application marketplace system, a request that corresponds to a software application distributed by the application marketplace system, the software application having multiple versions on the application marketplace system. The method also includes determining one or more device attributes that are associated with the computing device, and identifying a particular version of the software application, from among the multiple versions on the application marketplace system, that is targeted for the computing device based on the device attributes. The method also includes providing, for display to the user and in response to the request, information related to the particular version of the software application.

公开(公告)号：US12106084B2

公开(公告)日：2024-10-01

申请号：US17840328

申请日：2022-06-14

Applicant: Google LLC

Inventor： Yan Huang ,  Nikhil Rao ,  Owen Lin ,  Ilya Firman ,  Anil Iyer

IPC: G06F8/60 ,  G06F9/54 ,  G06F11/36 ,  G06F16/9035 ,  G06F16/906 ,  G06F16/907

CPC classification number: G06F8/60 ,  G06F9/546 ,  G06F11/3604 ,  G06F11/362 ,  G06F11/3664 ,  G06F16/9035 ,  G06F16/906 ,  G06F16/907

Abstract: Analyzing or debugging applications is provided. The system identifies an action for an application provided by a developer. The system determines a first classification score based on historical execution of the action. The system generates a machine generated action for the application based on metadata associated with the application. The system determines a second classification score based on a comparison of the action with the machine generated action. The system selects, via a matching program, a second application that matches the application. The system determines a third classification score based on a comparison of an action approved for the second application with the action provided by the application developer. The system updates a delivery control parameter based on the first classification score, the second classification score and the third classification score. The system controls delivery of the application based on the delivery control parameter.

公开(公告)号：US20240184620A1

公开(公告)日：2024-06-06

申请号：US18440528

申请日：2024-02-13

Applicant: GOOGLE LLC

Inventor： Jason Douglas ,  Carey Radebaugh ,  Ilya Firman ,  Ulas Kirazci ,  Luv Kothari

IPC: G06F9/48 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/34 ,  H04L12/28

CPC classification number: G06F9/4843 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/30 ,  G06F2209/482 ,  G10L2015/223 ,  G10L2015/228 ,  G10L15/34 ,  H04L12/281 ,  H04L12/2816

Abstract: Systems and methods of invoking functions of agents via digital assistant applications are provided. Each action-inventory can have an address template for an action by an agent. The address template can include a portion having an input variable used to execute the action. A data processing system can parse an input audio signal from a client device to identify a request and a parameter to be executed by the agent. The data processing system can select an action-inventory for the action corresponding to the request. The data processing system can generate, using the address template, an address. The address can include a substring having the parameter used to control execution of the action. The data processing system can direct an action data structure including the address to the agent to cause the agent to execute the action and to provide output for presentation.

公开(公告)号：US11664025B2

公开(公告)日：2023-05-30

申请号：US17334416

申请日：2021-05-28

Applicant: GOOGLE LLC

Inventor： Gaurav Bhaya ,  Ulas Kirazci ,  Bradley Abrams ,  Adam Coimbra ,  Ilya Firman ,  Carey Radebaugh

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/30 ,  G06F40/216 ,  G06F40/30 ,  G06F16/901 ,  G06F40/35

CPC classification number: G10L15/22 ,  G06F40/216 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/30 ,  G06F16/9024 ,  G06F16/9027 ,  G06F40/30 ,  G06F40/35 ,  G10L2015/223 ,  G10L2015/225

Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.