公开(公告)号：US11967321B2

公开(公告)日：2024-04-23

申请号：US17538641

申请日：2021-11-30

Applicant: GOOGLE LLC

Inventor： Joseph Lange ,  Abhanshu Sharma ,  Adam Coimbra ,  Gökhan Bakir ,  Gabriel Taubman ,  Ilya Firman ,  Jindong Chen ,  James Stout ,  Marcin Nowak-Przygodzki ,  Reed Enger ,  Thomas Weedon Hume ,  Vishwath Mohan ,  Jacek Szmigiel ,  Yunfan Jin ,  Kyle Pedersen ,  Gilles Baechler

IPC: G10L15/22 ,  G06F3/16 ,  G06F40/247 ,  G06F40/30 ,  G10L15/18

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F40/247 ,  G06F40/30 ,  G10L15/1815 ,  G10L15/1822 ,  G10L2015/223 ,  G10L2015/228

Abstract: Implementations set forth herein relate to an automated assistant that can interact with applications that may not have been pre-configured for interfacing with the automated assistant. The automated assistant can identify content of an application interface of the application to determine synonymous terms that a user may speak when commanding the automated assistant to perform certain tasks. Speech processing operations employed by the automated assistant can be biased towards these synonymous terms when the user is accessing an application interface of the application. In some implementations, the synonymous terms can be identified in a responsive language of the automated assistant when the content of the application interface is being rendered in a different language. This can allow the automated assistant to operate as an interface between the user and certain applications that may not be rendering content in a native language of the user.

公开(公告)号：US20230401253A1

公开(公告)日：2023-12-14

申请号：US18225560

申请日：2023-07-24

Applicant: GOOGLE LLC

Inventor： Anuj Thakkar ,  Chaitrali Amrutkar ,  Ognjen Nikolic ,  Jason Douglas ,  Ilya Firman ,  Steve Chen

IPC: G06F16/632 ,  G06F16/9532 ,  G06F3/16

CPC classification number: G06F16/634 ,  G06F16/9532 ,  G06F3/165

Abstract: Consolidation of disparate data source queries is provided. An application intake component can receive an application package file, and process the file to identify one or more actions and entities for the application. A natural language processor component can receive an input audio signal to identify an action and an entity on which to perform the action. An application delivery component can identify applications that can perform the action and applications that have access to the entity, and then select an application that is configured to perform the action on the entity. The application delivery component can provide an indication of the application selected by the system to a client device.

公开(公告)号：US11429428B2

公开(公告)日：2022-08-30

申请号：US16466228

申请日：2019-05-06

Applicant: Google LLC

Inventor： Jason Douglas ,  Carey Radebaugh ,  Ilya Firman ,  Ulas Kirazci ,  Luv Kothari

IPC: G10L15/22 ,  G06F9/48 ,  G10L15/18 ,  G10L15/30 ,  H04L12/28 ,  G10L15/34

Abstract: Systems and methods of invoking functions of agents via digital assistant applications are provided. Each action-inventory can have an address template for an action by an agent. The address template can include a portion having an input variable used to execute the action. A data processing system can parse an input audio signal from a client device to identify a request and a parameter to be executed by the agent. The data processing system can select an action-inventory for the action corresponding to the request. The data processing system can generate, using the address template, an address. The address can include a substring having the parameter used to control execution of the action. The data processing system can direct an action data structure including the address to the agent to cause the agent to execute the action and to provide output for presentation.

公开(公告)号：US11385990B2

公开(公告)日：2022-07-12

申请号：US16333535

申请日：2019-03-13

Applicant: GOOGLE LLC

Inventor： Yan Huang ,  Nikhil Rao ,  Owen Lin ,  Ilya Firman ,  Anil Iyer

IPC: G06F11/36 ,  G06F8/60

Abstract: Analyzing or debugging applications is provided. The system identifies an action for an application provided by a developer. The system determines a first classification score based on historical execution of the action. The system generates a machine generated action for the application based on metadata associated with the application. The system determines a second classification score based on a comparison of the action with the machine generated action. The system selects, via a matching program, a second application that matches the application. The system determines a third classification score based on a comparison of an action approved for the second application with the action provided by the application developer. The system updates a delivery control parameter based on the first classification score, the second classification score and the third classification score. The system controls delivery of the application based on the delivery control parameter.

公开(公告)号：US20190259078A1

公开(公告)日：2019-08-22

申请号：US16401415

申请日：2019-05-02

Applicant: Google LLC

Inventor： Ilya Firman ,  Jasper S. Lin ,  Mark D. Womack ,  Yu-Kuan Lin ,  Sheng-chi Hsieh ,  Juliana Tsang

IPC: G06Q30/06 ,  G06F8/71 ,  G06F8/60 ,  H04L29/08 ,  G06Q20/12

Abstract: In one aspect, this application describes a method for determining a version of a software application targeted for a computing device. The method includes receiving, at an application marketplace system and from a user associated with a computing device that operates remotely from the application marketplace system, a request that corresponds to a software application distributed by the application marketplace system, the software application having multiple versions on the application marketplace system. The method also includes determining one or more device attributes that are associated with the computing device, and identifying a particular version of the software application, from among the multiple versions on the application marketplace system, that is targeted for the computing device based on the device attributes. The method also includes providing, for display to the user and in response to the request, information related to the particular version of the software application.

公开(公告)号：US20240427581A1

公开(公告)日：2024-12-26

申请号：US18827258

申请日：2024-09-06

Applicant: GOOGLE LLC

Inventor： Yan Huang ,  Nikhil Rao ,  Owen Lin ,  Ilya Firman ,  Anil Iyer

IPC: G06F8/60 ,  G06F9/54 ,  G06F11/36 ,  G06F16/9035 ,  G06F16/906 ,  G06F16/907

Abstract: Analyzing or debugging applications is provided. The system identifies an action for an application provided by a developer. The system determines a first classification score based on historical execution of the action. The system generates a machine generated action for the application based on metadata associated with the application. The system determines a second classification score based on a comparison of the action with the machine generated action. The system selects, via a matching program, a second application that matches the application. The system determines a third classification score based on a comparison of an action approved for the second application with the action provided by the application developer. The system updates a delivery control parameter based on the first classification score, the second classification score and the third classification score. The system controls delivery of the application based on the delivery control parameter.

公开(公告)号：US20240242716A1

公开(公告)日：2024-07-18

申请号：US18432998

申请日：2024-02-05

Applicant: Google LLC

Inventor： Quazi Hussain ,  Adam Coimbra ,  Ilya Firman

IPC: G10L15/22 ,  G06F3/16 ,  G06F9/451 ,  G06F9/54 ,  G06N20/00 ,  G10L15/06 ,  G10L15/08 ,  G10L15/18

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F9/453 ,  G06F9/54 ,  G10L15/063 ,  G10L15/083 ,  G10L15/1815 ,  G10L15/1822 ,  G06N20/00 ,  G10L2015/0635 ,  G10L2015/223

Abstract: Dynamic interfacing with applications is provided. For example, a system receives a first input audio signal. The system processes, via a natural language processing technique, the first input audio signal to identify an application. The system activates the application for execution on the client computing device. The application declares a function the application is configured to perform. The system modifies the natural language processing technique responsive to the function declared by the application. The system receives a second input audio signal. The system processes, via the modified natural language processing technique, the second input audio signal to detect one or more parameters. The system determines that the one or more parameters are compatible for input into an input field of the application. The system generates an action data structure for the application. The system inputs the action data structure into the application, which executes the action data structure.

公开(公告)号：US11416229B2

公开(公告)日：2022-08-16

申请号：US16894101

申请日：2020-06-05

Applicant: GOOGLE LLC

Inventor： Yan Huang ,  Nikhil Rao ,  Owen Lin ,  Ilya Firman ,  Anil Iyer

IPC: G06F11/36 ,  G06F8/60 ,  G06F16/906 ,  G06F9/54 ,  G06F16/907 ,  G06F16/9035

Abstract: Analyzing or debugging applications is provided. The system identifies an action for an application provided by a developer. The system determines a first classification score based on historical execution of the action. The system generates a machine generated action for the application based on metadata associated with the application. The system determines a second classification score based on a comparison of the action with the machine generated action. The system selects, via a matching program, a second application that matches the application. The system determines a third classification score based on a comparison of an action approved for the second application with the action provided by the application developer. The system updates a delivery control parameter based on the first classification score, the second classification score and the third classification score. The system controls delivery of the application based on the delivery control parameter.

公开(公告)号：US20210287676A1

公开(公告)日：2021-09-16

申请号：US17334416

申请日：2021-05-28

Applicant: GOOGLE LLC

Inventor： Gaurav BHAYA ,  Ulas Kirazci ,  Bradley Abrams ,  Adam Coimbra ,  Ilya Firman ,  Carey Radebaugh

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/30 ,  G06F40/216

Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.

公开(公告)号：US12236064B2

公开(公告)日：2025-02-25

申请号：US18347374

申请日：2023-07-05

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Ilya Firman

IPC: G06F3/0484 ,  G06F3/0481 ,  G06F3/16 ,  G06F9/451 ,  G06F40/205 ,  G06F40/30 ,  G06V20/70 ,  G10L15/18 ,  G10L15/22

Abstract: A method of encoding and decoding user interface interactions includes receiving a query from a user captured by an assistant-enabled device associated with the user. The query includes a user intent for interacting with an application. The method includes obtaining, for the application, a set of categorized actions. Each categorized action of the set of categorized actions is associated with one or more parameters and represents a high-level description of the user intent of the user interacting with the application. For each respective categorized action of the set of categorized actions, the method includes selecting a respective script associated with the respective categorized action that performs one or more low-level interactions with the application and executing the respective script to represent the user intent for interacting with the application.