公开(公告)号：US11145300B2

公开(公告)日：2021-10-12

申请号：US16064961

申请日：2018-05-07

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Ulas Kirazci ,  Bradley Abrams ,  Adam Coimbra ,  Ilya Firman ,  Carey Radebaugh

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/30 ,  G06F40/216 ,  G06F40/30 ,  G06F16/901 ,  G06F40/35

Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.

公开(公告)号：US20210279412A1

公开(公告)日：2021-09-09

申请号：US17327261

申请日：2021-05-21

Applicant: Google LLC

Inventor： David Wang ,  Ulas Kirazci ,  Joshua Richard Williams

IPC: G06F40/174 ,  G06F40/30 ,  G06F40/221 ,  G06F40/274 ,  G06F16/958

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for facilitating input by a user into a form. In one aspect, a method include actions of obtaining a web resource that includes a form, determining a particular field of the form has been selected, determining an intent that corresponds to the form from a first semantic tag in the web resource, determining a parameter of the intent that corresponds to the particular field of the form from a second semantic tag in the web resource, determining a value to suggest for the particular field based at least on the intent and the parameter of the intent, and providing the value for output as a suggestion of input for the particular field.

公开(公告)号：US20210193146A1

公开(公告)日：2021-06-24

申请号：US17192230

申请日：2021-03-04

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/22 ,  G06F9/448 ,  G06F3/16 ,  G10L13/027

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US20200294497A1

公开(公告)日：2020-09-17

申请号：US15774950

申请日：2018-05-07

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/22 ,  G10L13/027 ,  G06F3/16 ,  G06F9/448

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US10714086B2

公开(公告)日：2020-07-14

申请号：US16244780

申请日：2019-01-10

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20190205368A1

公开(公告)日：2019-07-04

申请号：US15858586

申请日：2017-12-29

Applicant: Google LLC

Inventor： David Wang ,  Ulas Kirazci ,  Joshua Richard Williams

IPC: G06F17/24 ,  G06F17/30 ,  G06F17/27

CPC classification number: G06F17/243 ,  G06F16/986 ,  G06F17/272 ,  G06F17/276 ,  G06F17/2785

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for facilitating input by a user into a form. In one aspect, a method include actions of obtaining a web resource that includes a form, determining a particular field of the form has been selected, determining an intent that corresponds to the form from a first semantic tag in the web resource, determining a parameter of the intent that corresponds to the particular field of the form from a second semantic tag in the web resource, determining a value to suggest for the particular field based at least on the intent and the parameter of the intent, and providing the value for output as a suggestion of input for the particular field.

公开(公告)号：US20240346055A1

公开(公告)日：2024-10-17

申请号：US18495558

申请日：2023-10-26

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Othar Hansson ,  Anton Hansson

IPC: G06F16/332

CPC classification number: G06F16/3322

Abstract: Methods, systems, and apparatus, for automatically generating search suggestions based on history data for multiple native application on a user device.

公开(公告)号：US11429428B2

公开(公告)日：2022-08-30

申请号：US16466228

申请日：2019-05-06

Applicant: Google LLC

Inventor： Jason Douglas ,  Carey Radebaugh ,  Ilya Firman ,  Ulas Kirazci ,  Luv Kothari

IPC: G10L15/22 ,  G06F9/48 ,  G10L15/18 ,  G10L15/30 ,  H04L12/28 ,  G10L15/34

Abstract: Systems and methods of invoking functions of agents via digital assistant applications are provided. Each action-inventory can have an address template for an action by an agent. The address template can include a portion having an input variable used to execute the action. A data processing system can parse an input audio signal from a client device to identify a request and a parameter to be executed by the agent. The data processing system can select an action-inventory for the action corresponding to the request. The data processing system can generate, using the address template, an address. The address can include a substring having the parameter used to control execution of the action. The data processing system can direct an action data structure including the address to the agent to cause the agent to execute the action and to provide output for presentation.

公开(公告)号：US20220148596A1

公开(公告)日：2022-05-12

申请号：US17582926

申请日：2022-01-24

Applicant: Google LLC

Inventor： Barnaby James ,  Bo Wang ,  Sunil Vemuri ,  David Schairer ,  Ulas Kirazci ,  Ertan Dogrultan ,  Petar Aleksic

IPC: G10L15/22 ,  G10L15/18 ,  G06F40/284 ,  G06F40/30 ,  G10L15/183 ,  G06F40/205 ,  G10L15/30

Abstract: Implementations relate to dynamically, and in a context-sensitive manner, biasing voice to text conversion. In some implementations, the biasing of voice to text conversions is performed by a voice to text engine of a local agent, and the biasing is based at least in part on content provided to the local agent by a third-party (3P) agent that is in network communication with the local agent. In some of those implementations, the content includes contextual parameters that are provided by the 3P agent in combination with responsive content generated by the 3P agent during a dialog that: is between the 3P agent, and a user of a voice-enabled electronic device; and is facilitated by the local agent. The contextual parameters indicate potential feature(s) of further voice input that is to be provided in response to the responsive content generated by the 3P agent.

公开(公告)号：US20240184620A1

公开(公告)日：2024-06-06

申请号：US18440528

申请日：2024-02-13

Applicant: GOOGLE LLC

Inventor： Jason Douglas ,  Carey Radebaugh ,  Ilya Firman ,  Ulas Kirazci ,  Luv Kothari

IPC: G06F9/48 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/34 ,  H04L12/28

CPC classification number: G06F9/4843 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/30 ,  G06F2209/482 ,  G10L2015/223 ,  G10L2015/228 ,  G10L15/34 ,  H04L12/281 ,  H04L12/2816

Abstract: Systems and methods of invoking functions of agents via digital assistant applications are provided. Each action-inventory can have an address template for an action by an agent. The address template can include a portion having an input variable used to execute the action. A data processing system can parse an input audio signal from a client device to identify a request and a parameter to be executed by the agent. The data processing system can select an action-inventory for the action corresponding to the request. The data processing system can generate, using the address template, an address. The address can include a substring having the parameter used to control execution of the action. The data processing system can direct an action data structure including the address to the agent to cause the agent to execute the action and to provide output for presentation.