公开(公告)号：US20200258523A1

公开(公告)日：2020-08-13

申请号：US16860679

申请日：2020-04-28

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Ulas Kirazci ,  Bradley Abrams ,  Adam Coimbra ,  Ilya Firman ,  Carey Radebaugh

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/30

Abstract: The present disclosure is generally directed to the generation of voice-activated data flows in interconnected network. The voice-activated data flows can include input audio signals that include a request and are detected at a client device. The client device can transmit the input audio signal to a data processing system, where the input audio signal can be parsed and passed to the data processing system of a service provider to fulfill the request in the input audio signal. The present solution is configured to conserve network resources by reducing the number of network transmissions needed to fulfill a request.

公开(公告)号：US10719515B2

公开(公告)日：2020-07-21

申请号：US16546623

申请日：2019-08-21

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Robert Stets

IPC: G10L15/00 ,  G06F16/2455 ,  G10L15/18 ,  G10L15/30 ,  G10L15/22 ,  G06F16/242 ,  G10L15/08

Abstract: Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor (“NLP”) component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A direct action application programming interface (“API”) can generate a first action data structure with a parameter defining a first action. The NLP component can receive and parse a second input audio signal to identify a second request and a second trigger keyword, and can generate a second action data structure with a parameter defining a second action. A pooling component can generate the first and second action data structures into a pooled data structure, and can transmit the pooled data structure to a service provider computing device to cause it device to perform an operation defined by the pooled data structure.

公开(公告)号：US10665236B2

公开(公告)日：2020-05-26

申请号：US15966940

申请日：2018-04-30

Applicant: Google LLC

Inventor： Anshul Kothari ,  Tarun Jain ,  Gaurav Bhaya ,  Lisa Takehana ,  Ruxandra Davies

IPC: G10L15/00 ,  G10L15/22 ,  G10L15/18 ,  G10L17/22 ,  H04W12/06 ,  G10L15/08 ,  G10L15/30

Abstract: Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

公开(公告)号：US20180322878A1

公开(公告)日：2018-11-08

申请号：US16039202

申请日：2018-07-18

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Robert Stets

IPC: G10L15/22 ,  H04L12/825 ,  G10L15/30 ,  G10L15/14 ,  G10L15/18 ,  G10L15/08

CPC classification number: G10L15/22 ,  G06F3/165 ,  G10L15/14 ,  G10L15/1822 ,  G10L15/26 ,  G10L15/30 ,  G10L2015/088 ,  H04L47/25

Abstract: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

公开(公告)号：US20180191713A1

公开(公告)日：2018-07-05

申请号：US15863042

申请日：2018-01-05

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Robert Stets

IPC: H04L29/06 ,  H04W4/02 ,  H04L29/08 ,  G10L17/24 ,  G06F21/34 ,  G10L15/18 ,  G10L25/51 ,  G06F21/32 ,  G10L17/02 ,  G10L15/08

Abstract: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.

公开(公告)号：US11949733B2

公开(公告)日：2024-04-02

申请号：US17167720

申请日：2021-02-04

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Robert James Stets, Jr.

IPC: H04L67/10 ,  G06F40/174 ,  G06F40/186 ,  G10L15/18 ,  G10L15/22 ,  H04L67/53 ,  G06Q30/0242 ,  G10L15/08 ,  G10L15/30 ,  H04L67/01

CPC classification number: H04L67/10 ,  G06F40/174 ,  G06F40/186 ,  G10L15/1822 ,  G10L15/22 ,  H04L67/53 ,  G06Q30/0242 ,  G10L2015/088 ,  G10L2015/223 ,  G10L15/30 ,  H04L67/01

Abstract: Routing packetized actions in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate an action data structure. The system can transmit the action data structure to a third party provider device. The system can receive an indication from the third party provider device that a communication session was established with the device.

公开(公告)号：US11705127B2

公开(公告)日：2023-07-18

申请号：US17346009

申请日：2021-06-11

Applicant: Google LLC

Inventor： Anshul Kothari ,  Gaurav Bhaya ,  Tarun Jain

IPC: G10L15/22 ,  G10L15/28 ,  H04L43/10 ,  H04L67/125

CPC classification number: G10L15/22 ,  G10L15/28 ,  H04L43/10 ,  H04L67/125 ,  G10L2015/223

Abstract: Coordinating signal processing among computing devices in a voice-driven computing environment is provided. A first and second digital assistant can detect an input audio signal, perform a signal quality check, and provide indications that the first and second digital assistants are operational to process the input audio signal. A system can select the first digital assistant for further processing. The system can receive, from the first digital assistant, data packets including a command. The system can generate, for a network connected device selected from a plurality of network connected devices, an action data structure based on the data packets, and transmit the action data structure to the selected network connected device.

公开(公告)号：US20230186920A1

公开(公告)日：2023-06-15

申请号：US18154448

申请日：2023-01-13

Applicant: Google LLC

Inventor： Anshul Kothari ,  Gaurav Bhaya ,  Tarun Jain

IPC: G10L17/00 ,  G10L15/22 ,  G10L15/08 ,  H04L67/306 ,  H04W4/021 ,  G06F3/16 ,  G06F16/903 ,  G06F21/32 ,  G06F9/44

CPC classification number: G10L17/00 ,  G10L15/22 ,  G10L15/08 ,  H04L67/306 ,  H04W4/021 ,  G06F3/167 ,  G06F16/903 ,  G06F21/32 ,  G06F9/44 ,  G10L2015/223 ,  G10L17/22

Abstract: Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

公开(公告)号：US11557302B2

公开(公告)日：2023-01-17

申请号：US16799307

申请日：2020-02-24

Applicant: Google LLC

Inventor： Anshul Kothari ,  Tarun Jain ,  Gaurav Bhaya

IPC: G10L15/22 ,  G10L17/00 ,  G10L15/08 ,  H04L67/306 ,  H04W4/021 ,  G06F3/16 ,  G06F16/903 ,  G06F21/32 ,  G06F9/44 ,  G10L17/22

Abstract: Processing stacked data structures is provided. A system receives an input audio signal detected by a sensor of a local computing device, identifies an acoustic signature, and identifies an account corresponding to the signature. The system establishes a session and a profile stack data structure including a first profile layer having policies configured by a third-party device. The system pushes, to the profile stack data structure, a second profile layer retrieved from the account. The system parses the input audio signal to identify a request and a trigger keyword. The system generates, based on the trigger keyword and the second profile layer, a first action data structure compatible with the first profile layer. The system provides the first action data structure for execution. The system disassembles the profile stack data structure to remove the first profile layer or the second profile layer from the profile stack data structure.

公开(公告)号：US11482216B2

公开(公告)日：2022-10-25

申请号：US16447718

申请日：2019-06-20

Applicant: Google LLC

Inventor： Gaurav Bhaya ,  Robert Stets

IPC: G10L15/22 ,  H04L65/1069 ,  G10L15/18 ,  G10L15/30 ,  G10L21/003 ,  G10L21/0316 ,  G10L13/027 ,  G06F40/205 ,  G10L15/08

Abstract: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.