Multimodal Transmission of Packetized Data

    公开(公告)号:US20220353303A1

    公开(公告)日:2022-11-03

    申请号:US17856636

    申请日:2022-07-01

    申请人: Google LLC

    摘要: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

    Modulation of packetized audio signals

    公开(公告)号:US11295738B2

    公开(公告)日:2022-04-05

    申请号:US16518606

    申请日:2019-07-22

    申请人: Google LLC

    摘要: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.

    Device identifier dependent operation processing of packet based data communication

    公开(公告)号:US10957326B2

    公开(公告)日:2021-03-23

    申请号:US15966587

    申请日:2018-04-30

    申请人: Google LLC

    摘要: Identifier dependent operation processing of packet based data communication is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. A content selector component can select, based on the request or trigger keyword, a content item. A link generation component can determine whether the client computing device has an account or a record in a database associated with the service provider device. In the absence of the record or account, the link generation device generates and sends a virtual identifier to the service provider device with instructions to generate an account in the database using the virtual identifier. Once the account is created, the service provider device can communicate with the client computing device.

    Authentication of packetized audio signals

    公开(公告)号:US10917404B2

    公开(公告)日:2021-02-09

    申请号:US16725371

    申请日:2019-12-23

    申请人: Google LLC

    摘要: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.

    RESOURCE SIZE-BASED CONTENT ITEM SELECTION
    55.
    发明申请

    公开(公告)号:US20200210639A1

    公开(公告)日:2020-07-02

    申请号:US16816077

    申请日:2020-03-11

    申请人: Google LLC

    摘要: Systems and methods for automatically determining a content item size may be based on a size of a viewport and a width of a parent element. A script may be configured to determine a size of a viewport, determine a width of a parent element of a resource, and determine a content item size based, at least in part, on the size of the view port and the width of the parent element. A dimension of the determined content item size may be used by a content item selection system to determine a set of content items. A content item selection system may select a content item from the determined set of content items and serve data to effect display of the selected content item in the parent element with the resource.

    Multimodal transmission of packetized data

    公开(公告)号:US10593329B2

    公开(公告)日:2020-03-17

    申请号:US16039204

    申请日:2018-07-18

    申请人: Google LLC

    摘要: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

    Authentication of packetized audio signals

    公开(公告)号:US10541998B2

    公开(公告)日:2020-01-21

    申请号:US15863042

    申请日:2018-01-05

    申请人: Google LLC

    摘要: The present disclosure is generally directed a data processing system for authenticating packetized audio signals in a voice activated computer network environment. The data processing system can improve the efficiency and effectiveness of auditory data packet transmission over one or more computer networks by, for example, disabling malicious transmissions prior to their transmission across the network. The present solution can also improve computational efficiency by disabling remote computer processes possibly affected by or caused by the malicious audio signal transmissions. By disabling the transmission of malicious audio signals, the system can reduce bandwidth utilization by not transmitting the data packets carrying the malicious audio signal across the networks.

    Multimodal transmission of packetized data

    公开(公告)号:US10535348B2

    公开(公告)日:2020-01-14

    申请号:US16039202

    申请日:2018-07-18

    申请人: Google LLC

    摘要: A system of multi-modal transmission of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify first and second candidate interfaces, and respective resource utilization values. The interface management component can select, based on the resource utilization values, the first candidate interface to present the content item. The interface management component can provide the first action data structure to the client computing device for rendering as audio output, and can transmit the content item converted for a first modality to deliver the content item for rendering from the selected interface.

    MODULATION OF PACKETIZED AUDIO SIGNALS
    59.
    发明申请

    公开(公告)号:US20190355359A1

    公开(公告)日:2019-11-21

    申请号:US16518606

    申请日:2019-07-22

    申请人: Google LLC

    摘要: Modulating packetized audio signals in a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request, and generate a first action data structure. The system can identify a content item object based on the trigger keyword, and generate an output signal comprising a first portion corresponding to the first action data structure and a second portion corresponding to the content item object. The system can apply a modulation to the first or second portion of the output signal, and transmit the modulated output signal to the device.

    Data structure pooling of voice activated data packets

    公开(公告)号:US10423621B2

    公开(公告)日:2019-09-24

    申请号:US16018750

    申请日:2018-06-26

    申请人: Google LLC

    摘要: Systems and methods of voice activated thread management in a voice activated data packet based environment are provided. A natural language processor (“NLP”) component can receive and parse data packets comprising a first input audio signal to identify a first request and a first trigger keyword. A direct action application programming interface (“API”) can generate a first action data structure with a parameter defining a first action. The NLP component can receive and parse a second input audio signal to identify a second request and a second trigger keyword, and can generate a second action data structure with a parameter defining a second action. A pooling component can generate the first and second action data structures into a pooled data structure, and can transmit the pooled data structure to a service provider computing device to cause it device to perform an operation defined by the pooled data structure.