-
公开(公告)号:US11822857B2
公开(公告)日:2023-11-21
申请号:US16924835
申请日:2020-07-09
Applicant: Amazon Technologies, Inc.
Inventor: Mark Aran Aiken , Stanislaw Ignacy Pasko , Olusanya Temitope Soyannwo , Vibhav Hemant Salgaonkar , Adam Barry Fineberg , Roger Robert Webster , Makarand Damle , Rohan Mutagi , Philip Alexander Lee
CPC classification number: G06F3/167 , G10L15/22 , G10L15/26 , H04L12/282 , H04L12/2829 , H04L12/2834 , H04M1/72415 , G10L15/1822 , G10L15/30 , G10L15/32 , G10L2015/223 , G10L2015/228 , H04M2250/74
Abstract: A hub is configured to provide voice control without assistance from a remote system, which allows the hub to provide a user with the ability to control second devices in an environment by issuing voice commands, even when the hub is unable to communicate with the remote system over a wide area network (e.g., the Internet). The hub is also configured to execute rules without assistance from the remote system, which allows the hub to execute rules, even when the hub is unable to communicate with the remote system over a wide area network (e.g., the Internet).
-
公开(公告)号:US20230297327A1
公开(公告)日:2023-09-21
申请号:US17993242
申请日:2022-11-23
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko
CPC classification number: G06F3/167 , G10L15/32 , G10L15/22 , G10L25/60 , G10L2015/088
Abstract: A device can perform device arbitration, even when the device is unable to communicate with a remote system over a wide area network (e.g., the Internet). Upon detecting a wakeword in an utterance, the device can wait a period of time for data to arrive at the device, which, if received, indicates to the device that another speech interface device in the environment detected an utterance. If the device receives data prior to the period of time lapsing, the device can determine the earliest-occurring wakeword based on multiple wakeword occurrence times, and may designate whichever device that detected the wakeword first as the designated device to perform an action with respect to the user speech. To account for differences in sound capture latency between speech interface devices, a pre-calculated time offset value can be applied to wakeword occurrence time(s) during device arbitration.
-
公开(公告)号:US10984799B2
公开(公告)日:2021-04-20
申请号:US15934726
申请日:2018-03-23
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko , Michal Papierski , Maciej Makowski , Marcin Fuszara
Abstract: A speech interface device is configured with “hybrid” capabilities, which allows the speech interface device to perform actions in response to user speech, even when the speech interface device is unable to communicate with a remote system over a wide area network (e.g., the Internet). A hybrid request selector of the speech interface device sends audio data representing user speech to both a remote speech processing system and a local speech processing component executing on the speech interface device, and then waits for a response from either or both components. The local speech processing component may start execution based on the audio data and subsequently suspend the execution until further instruction from the hybrid request selector. The hybrid request selector can then determine which response to use, and, depending on which response is chosen, may instruct the local speech processing component to either continue or terminate the suspended execution.
-
公开(公告)号:US20200301661A1
公开(公告)日:2020-09-24
申请号:US16895869
申请日:2020-06-08
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko
Abstract: A device can perform device arbitration, even when the device is unable to communicate with a remote system over a wide area network (e.g., the Internet). Upon detecting a wakeword in an utterance, the device can wait a period of time for data to arrive at the device, which, if received, indicates to the device that another speech interface device in the environment detected an utterance. If the device receives data prior to the period of time lapsing, the device can determine the earliest-occurring wakeword based on multiple wakeword occurrence times, and may designate whichever device that detected the wakeword first as the designated device to perform an action with respect to the user speech. To account for differences in sound capture latency between speech interface devices, a pre-calculated time offset value can be applied to wakeword occurrence time(s) during device arbitration.
-
公开(公告)号:US10713007B2
公开(公告)日:2020-07-14
申请号:US15839750
申请日:2017-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Mark Aran Aiken , Stanislaw Ignacy Pasko , Olusanya Temitope Soyannwo , Vibhav Hemant Salgaonkar , Adam Barry Fineberg , Roger Robert Webster , Makarand Damle , Rohan Mutagi , Philip Alexander Lee
Abstract: A hub is configured to provide voice control without assistance from a remote system, which allows the hub to provide a user with the ability to control second devices in an environment by issuing voice commands, even when the hub is unable to communicate with the remote system over a wide area network (e.g., the Internet). The hub is also configured to execute rules without assistance from the remote system, which allows the hub to execute rules, even when the hub is unable to communicate with the remote system over a wide area network (e.g., the Internet).
-
公开(公告)号:US11887604B1
公开(公告)日:2024-01-30
申请号:US17902519
申请日:2022-09-02
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko
IPC: G10L15/30 , H04L67/5683 , G10L15/18
CPC classification number: G10L15/30 , G10L15/18 , H04L67/5683
Abstract: A speech interface device is configured to receive response data from a remote speech processing system for responding to user speech. This response data may be enhanced with information such as a remote ASR result(s) and a remote NLU result(s). The response data from the remote speech processing system may include one or more cacheable status indicators associated with the NLU result(s) and/or remote directive data, which indicate whether the remote NLU result(s) and/or the remote directive data are individually cacheable. A caching component of the speech interface device allows for caching at least some of this cacheable remote speech processing information, and using the cached information locally on the speech interface device when responding to user speech in the future. This allows for responding to user speech, even when the speech interface device is unable to communicate with a remote speech processing system over a wide area network.
-
公开(公告)号:US11721347B1
公开(公告)日:2023-08-08
申请号:US17362301
申请日:2021-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko , Pawel Zelazko , Cagdas Bak , Eli Joshua Fidler , Michal Kowalczuk , Andrew Oberlin , Ariya Rastrow
IPC: G10L17/26 , G10L15/183 , G10L15/34 , G10L15/22
CPC classification number: G10L17/26 , G10L15/183 , G10L15/22 , G10L15/34
Abstract: Some speech processing systems may handle some commands on-device rather than sending the audio data to a second device or system for processing. The first device may have limited speech processing capabilities sufficient for handling common language and/or commands, while the second device (e.g., an edge device and/or a remote system) may call on additional language models, entity libraries, skill components, etc. to perform additional tasks. An intermediate data generator may facilitate dividing speech processing operations between devices by generating a stream of data that includes a first-pass ASR output (e.g., a word or sub-word lattice) and other characteristics of the audio data such as whisper detection, speaker identification, media signatures, etc. The second device can perform the additional processing using the data stream; e.g., without using the audio data. Thus, privacy may be enhanced by processing the audio data locally without sending it to other devices/systems.
-
公开(公告)号:US11437041B1
公开(公告)日:2022-09-06
申请号:US17018279
申请日:2020-09-11
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko
IPC: G10L15/30 , H04L67/5683 , G10L15/18
Abstract: A speech interface device is configured to receive response data from a remote speech processing system for responding to user speech. This response data may be enhanced with information such as a remote ASR result(s) and a remote NLU result(s). The response data from the remote speech processing system may include one or more cacheable status indicators associated with the NLU result(s) and/or remote directive data, which indicate whether the remote NLU result(s) and/or the remote directive data are individually cacheable. A caching component of the speech interface device allows for caching at least some of this cacheable remote speech processing information, and using the cached information locally on the speech interface device when responding to user speech in the future. This allows for responding to user speech, even when the speech interface device is unable to communicate with a remote speech processing system over a wide area network.
-
公开(公告)号:US11132509B1
公开(公告)日:2021-09-28
申请号:US16208463
申请日:2018-12-03
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko , Ross William McGowan , Aliaksei Kuzmin , Rui Liu
IPC: G06F40/295 , G06K9/62 , G10L15/19
Abstract: A speech interface device is configured to perform natural language understanding (NLU) processing in a manner that optimizes the use of resources on the speech interface device. In an example process, a domain classifier(s) is used to generate domain classifier scores associated with multiple candidate domains, and the candidate domains can then be evaluated, one candidate domain at a time, in accordance with the domain classifier scores (e.g., starting with a highest scoring candidate domain). For each candidate domain undergoing the evaluation, input data is by that domain's NLU model(s), and, as soon as a domain-specific NLU model(s) produces a NLU result with a confidence score that satisfies a threshold confidence score, the evaluation can be stopped for any remaining candidate domains.
-
公开(公告)号:US20210241775A1
公开(公告)日:2021-08-05
申请号:US17234111
申请日:2021-04-19
Applicant: Amazon Technologies, Inc.
Inventor: Stanislaw Ignacy Pasko , Michal Papierski , Maciej Makowski , Marcin Fuszara
Abstract: A speech interface device is configured with “hybrid” capabilities, which allows the speech interface device to perform actions in response to user speech, even when the speech interface device is unable to communicate with a remote system over a wide area network (e.g., the Internet). A hybrid request selector of the speech interface device sends audio data representing user speech to both a remote speech processing system and a local speech processing component executing on the speech interface device, and then waits for a response from either or both components. The local speech processing component may start execution based on the audio data and subsequently suspend the execution until further instruction from the hybrid request selector. The hybrid request selector can then determine which response to use, and, depending on which response is chosen, may instruct the local speech processing component to either continue or terminate the suspended execution.
-
-
-
-
-
-
-
-
-