Obtaining input from a virtual user interface
    11.
    发明授权
    Obtaining input from a virtual user interface 有权
    从虚拟用户界面获取输入

    公开(公告)号:US09081418B1

    公开(公告)日:2015-07-14

    申请号:US13794296

    申请日:2013-03-11

    申请人: Rawles LLC

    IPC分类号: G09G5/00 G06F3/01 G06F3/00

    摘要: A virtual user interface in a 3D environment is projected onto a display object, such as an open hand. An operating object, such as a stylus or a second hand with an index finger extended, may be used to select input features of the projected user interface. In one scenario, for example, a telephone keypad may be projected onto the open hand and the index finger may be used to select a particular number on the keypad. Images of the hands may be segmented to produce contours of the finger and open hand, and these contours are used to determine the location of the finger relative to the open hand.

    摘要翻译: 将3D环境中的虚拟用户界面投影到诸如开放手的显示对象上。 可以使用操作对象(诸如触控笔或具有伸缩的食指的秒针)来选择投影用户界面的输入特征。 在一种情况下,例如,可以将电话键盘投影到打开的手上,并且食指可以用于选择键盘上的特定数字。 手的图像可以被分割以产生手指和打开的手的轮廓,并且这些轮廓用于确定手指相对于开放手的位置。

    Non-uniform adaptive echo cancellation
    12.
    发明授权
    Non-uniform adaptive echo cancellation 有权
    非均匀自适应回波消除

    公开(公告)号:US09001994B1

    公开(公告)日:2015-04-07

    申请号:US14035369

    申请日:2013-09-24

    申请人: Rawles LLC

    发明人: Jun Yang

    IPC分类号: H04M9/08 H04B3/23

    CPC分类号: H04M9/082

    摘要: An audio-based system may perform echo cancellation by decomposing an input audio signal and a corresponding reference signal into sub-signals corresponding to different frequency bands and implementing adaptive filtering independently for each frequency band. Computational resources may be allocated differently for each of the frequency bands depending on observed conditions. Orders of adaptive FIR filters may be varied during operation. Double talk detection and echo path change detection may be implemented for some frequency bands and not others. Filter adaption rates may also be assigned independently to each of the FIR filters, and may be changed during operation.

    摘要翻译: 基于音频的系统可以通过将输入音频信号和相应的参考信号分解成对应于不同频带的子信号并且针对每个频带独立地实现自适应滤波来执行回波消除。 可以根据观察到的条件为每个频带分配不同的计算资源。 自适应FIR滤波器的顺序可以在操作期间变化。 双通道检测和回波路径变化检测可以针对一些频带而不是其他频带实现。 滤波器适配速率也可以独立地分配给每个FIR滤波器,并且可以在操作期间改变。

    Providing Content on Multiple Devices
    13.
    发明申请
    Providing Content on Multiple Devices 审中-公开
    在多个设备上提供内容

    公开(公告)号:US20140278438A1

    公开(公告)日:2014-09-18

    申请号:US13829156

    申请日:2013-03-14

    申请人: Rawles LLC

    IPC分类号: G10L21/06

    CPC分类号: G06F3/167 G10L15/00

    摘要: Techniques for receiving a voice command from a user and, in response, providing audible content to the user using a first device and providing visual content for the user using a second device. In some instances, the first device includes a microphone for generating audio signals that include user speech, as well as a speaker for outputting audible content in response to identified voice commands from the speech. However, the first device might not include a display for displaying graphical content. As such, the first device may be configured to identify devices that include displays and that are proximate to the first device. The first device may then instruct one or more of these other devices to output visual content associated with a user's voice command.

    摘要翻译: 用于从用户接收语音命令的技术,并且作为响应,使用第一设备向用户提供可听内容,并使用第二设备为用户提供视觉内容。 在一些情况下,第一设备包括用于产生包括用户语音的音频信号的麦克风,以及用于响应于来自语音的所识别的语音命令而输出可听内容的扬声器。 但是,第一个设备可能不包含用于显示图形内容的显示。 因此,第一设备可以被配置为识别包括显示器并且靠近第一设备的设备。 然后,第一设备可以指示这些其他设备中的一个或多个输出与用户的语音命令相关联的可视内容。

    Contingent device actions during loss of network connectivity

    公开(公告)号:US10224056B1

    公开(公告)日:2019-03-05

    申请号:US14109319

    申请日:2013-12-17

    申请人: Rawles LLC

    IPC分类号: G10L21/06

    摘要: A speech-based system includes a local device in a user premises and a network-based control service that directs the local device to perform actions for a user. The control service may specify a first action that is to be performed upon detection by the local device of a stimulus. In some cases, performing the first action may rely on the availability of network communications with the control service or with another service. In these cases, the control service also specifies a second, fallback action that does not rely upon network communications. Upon detecting the stimulus, the local device performs the first action if network communications are available. If network communications are not available, the local device performs the second, fallback action.

    Voice controlled system
    15.
    发明授权

    公开(公告)号:US10147441B1

    公开(公告)日:2018-12-04

    申请号:US14134546

    申请日:2013-12-19

    申请人: Rawles LLC

    IPC分类号: G10L25/00 G06F3/16 G06F3/041

    摘要: A distributed voice controlled system has a primary assistant and at least one secondary assistant. The primary assistant has a housing to hold one or more microphones, one or more speakers, and various computing components. The secondary assistant is similar in structure, but is void of speakers. The voice controlled assistants perform transactions and other functions primarily based on verbal interactions with a user. The assistants within the system are coordinated and synchronized to perform acoustic echo cancellation, selection of a best audio input from among the assistants, and distributed processing.

    Open and closed hand detection
    16.
    发明授权

    公开(公告)号:US10126820B1

    公开(公告)日:2018-11-13

    申请号:US13689525

    申请日:2012-11-29

    申请人: Rawles LLC

    IPC分类号: G06F3/01

    摘要: Detection of human hands within an environment is used for gesture recognition for input to a computing system. Detecting a hand is non-trivial, however, because the appearances of a hand vary widely with many independent digits and moving parts. A feature-based similarity measurement is used to detect two specific hand positions—an open hand and a closed hand.

    Hand-based interaction in virtually shared workspaces

    公开(公告)号:US09978178B1

    公开(公告)日:2018-05-22

    申请号:US13660832

    申请日:2012-10-25

    申请人: Rawles LLC

    IPC分类号: G09G5/00 G06F3/00 G06T19/00

    摘要: When sharing visible content on multiple display surfaces associated with different users, the hand of a user may be detected and analyzed when placed over the user's display surface. Characteristics of the user's hand, including things such as position, orientation, color, shape, and texture, may be shared with other users. Based on these characteristics, a representation of the user's hand may be depicted over the shared content on the display surfaces of the other users.

    Selecting from multiple content sources

    公开(公告)号:US09691379B1

    公开(公告)日:2017-06-27

    申请号:US14316613

    申请日:2014-06-26

    申请人: Rawles LLC

    IPC分类号: G10L15/22 G06F3/16 G10L15/18

    CPC分类号: G10L15/1815

    摘要: A speech-based system may be configured to receive and act upon spoken requests from a user. In some cases, a spoken request may ask the system to play content such as music without specifying from which of multiple available content sources the music is to be obtained. In response to such a request, the system analyzes feature scores for each of the content sources. The feature scores indicate usage characteristics of the different sources by a current user or groups of users. The features scores for a particular source may be averaged or otherwise combined to create a composite score, and the source having the highest composite score is selected as the source of the requested content.

    Detecting device proximities
    19.
    发明授权
    Detecting device proximities 有权
    检测设备接近度

    公开(公告)号:US09336767B1

    公开(公告)日:2016-05-10

    申请号:US14229454

    申请日:2014-03-28

    申请人: Rawles LLC

    IPC分类号: G10K11/16

    摘要: An audio device may be configured to produce output audio and to capture input audio for speech recognition. In some cases, a second device may also be used to capture input audio to improve isolation of input audio with respect to the output audio. In addition, acoustic echo cancellation (AEC) may be used to remove components of output audio from input signals of the first and second devices. AEC may be implemented by an adaptive filter based on dynamically optimized filter coefficients. The filter coefficients may be analyzed to detect situations in which the first and second devices are too close to each other, and the user may then be prompted to increase the distance between the two devices.

    摘要翻译: 音频设备可被配置为产生输出音频并且捕获用于语音识别的输入音频。 在一些情况下,第二设备也可用于捕获输入音频,以改善输入音频相对于输出音频的隔离。 此外,声回波消除(AEC)可以用于从第一和第二设备的输入信号中去除输出音频的分量。 AEC可以通过基于动态优化的滤波器系数的自适应滤波器来实现。 可以分析滤波器系数以检测第一和第二设备彼此太接近的情况,然后可以提示用户增加两个设备之间的距离。

    Estimating features of occluded objects
    20.
    发明授权
    Estimating features of occluded objects 有权
    封闭物体的估计特征

    公开(公告)号:US09336602B1

    公开(公告)日:2016-05-10

    申请号:US13770327

    申请日:2013-02-19

    申请人: Rawles LLC

    IPC分类号: G06T7/00

    摘要: A number of images of an environment may be obtained over time. In some images, a portion of an object included in the environment may be occluded by another object in the environment. In these images, features of the occluded portion of the object may be absent. The absent features may be estimated based on features generated from previous images including the object where the occluded portion of the object was not occluded in the previous images. In some cases, the absent features may be estimated based on data associated with a reference object that corresponds to the occluded object with the reference object being included in a catalog of reference objects.

    摘要翻译: 随着时间的推移,可以获得许多环境的图像。 在一些图像中,环境中包括的对象的一部分可能被环境中的另一对象遮挡。 在这些图像中,对象的遮挡部分的特征可能不存在。 可以基于从先前图像生成的特征来估计不存在的特征,包括在先前图像中物体的遮挡部分未被遮挡的物体。 在一些情况下,可以基于与参考对象相关联的数据来估计缺席特征,所述参考对象对应于被遮挡对象,其中参考对象被包括在参考对象的目录中。