Signal-enhancing Beamforming in an Augmented Reality Environment
    2.
    发明申请
    Signal-enhancing Beamforming in an Augmented Reality Environment 有权
    增强现实环境中的信号增强波束形成

    公开(公告)号:US20120327115A1

    公开(公告)日:2012-12-27

    申请号:US13165620

    申请日:2011-06-21

    IPC分类号: G09G5/00

    摘要: An augmented reality environment allows interaction between virtual and real objects. Beamforming techniques are applied to signals acquired by an array of microphones to allow for simultaneous spatial tracking and signal acquisition from multiple users. Localization information such as from other sensors in the environment may be used to select a particular set of beamformer coefficients and resulting beampattern focused on a signal source. Alternately, a series of beampatterns may be used iteratively to localize the signal source in a computationally efficient fashion. The beamformer coefficients may be pre-computed.

    摘要翻译: 增强的现实环境允许虚拟和实际对象之间的交互。 波束形成技术应用于由麦克风阵列获取的信号,以允许来自多个用户的同时空间跟踪和信号采集。 可以使用诸如来自环境中的其他传感器的定位信息来选择波束形成器系数的特定集合,并且将聚焦在信号源上的所得到的波形图进行选择。 或者,可以迭代地使用一系列波形图来以计算有效的方式定位信号源。 波束形成系数可以被预先计算。

    Sound localization with artificial neural network
    3.
    发明授权
    Sound localization with artificial neural network 有权
    用人造神经网络进行声音定位

    公开(公告)号:US08676728B1

    公开(公告)日:2014-03-18

    申请号:US13076201

    申请日:2011-03-30

    IPC分类号: G06F15/18

    摘要: The location of a sound within a given spatial volume may be used in applications such as augmented reality environments. An artificial neural network processes time-difference-of-arrival data (TDOA) from a known microphone array to determine a spatial location of the sound. The neural network may be located locally or available as a cloud service. The artificial neural network is trained with perturbed and non-perturbed TDOA data.

    摘要翻译: 给定空间体积内的声音的位置可以用于诸如增强现实环境的应用中。 人造神经网络处理来自已知麦克风阵列的时差差数据(TDOA)以确定声音的空间位置。 神经网络可以位于本地或可用作云服务。 人工神经网络用扰动和非扰动TDOA数据训练。

    Providing user feedback in projection environments
    4.
    发明授权
    Providing user feedback in projection environments 有权
    在投影环境中提供用户反馈

    公开(公告)号:US08887043B1

    公开(公告)日:2014-11-11

    申请号:US13351983

    申请日:2012-01-17

    CPC分类号: G06F3/017 G06F3/0304

    摘要: Systems and techniques for providing feedback to users within an environment that interact with user interfaces (UIs) that are projected within the environment. For instance, the systems and techniques may project a UI that includes one or more selectable portions, such as keys, icons, sliders, dials, or any other type of control. After projecting the UI, the systems and techniques may identify the user attempting to interact with the UI. In response, the systems and techniques may provide feedback to the user indicating that the user has engaged the UI. For instance, the systems and techniques may visually alter the projected UI, may output a sound via one or more speakers within the environment, or may provide the feedback in any other manner.

    摘要翻译: 在与环境中预测的用户界面(UI)交互的环境中向用户提供反馈的系统和技术。 例如,系统和技术可以投影包括一个或多个可选部分的UI,例如键,图标,滑块,拨盘或任何其他类型的控制。 在投影UI之后,系统和技术可以标识尝试与UI交互的用户。 作为响应,系统和技术可以向用户提供指示用户已经接合UI的反馈。 例如,系统和技术可以在视觉上改变投影的UI,可以通过环境中的一个或多个扬声器输出声音,或者可以以任何其它方式提供反馈。

    Calibrating devices by selecting images having a target having fiducial features
    6.
    发明授权
    Calibrating devices by selecting images having a target having fiducial features 有权
    通过选择具有基准特征的目标的图像来校准设备

    公开(公告)号:US09338447B1

    公开(公告)日:2016-05-10

    申请号:US13419750

    申请日:2012-03-14

    IPC分类号: H04N17/02

    摘要: Devices and techniques are described for automatically calibrating a device such as a camera, projector, or both using a video stream. The device undergoing calibration is coupled to a computing device and configured to acquire video comprising a plurality of images. These images, at least some of the time, include targets having known characteristics present in an environment. From these acquired images calibration data comprising parameters such as intrinsic parameters, extrinsic parameters, or both, may be determined. The calibration data may be embedded or otherwise associated with the video stream as calibration matrix metadata.

    摘要翻译: 描述了使用视频流自动校准诸如相机,投影仪或两者的装置的装置和技术。 正在进行校准的设备被耦合到计算设备并且被配置为获取包括多个图像的视频。 这些图像至少在某些时候包括在环境中存在已知特征的目标。 从这些获取的图像可以确定包括诸如固有参数,外在参数或两者之类的参数的校准数据。 校准数据可以嵌入或以视频流的形式与校准矩阵元数据相关联。

    Sound source localization using multiple microphone arrays
    9.
    发明授权
    Sound source localization using multiple microphone arrays 有权
    使用多个麦克风阵列的声源定位

    公开(公告)号:US08983089B1

    公开(公告)日:2015-03-17

    申请号:US13305189

    申请日:2011-11-28

    IPC分类号: H04R3/00 H04R29/00

    摘要: An augmented reality environment allows interaction between virtual and real objects. Multiple microphone arrays of different physical sizes are used to acquire signals for spatial tracking of one or more sound sources within the environment. A first array with a larger size may be used to track an object beyond a threshold distance, while a second array having a size smaller than the first may be used to track the object up to the threshold distance. By selecting different sized arrays, accuracy of the spatial location is improved.

    摘要翻译: 增强的现实环境允许虚拟和实际对象之间的交互。 使用不同物理尺寸的多个麦克风阵列来获取用于环境内的一个或多个声源的空间跟踪的信号。 可以使用具有较大尺寸的第一阵列来跟踪超过阈值距离的对象,而具有小于第一尺寸的尺寸的第二阵列可以用于跟踪该物体直到阈值距离。 通过选择不同大小的阵列,提高了空间位置的准确性。