公开(公告)号：US08219394B2

公开(公告)日：2012-07-10

申请号：US12690827

申请日：2010-01-20

申请人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

发明人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

IPC分类号： G10L11/00 ,  G10L21/02 ,  G10L21/00

CPC分类号： H04S3/008 ,  G10L21/0208 ,  G10L21/0272 ,  G10L2021/02085 ,  G10L2021/02166

摘要： A device for suppressing ambient sounds from speech received by a microphone array is provided. One embodiment of the device comprises a microphone array, a processor, an analog-to-digital converter, and memory comprising instructions stored therein that are executable by the processor. The instructions stored in the memory are configured to receive a plurality of digital sound signals, each digital sound signal based on an analog sound signal originating at the microphone array, receive a multi-channel speaker signal, generate a monophonic approximation signal of the multi-channel speaker signal, apply a linear acoustic echo canceller to suppress a first ambient sound portion of each digital sound signal, generate a combined directionally-adaptive sound signal from a combination of each digital sound signal by a combination of time-invariant and adaptive beamforming techniques, and apply one or more nonlinear noise suppression techniques to suppress a second ambient sound portion of the combined directionally-adaptive sound signal.

摘要翻译： 提供了一种用于抑制由麦克风阵列接收的语音的环境声音的装置。 该设备的一个实施例包括麦克风阵列，处理器，模数转换器和包含可由处理器执行的存储在其中的指令的存储器。 存储在存储器中的指令被配置为接收多个数字声音信号，基于源自麦克风阵列的模拟声音信号的每个数字声音信号接收多声道扬声器信号，产生多声道扬声器信号的单声道近似信号， 应用线性声学回声消除器来抑制每个数字声音信号的第一环境声音部分，通过时不变和自适应波束成形技术的组合从每个数字声音信号的组合产生组合的定向自适应声音信号 并且应用一个或多个非线性噪声抑制技术来抑制组合的定向自适应声音信号的第二环境声音部分。

公开(公告)号：US20110178798A1

公开(公告)日：2011-07-21

申请号：US12690827

申请日：2010-01-20

申请人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

发明人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

IPC分类号： G10L21/02

CPC分类号： H04S3/008 ,  G10L21/0208 ,  G10L21/0272 ,  G10L2021/02085 ,  G10L2021/02166

摘要： A device for suppressing ambient sounds from speech received by a microphone array is provided. One embodiment of the device comprises a microphone array, a processor, an analog-to-digital converter, and memory comprising instructions stored therein that are executable by the processor. The instructions stored in the memory are configured to receive a plurality of digital sound signals, each digital sound signal based on an analog sound signal originating at the microphone array, receive a multi-channel speaker signal, generate a monophonic approximation signal of the multi-channel speaker signal, apply a linear acoustic echo canceller to suppress a first ambient sound portion of each digital sound signal, generate a combined directionally-adaptive sound signal from a combination of each digital sound signal by a combination of time-invariant and adaptive beamforming techniques, and apply one or more nonlinear noise suppression techniques to suppress a second ambient sound portion of the combined directionally-adaptive sound signal.

摘要翻译： 提供了一种用于抑制由麦克风阵列接收的语音的环境声音的装置。 该设备的一个实施例包括麦克风阵列，处理器，模数转换器和包含可由处理器执行的存储在其中的指令的存储器。 存储在存储器中的指令被配置为接收多个数字声音信号，基于源自麦克风阵列的模拟声音信号的每个数字声音信号，接收多声道扬声器信号，产生多声道扬声器信号的单声道近似信号， 应用线性声学回声消除器来抑制每个数字声音信号的第一环境声音部分，通过时不变和自适应波束成形技术的组合从每个数字声音信号的组合产生组合的定向自适应声音信号 并且应用一个或多个非线性噪声抑制技术来抑制组合的定向自适应声音信号的第二环境声音部分。

公开(公告)号：US20120245933A1

公开(公告)日：2012-09-27

申请号：US13491952

申请日：2012-06-08

申请人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

发明人： Jason Flaks ,  Ivan Tashev ,  Duncan McKay ,  Xudong Ni ,  Robert Heitkamp ,  Wei Guo ,  John Tardif ,  Leo Shing ,  Michael Baseflug

IPC分类号： G10L15/20 ,  H04B15/00 ,  H04R3/00 ,  H03G3/20 ,  H04R5/00 ,  H04B3/20

CPC分类号： H04S3/008 ,  G10L21/0208 ,  G10L21/0272 ,  G10L2021/02085 ,  G10L2021/02166

摘要： A device for suppressing ambient sounds from speech received by a microphone array is provided. One embodiment of the device comprises a microphone array, a processor, an analog-to-digital converter, and memory comprising instructions stored therein that are executable by the processor. The instructions stored in the memory are configured to receive a plurality of digital sound signals, each digital sound signal based on an analog sound signal originating at the microphone array, receive a multi-channel speaker signal, generate a monophonic approximation signal of the multi-channel speaker signal, apply a linear acoustic echo canceller to suppress a first ambient sound portion of each digital sound signal, generate a combined directionally-adaptive sound signal from a combination of each digital sound signal by a combination of time-invariant and adaptive beamforming techniques, and apply one or more nonlinear noise suppression techniques to suppress a second ambient sound portion of the combined directionally-adaptive sound signal.

摘要翻译： 提供了一种用于抑制由麦克风阵列接收的语音的环境声音的装置。 该设备的一个实施例包括麦克风阵列，处理器，模数转换器和包含可由处理器执行的存储在其中的指令的存储器。 存储在存储器中的指令被配置为接收多个数字声音信号，基于源自麦克风阵列的模拟声音信号的每个数字声音信号，接收多声道扬声器信号，产生多声道扬声器信号的单声道近似信号， 应用线性声学回声消除器来抑制每个数字声音信号的第一环境声音部分，通过时间不变和自适应波束成形技术的组合从每个数字声音信号的组合产生组合的定向自适应声音信号 并且应用一个或多个非线性噪声抑制技术来抑制组合的定向自适应声音信号的第二环境声音部分。

公开(公告)号：US20120093320A1

公开(公告)日：2012-04-19

申请号：US12903610

申请日：2010-10-13

申请人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

发明人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

IPC分类号： H04R5/00

CPC分类号： H04S7/304 ,  A63F13/213 ,  A63F13/54 ,  A63F2300/1012 ,  A63F2300/6081 ,  H04R27/00 ,  H04R2227/003 ,  H04S7/301 ,  H04S2400/11 ,  H04S2420/01

摘要： Techniques are provided for providing 3D audio, which may be used in augmented reality. A 3D audio signal may be generated based on sensor data collected from the actual room in which the listener is located and the actual position of the listener in the room. The 3D audio signal may include a number of components that are determined based on the collected sensor data and the listener's location. For example, a number of (virtual) sound paths between a virtual sound source and the listener may be determined The sensor data may be used to estimate materials in the room, such that the affect that those materials would have on sound as it travels along the paths can be determined In some embodiments, sensor data may be used to collect physical characteristics of the listener such that a suitable HRTF may be determined from a library of HRTFs.

摘要翻译： 提供了用于提供3D音频的技术，其可以用于增强现实。 可以基于从听众所在的实际房间收集的传感器数据和在房间中的听众的实际位置来生成3D音频信号。 3D音频信号可以包括基于收集的传感器数据和收听者的位置确定的多个组件。 例如，可以确定虚拟声源和收听者之间的多个（虚拟）声音路径。传感器数据可以用于估计房间中的材料，使得这些材料在行进时对声音的影响 可以确定路径。在一些实施例中，可以使用传感器数据来收集听众的物理特征，使得可以从HRTF库确定合适的HRTF。

公开(公告)号：US08767968B2

公开(公告)日：2014-07-01

申请号：US12903610

申请日：2010-10-13

申请人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

发明人： Jason Flaks ,  Avi Bar-Zeev ,  John Tardif

IPC分类号： H04R5/00 ,  H04R5/02 ,  G09G5/00

CPC分类号： H04S7/304 ,  A63F13/213 ,  A63F13/54 ,  A63F2300/1012 ,  A63F2300/6081 ,  H04R27/00 ,  H04R2227/003 ,  H04S7/301 ,  H04S2400/11 ,  H04S2420/01

摘要： Techniques are provided for providing 3D audio, which may be used in augmented reality. A 3D audio signal may be generated based on sensor data collected from the actual room in which the listener is located and the actual position of the listener in the room. The 3D audio signal may include a number of components that are determined based on the collected sensor data and the listener's location. For example, a number of (virtual) sound paths between a virtual sound source and the listener may be determined. The sensor data may be used to estimate materials in the room, such that the affect that those materials would have on sound as it travels along the paths can be determined. In some embodiments, sensor data may be used to collect physical characteristics of the listener such that a suitable HRTF may be determined from a library of HRTFs.

摘要翻译： 提供了用于提供3D音频的技术，其可以用于增强现实。 可以基于从听众所在的实际房间收集的传感器数据和在房间中的听众的实际位置来生成3D音频信号。 3D音频信号可以包括基于收集的传感器数据和收听者的位置确定的多个组件。 例如，可以确定虚拟声音源和收听者之间的多个（虚拟）声音路径。 可以使用传感器数据来估计房间中的材料，从而可以确定这些材料沿着路径行进时对声音的影响。 在一些实施例中，可以使用传感器数据来收集听众的物理特征，使得可以从HRTF库确定合适的HRTF。

公开(公告)号：US08988463B2

公开(公告)日：2015-03-24

申请号：US12963547

申请日：2010-12-08

申请人： Kathryn Stone Perez ,  Alex Aben-Athar Kipman ,  Andrew Fuller ,  Philip Greenhalgh ,  David Hayes ,  John Tardif

发明人： Kathryn Stone Perez ,  Alex Aben-Athar Kipman ,  Andrew Fuller ,  Philip Greenhalgh ,  David Hayes ,  John Tardif

IPC分类号： G09G5/00 ,  G02B27/01 ,  G06T19/00 ,  G09G5/377 ,  G02B23/12

CPC分类号： G02B27/0172 ,  G02B2027/0127 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06T19/006 ,  G09G5/377

摘要： A method for overlaying first and second images in a common focal plane of a viewer comprises forming the first image and guiding the first and second images along an axis to a pupil of the viewer. The method further comprises adjustably diverging the first and second images at an adaptive diverging optic to bring the first image into focus at the common focal plane, and, adjustably converging the second image at an adaptive converging optic to bring the second image into focus at the common focal plane.

摘要翻译： 用于将第一和第二图像重叠在观看者的公共焦平面中的方法包括形成第一图像并沿着轴将第一和第二图像引导至观看者的瞳孔。 该方法还包括在自适应发散光学器件处可调节地分散第一和第二图像以使第一图像在公共焦平面处聚焦，并且可调节地将自适应会聚光学器件上的第二图像会聚，以使第二图像在 共同焦平面。

公开(公告)号：US20110298967A1

公开(公告)日：2011-12-08

申请号：US12794406

申请日：2010-06-04

申请人： John Clavin ,  John Tardif

发明人： John Clavin ,  John Tardif

IPC分类号： H04N5/225 ,  H02J4/00

CPC分类号： H04N21/4223 ,  G06F1/3231 ,  H04N21/42203 ,  H04N21/44218 ,  H04N21/4436 ,  Y02D10/173

摘要： A processor-implemented method, system and computer readable medium for intelligently controlling the power level of an electronic device in a multimedia system based on user intent, is provided. The method includes receiving data relating to a first user interaction with a device in a multimedia system. The method includes determining if the first user interaction corresponds to a user's intent to interact with the device. The method then includes setting a power level for the device based on the first user interaction. The method further includes receiving data relating to a second user interaction with the device. The method then includes altering the power level of the device based on the second user interaction to activate the device for the user.

摘要翻译： 提供了一种用于基于用户意图来智能地控制多媒体系统中的电子设备的功率电平的处理器实现的方法，系统和计算机可读介质。 该方法包括接收与多媒体系统中的设备的第一用户交互相关的数据。 该方法包括确定第一用户交互是否对应于用户与设备交互的意图。 该方法然后包括基于第一用户交互来设置设备的功率级别。 所述方法还包括接收与所述设备的第二用户交互相关的数据。 该方法然后包括基于第二用户交互来改变设备的功率级别以激活用户的设备。

公开(公告)号：US20110234756A1

公开(公告)日：2011-09-29

申请号：US12732918

申请日：2010-03-26

申请人： Avishai Adler ,  Sagi Katz ,  Guy Gilboa ,  John Tardif

发明人： Avishai Adler ,  Sagi Katz ,  Guy Gilboa ,  John Tardif

IPC分类号： H04N13/02 ,  G06K9/00

CPC分类号： G06T5/002 ,  G06T2207/10028

摘要： Techniques are provided for de-aliasing depth images. The depth image may have been generated based on phase differences between a transmitted and received modulated light beam. A method may include accessing a depth image that has a depth value for a plurality of locations in the depth image. Each location has one or more neighbor locations. Potential depth values are determined for each of the plurality of locations based on the depth value in the depth image for the location and potential aliasing in the depth image. A cost function is determined based on differences between the potential depth values of each location and its neighboring locations. Determining the cost function includes assigning a higher cost for greater differences in potential depth values between neighboring locations. The cost function is substantially minimized to select one of the potential depth values for each of the locations.

摘要翻译： 提供了去锯齿深度图像的技术。 可以基于发送和接收的调制光束之间的相位差来生成深度图像。 一种方法可以包括访问具有深度图像中的多个位置的深度值的深度图像。 每个位置都有一个或多个邻居位置。 基于深度图像中的深度图像中的深度值和深度图像中的潜在混叠，为每个多个位置确定潜在深度值。 基于每个位置的潜在深度值与其相邻位置之间的差异来确定成本函数。 确定成本函数包括为相邻位置之间的潜在深度值的更大差异分配更高的成本。 成本函数基本上被最小化以选择每个位置的潜在深度值之一。

公开(公告)号：US20060028393A1

公开(公告)日：2006-02-09

申请号：US11244122

申请日：2005-10-05

申请人： Michael Love ,  John Tardif ,  Jack Scheuer ,  Louis Coffin

发明人： Michael Love ,  John Tardif ,  Jack Scheuer ,  Louis Coffin

IPC分类号： G09G5/00

CPC分类号： G06F3/1423 ,  A63F2300/203 ,  A63F2300/30 ,  A63F2300/301 ,  A63F2300/66 ,  A63F2300/8082 ,  A63F2300/8088 ,  G06F3/1454

摘要： In an implementation of a display source divider, a video generation system generates a video display source that includes display data for multiple display regions on a display device. For example, a gaming system generates a video display source that includes display data partitioned display, where each region of the partitioned display corresponds to a different player of the gaming system. A display source divider receives the video display source and generates multiple video streams each corresponding to a different display region of the partitioned display.

公开(公告)号：US20060017847A1

公开(公告)日：2006-01-26

申请号：US10897278

申请日：2004-07-22

申请人： John Tardif

发明人： John Tardif

IPC分类号： H03L7/00

CPC分类号： H04N5/06 ,  G09G5/12 ,  G09G5/18 ,  G09G2360/02 ,  G09G2370/04 ,  H04N5/04 ,  H04N5/126 ,  H04N5/14 ,  H04N9/641

摘要： When playing back audio/video streams, many playback devices try to recreate the audio and video clocks used for encoding. One means typically employed to recreate such clocks includes the use of a Phased Locked Loop (PLL) circuit. The audio and video should remain synchronized. However, many reasonable cost PLLs cannot recreate the exact video clock used for encoding. The synchronization of the video to the audio can be resolved by adjusting one or more of the dimensions (or other variables) that define the video being recreated. Changing the dimensions (or other variables) of the video allows for an adjustment of the output frequency of the PLL to a value that can be implemented.

摘要翻译： 当播放音频/视频流时，许多播放设备尝试重新创建用于编码的音频和视频时钟。 通常用于重建这样的时钟的一种方式包括使用分相锁定环路（PLL）电路。 音频和视频应保持同步。 然而，许多合理的成本PLL无法重现用于编码的精确视频时钟。 可以通过调整定义正在重新创建的视频的维度（或其他变量）中的一个或多个来解决视频与音频的同步。 更改视频的尺寸（或其他变量）可以将PLL的输出频率调整为可实现的值。