公开(公告)号：US07039199B2

公开(公告)日：2006-05-02

申请号：US10228210

申请日：2002-08-26

Applicant: Yong Rui

Inventor： Yong Rui

IPC: H04R3/00 ,  H04N5/232 ,  H04N7/14

CPC classification number: H04R3/005 ,  H04R2201/401

Abstract: A system and process is described for estimating the location of a speaker using signals output by a microphone array characterized by multiple pairs of audio sensors. The location of a speaker is estimated by first determining whether the signal data contains human speech components and filtering out noise attributable to stationary sources. The location of the person speaking is then estimated using a time-delay-of-arrival based SSL technique on those parts of the data determined to contain human speech components. A consensus location for the speaker is computed from the individual location estimates associated with each pair of microphone array audio sensors taking into consideration the uncertainty of each estimate. A final consensus location is also computed from the individual consensus locations computed over a prescribed number of sampling periods using a temporal filtering technique.

Abstract translation: 描述了一种系统和过程，用于使用由多对音频传感器表征的麦克风阵列输出的信号来估计扬声器的位置。 通过首先确定信号数据是否包含人类语音分量并滤除归因于固定源的噪声来估计扬声器的位置。 然后使用基于时间延迟的SSL技术来估计说话人的位置，以确定包含人类语音组件的数据的那些部分。 考虑到每个估计的不确定性，从与每对麦克风阵列音频传感器相关联的各个位置估计计算扬声器的共识位置。 还可以使用时间滤波技术从在规定数量的采样周期上计算的单个共识位置计算最终共识位置。

公开(公告)号：US07035764B2

公开(公告)日：2006-04-25

申请号：US10985243

申请日：2004-11-10

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06F17/18 ,  G06F15/18 ,  G06F9/445

CPC classification number: G06T7/277 ,  G10L2021/02166

Abstract: A system and process for tracking an object state over time using particle filter sensor fusion and a plurality of logical sensor modules is presented. This new fusion framework combines both the bottom-up and top-down approaches to sensor fusion to probabilistically fuse multiple sensing modalities. At the lower level, individual vision and audio trackers can be designed to generate effective proposals for the fuser. At the higher level, the fuser performs reliable tracking by verifying hypotheses over multiple likelihood models from multiple cues. Different from the traditional fusion algorithms, the present framework is a closed-loop system where the fuser and trackers coordinate their tracking information. Furthermore, to handle non-stationary situations, the present framework evaluates the performance of the individual trackers and dynamically updates their object states. A real-time speaker tracking system based on the proposed framework is feasible by fusing object contour, color and sound source location.

Abstract translation: 提出了一种使用粒子滤波器传感器融合和多个逻辑传感器模块跟踪物体状态随时间变化的系统和过程。 这种新的融合框架将自下而上和自顶向下的方法与传感器融合相结合，以概率地融合多种感测模式。 在较低级别，个人视觉和音频跟踪器可以设计用于为定影器生成有效的建议。 在较高级别，定影器通过从多个线索的多个似然模型中验证假设来执行可靠的跟踪。 与传统融合算法不同，本框架是闭环系统，其中定影器和跟踪器协调其跟踪信息。 此外，为了处理非平稳情况，本框架评估各个跟踪器的性能并动态更新其对象状态。 基于提出的框架的实时扬声器跟踪系统可以通过融合对象轮廓，颜色和声源位置来实现。

公开(公告)号：US06999593B2

公开(公告)日：2006-02-14

申请号：US10446924

申请日：2003-05-28

Applicant: Yong Rui ,  Dinei A. Florencio

Inventor： Yong Rui ,  Dinei A. Florencio

IPC: H04R3/00 ,  H04N7/14

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02165

Abstract: A system and process for finding the location of a sound source using direct approaches having weighting factors that mitigate the effect of both correlated and reverberation noise is presented. When more than two microphones are used, the traditional time-delay-of-arrival (TDOA) based sound source localization (SSL) approach involves two steps. The first step computes TDOA for each microphone pair, and the second step combines these estimates. This two-step process discards relevant information in the first step, thus degrading the SSL accuracy and robustness. In the present invention, direct, one-step, approaches are employed. Namely, a one-step TDOA SSL approach and a steered beam (SB) SSL approach are employed. Each of these approaches provides an accuracy and robustness not available with the traditional two-step approaches.

公开(公告)号：US20060005136A1

公开(公告)日：2006-01-05

申请号：US10883123

申请日：2004-06-30

Applicant: Michael Wallick ,  Yong Rui ,  Li-wei He

Inventor： Michael Wallick ,  Yong Rui ,  Li-wei He

IPC: H04N5/60

CPC classification number: H04M9/082

Abstract: A “virtual video studio”, as described herein, provides a highly portable real-time capability to automatically capture, record, and edit a plurality of video streams of a presentation, such as, for example, a speech, lecture, seminar, classroom instruction, talk-show, teleconference, etc., along with any accompanying exhibits, such as a corresponding slide presentation, using a suite of one or more unmanned cameras controlled by a set of videography rules. The resulting video output may then either be stored for later use, or broadcast in real-time to a remote audience. This real-time capability is achieved by using an abstraction of “virtual cameramen” and physical cameras in combination with a scriptable interface to the aforementioned videography rules for capturing and editing the recorded video to create a composite video of the presentation in real-time under the control of a “virtual director.”

公开(公告)号：US20050249038A1

公开(公告)日：2005-11-10

申请号：US11182633

申请日：2005-07-14

Applicant: Yong Rui ,  Dinei Florencio

Inventor： Yong Rui ,  Dinei Florencio

IPC: H04R3/00 ,  G01S3/80

CPC classification number: H04R3/005 ,  H04R2430/23

Abstract: A system and process for estimating the time delay of arrival (TDOA) between a pair of audio sensors of a microphone array is presented. Generally, a generalized cross-correlation (GCC) technique is employed. However, this technique is improved to include provisions for both reducing the influence (including interference) from correlated ambient noise and reverberation noise in the sensor signals prior to computing the TDOA estimate. Two unique correlated ambient noise reduction procedures are also proposed. One involves the application of Wiener filtering, and the other a combination of Wiener filtering with a Gnn subtraction technique. In addition, two unique reverberation noise reduction procedures are proposed. Both involve applying a weighting factor to the signals prior to computing the TDOA which combines the effects of a traditional maximum likelihood (TML) weighting function and a phase transformation (PHAT) weighting function.

Abstract translation: 提出了一种用于估计麦克风阵列的一对音频传感器之间的到达时间延迟（TDOA）的系统和过程。 通常，采用广义互相关（GCC）技术。 然而，该技术被改进为包括在计算TDOA估计之前减少传感器信号中相关环境噪声和混响噪声的影响（包括干扰）的规定。 还提出了两个独特的相关环境降噪程序。 一个涉及Wiener滤波的应用，另一个涉及Wiener滤波与G>减法技术的组合。 另外还提​​出了两个独特的混响降噪程序。 两者都涉及在计算结合了传统最大似然（TML）加权函数和相变（PHAT）加权函数的效果的TDOA之前对信号应用加权因子。

公开(公告)号：US06937266B2

公开(公告)日：2005-08-30

申请号：US09681843

申请日：2001-06-14

Applicant: Yong Rui ,  Anoop Gupta ,  Johnathan J Cadiz ,  Ross Garrett Cutler

Inventor： Yong Rui ,  Anoop Gupta ,  Johnathan J Cadiz ,  Ross Garrett Cutler

IPC: H04N7/14 ,  H04N7/15

CPC classification number: H04N7/142 ,  H04N7/147 ,  H04N7/15

Abstract: An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

公开(公告)号：US20050129278A1

公开(公告)日：2005-06-16

申请号：US11042457

申请日：2005-01-25

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06T1/00 ,  G06K9/00 ,  G06T1/20 ,  G06T7/00 ,  G06T7/20 ,  H04N7/15 ,  H04N7/26 ,  G06K9/46

CPC classification number: G06K9/00234 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30201

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

公开(公告)号：US20050083849A1

公开(公告)日：2005-04-21

申请号：US10686160

申请日：2003-10-15

Applicant: Yong Rui ,  Andres Vega-Garcia

Inventor： Yong Rui ,  Andres Vega-Garcia

IPC: H04L12/26

CPC classification number: H04L43/0882 ,  H04L43/022 ,  H04L43/045 ,  H04L43/0852

Abstract: Estimation of available bandwidth on a network uses packet pairs and spatially filtering. Packet pairs are transmitted over the network. The dispersion of the packet pairs is used to generate samples of the available bandwidth, which are then classified into bins to generate a histogram. The bins can have uniform bin widths, and the histogram data can be aged so that older samples are given less weight in the estimation. The histogram data is then spatially filtered. Kernel density algorithms can be used to spatially filter the histogram data. The network available bandwidth is estimated using the spatially filtered histogram data. Alternatively, the spatially filtered histogram data can be temporally filtered before the available bandwidth is estimated.

Abstract translation: 网络上可用带宽的估计使用数据包对和空间过滤。 分组对通过网络传输。 分组对的分散被用于生成可用带宽的样本，然后将其分类为分组以生成直方图。 箱体可以具有统一的箱体宽度，并且直方图数据可以老化，以便在估计中给予较小的重量。 然后将直方图数据进行空间滤波。 内核密度算法可用于对直方图数据进行空间过滤。 使用空间滤波的直方图数据估计网络可用带宽。 或者，空间滤波的直方图数据可以在估计可用带宽之前进行时间滤波。

公开(公告)号：US20050065929A1

公开(公告)日：2005-03-24

申请号：US10973141

申请日：2004-10-26

Applicant: Yong Rui

Inventor： Yong Rui

IPC: G06F17/30

CPC classification number: G06K9/6253 ,  G06F17/30256 ,  G06K9/6215 ,  G06K9/6263 ,  Y10S707/99933 ,  Y10S707/99934 ,  Y10S707/99935 ,  Y10S707/99936 ,  Y10S707/99943 ,  Y10S707/99945 ,  Y10S707/99948

Abstract: An improved image retrieval process based on relevance feedback uses a hierarchical (per-feature) approach in comparing images. Multiple query vectors are generated for an initial image by extracting multiple low-level features from the initial image. When determining how closely a particular image in an image collection matches the initial image, a distance is calculated between the query vectors and corresponding low-level feature vectors extracted from the particular image. Once these individual distances are calculated, they are combined to generate an overall distance that represents how closely the two images match. According to other aspects, relevancy feedback received regarding previously retrieved images is used during the query vector generation and the distance determination to influence which images are subsequently retrieved.

Abstract translation: 基于相关性反馈的改进的图像检索过程在比较图像中使用分层（每特征）方法。 通过从初始图像中提取多个低级特征，为初始图像生成多个查询向量。 当确定图像集合中的特定图像与初始图像相匹配时，在从特定图像提取的查询向量和对应的低级特征向量之间计算距离。 一旦这些单独的距离被计算，它们被组合以产生表示两个图像匹配的距离。 根据其他方面，在查询向量生成期间使用关于先前检索到的图像的相关性反馈，并且距离确定以影响随后检索哪些图像。

公开(公告)号：US20120063347A1

公开(公告)日：2012-03-15

申请号：US13300027

申请日：2011-11-18

Applicant: Yong Rui ,  Andres Vega-Garcia

Inventor： Yong Rui ,  Andres Vega-Garcia

IPC: H04L12/26

CPC classification number: H04L43/0882 ,  H04L43/022 ,  H04L43/045 ,  H04L43/0852

Abstract: Estimation of available bandwidth on a network uses packet pairs and spatially filtering. Packet pairs are transmitted over the network. The dispersion of the packet pairs is used to generate samples of the available bandwidth, which are then classified into bins to generate a histogram. The bins can have uniform bin widths, and the histogram data can be aged so that older samples are given less weight in the estimation. The histogram data is then spatially filtered. Kernel density algorithms can be used to spatially filter the histogram data. The network available bandwidth is estimated using the spatially filtered histogram data. Alternatively, the spatially filtered histogram data can be temporally filtered before the available bandwidth is estimated.

Abstract translation: 网络上可用带宽的估计使用数据包对和空间过滤。 分组对通过网络传输。 分组对的分散被用于生成可用带宽的样本，然后将其分类为分组以生成直方图。 箱体可以具有统一的箱体宽度，并且直方图数据可以老化，以便在估计中给予较小的重量。 然后将直方图数据进行空间滤波。 内核密度算法可用于对直方图数据进行空间过滤。 使用空间滤波的直方图数据估计网络可用带宽。 或者，空间滤波的直方图数据可以在估计可用带宽之前进行时间滤波。