公开(公告)号：US07254241B2

公开(公告)日：2007-08-07

申请号：US11190241

申请日：2005-07-26

Applicant: Yong Rui ,  Dinei Florencio

Inventor： Yong Rui ,  Dinei Florencio

IPC: H04R3/00

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02165

Abstract: A system and process for finding the location of a sound source using direct approaches having weighting factors that mitigate the effect of both correlated and reverberation noise is presented. When more than two microphones are used, the traditional time-delay-of-arrival (TDOA) based sound source localization (SSL) approach involves two steps. The first step computes TDOA for each microphone pair, and the second step combines these estimates. This two-step process discards relevant information in the first step, thus degrading the SSL accuracy and robustness. In the present invention, direct, one-step, approaches are employed. Namely, a one-step TDOA SSL approach and a steered beam (SB) SSL approach are employed. Each of these approaches provides an accuracy and robustness not available with the traditional two-step approaches.

Abstract translation: 提出了使用具有减轻相关和混响噪声的影响的加权因子的直接方法来发现声源的位置的系统和过程。 当使用两个以上的麦克风时，传统的基于时间延迟（TDOA）的声源定位（SSL）方法涉及两个步骤。 第一步计算每个麦克风对的TDOA，第二步合并这些估计。 这两步过程在第一步中丢弃相关信息，从而降低了SSL的准确性和鲁棒性。 在本发明中，采用直接的一步法。 也就是说，采用一步式TDOA SSL方法和转向束（SB）SSL方法。 这些方法中的每一种提供了传统的两步方法不可用的精度和鲁棒性。

公开(公告)号：US07151843B2

公开(公告)日：2006-12-19

申请号：US11042015

申请日：2005-01-25

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06K9/00 ,  H04N7/14 ,  H04N5/225

CPC classification number: G06K9/00234 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30201

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

公开(公告)号：US20060227977A1

公开(公告)日：2006-10-12

申请号：US11190241

申请日：2005-07-26

Applicant: Yong Rui ,  Dinei Florencio

Inventor： Yong Rui ,  Dinei Florencio

IPC: H04R5/00

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02165

Abstract: A system and process for finding the location of a sound source using direct approaches having weighting factors that mitigate the effect of both correlated and reverberation noise is presented. When more than two microphones are used, the traditional time-delay-of-arrival (TDOA) based sound source localization (SSL) approach involves two steps. The first step computes TDOA for each microphone pair, and the second step combines these estimates. This two-step process discards relevant information in the first step, thus degrading the SSL accuracy and robustness. In the present invention, direct, one-step, approaches are employed. Namely, a one-step TDOA SSL approach and a steered beam (SB) SSL approach are employed. Each of these approaches provides an accuracy and robustness not available with the traditional two-step approaches.

公开(公告)号：US06999599B2

公开(公告)日：2006-02-14

申请号：US10164947

申请日：2002-06-07

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06K9/00

CPC classification number: G06K9/00234 ,  G06K9/3216 ,  G06K9/6207 ,  G06T7/251 ,  G06T7/277 ,  G06T2207/10016 ,  G06T2207/30201

Abstract: A system and method for object tracking using probabilistic mode-based multi-hypothesis tracking (MHT) provides for robust and computationally efficient tracking of moving objects such as heads and faces in complex environments. A mode-based multi-hypothesis tracker uses modes that are local maximums which are refined from initial samples in a parametric state space. Because the modes are highly representative, the mode-based multi-hypothesis tracker effectively models non-linear probabilistic distributions using a small number of hypotheses. Real-time tracking performance is achieved by using a parametric causal contour model to refine initial contours to nearby modes. In addition, one common drawback of conventional MHT schemes, i.e., producing only maximum likelihood estimates instead of a desired posterior probability distribution, is addressed by introducing an importance sampling framework into MHT, and estimating the posterior probability distribution from the importance function.

公开(公告)号：US20050265562A1

公开(公告)日：2005-12-01

申请号：US11182142

申请日：2005-07-15

Applicant: Yong Rui

Inventor： Yong Rui

IPC: G10L25/93 ,  H04R3/00 ,  G10L11/06

CPC classification number: H04R3/005 ,  H04R2201/401

Abstract: A system and process is described for estimating the location of a speaker using signals output by a microphone array characterized by multiple pairs of audio sensors. The location of a speaker is estimated by first determining whether the signal data contains human speech components and filtering out noise attributable to stationary sources. The location of the person speaking is then estimated using a time-delay-of-arrival based SSL technique on those parts of the data determined to contain human speech components. A consensus location for the speaker is computed from the individual location estimates associated with each pair of microphone array audio sensors taking into consideration the uncertainty of each estimate. A final consensus location is also computed from the individual consensus locations computed over a prescribed number of sampling periods using a temporal filtering technique.

Abstract translation: 描述了一种系统和过程，用于使用由多对音频传感器表征的麦克风阵列输出的信号来估计扬声器的位置。 通过首先确定信号数据是否包含人类语音分量并滤除归因于固定源的噪声来估计扬声器的位置。 然后，使用基于时间延迟的SSL技术来估计说话人的位置，以确定包含人类语音组件的数据的那些部分。 考虑到每个估计的不确定性，从与每对麦克风阵列音频传感器相关联的各个位置估计计算扬声器的共识位置。 还可以使用时间滤波技术从在规定数量的采样周期上计算的单个共识位置计算最终共识位置。

公开(公告)号：US20050114079A1

公开(公告)日：2005-05-26

申请号：US10985243

申请日：2004-11-10

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06T7/20 ,  G10L21/02 ,  G01S13/00

CPC classification number: G06T7/277 ,  G10L2021/02166

Abstract: A system and process for tracking an object state over time using particle filter sensor fusion and a plurality of logical sensor modules is presented. This new fusion framework combines both the bottom-up and top-down approaches to sensor fusion to probabilistically fuse multiple sensing modalities. At the lower level, individual vision and audio trackers can be designed to generate effective proposals for the fuser. At the higher level, the fuser performs reliable tracking by verifying hypotheses over multiple likelihood models from multiple cues. Different from the traditional fusion algorithms, the present framework is a closed-loop system where the fuser and trackers coordinate their tracking information. Furthermore, to handle non-stationary situations, the present framework evaluates the performance of the individual trackers and dynamically updates their object states. A real-time speaker tracking system based on the proposed framework is feasible by fusing object contour, color and sound source location.

Abstract translation: 提出了一种使用粒子滤波器传感器融合和多个逻辑传感器模块跟踪物体状态随时间变化的系统和过程。 这种新的融合框架将自下而上和自顶向下的方法与传感器融合相结合，以概率地融合多种感测模式。 在较低级别，个人视觉和音频跟踪器可以设计用于为定影器生成有效的建议。 在较高级别，定影器通过从多个线索的多个似然模型上验证假设来执行可靠的跟踪。 与传统融合算法不同，本框架是闭环系统，其中定影器和跟踪器协调其跟踪信息。 此外，为了处理非平稳情况，本框架评估各个跟踪器的性能并动态更新其对象状态。 基于提出的框架的实时扬声器跟踪系统可以通过融合对象轮廓，颜色和声源位置来实现。

公开(公告)号：US08817645B2

公开(公告)日：2014-08-26

申请号：US13300027

申请日：2011-11-18

Applicant: Yong Rui ,  Andres Vega-Garcia

Inventor： Yong Rui ,  Andres Vega-Garcia

IPC: H04L12/26

CPC classification number: H04L43/0882 ,  H04L43/022 ,  H04L43/045 ,  H04L43/0852

Abstract: Estimation of available bandwidth on a network uses packet pairs and spatially filtering. Packet pairs are transmitted over the network. The dispersion of the packet pairs is used to generate samples of the available bandwidth, which are then classified into bins to generate a histogram. The bins can have uniform bin widths, and the histogram data can be aged so that older samples are given less weight in the estimation. The histogram data is then spatially filtered. Kernel density algorithms can be used to spatially filter the histogram data. The network available bandwidth is estimated using the spatially filtered histogram data. Alternatively, the spatially filtered histogram data can be temporally filtered before the available bandwidth is estimated.

Abstract translation: 网络上可用带宽的估计使用数据包对和空间过滤。 分组对通过网络传输。 分组对的分散被用于生成可用带宽的样本，然后将其分类为分组以生成直方图。 箱体可以具有统一的箱体宽度，并且直方图数据可以老化，以便在估计中给予较小的重量。 然后将直方图数据进行空间滤波。 内核密度算法可用于对直方图数据进行空间过滤。 使用空间滤波的直方图数据估计网络可用带宽。 或者，空间滤波的直方图数据可以在估计可用带宽之前进行时间滤波。

公开(公告)号：US08131086B2

公开(公告)日：2012-03-06

申请号：US12237298

申请日：2008-09-24

Applicant: Xian-Sheng Hua ,  Guo-Jun Qi ,  Yong Rui ,  Hong-Jiang Zhang

Inventor： Xian-Sheng Hua ,  Guo-Jun Qi ,  Yong Rui ,  Hong-Jiang Zhang

IPC: G06K9/68

CPC classification number: G06K9/469 ,  G06K9/6297

Abstract: Kernelized spatial-contextual image classification is disclosed. One embodiment comprises generating a first spatial-contextual model to represent a first image, the first spatial-contextual model having a plurality of interconnected nodes arranged in a first pattern of connections with each node connected to at least one other node, generating a second spatial-contextual model to represent a second image using the first pattern of connections, and estimating the distance between corresponding nodes in the first spatial-contextual model and the second spatial-contextual model based on a relationship with adjacent connected nodes to determine a distance between the first image and the second image.

Abstract translation: 公开了内核空间上下文图像分类。 一个实施例包括生成第一空间上下文模型以表示第一图像，第一空间上下文模型具有以与连接到至少一个其他节点的每个节点连接的第一连接方式布置的多个互连节点，产生第二空间 - 使用所述第一连接模式来表示第二图像，以及基于与相邻连接节点的关系来估计所述第一空间 - 上下文模型中的对应节点与所述第二空间 - 上下文模型之间的距离，以确定所述第二图像之间的距离 第一个图像和第二个图像。

公开(公告)号：US20110313766A1

公开(公告)日：2011-12-22

申请号：US13221640

申请日：2011-08-30

Applicant: Cha Zhang ,  Paul A. Viola ,  Pei Yin ,  Ross G. Cutler ,  Xinding Sun ,  Yong Rui

Inventor： Cha Zhang ,  Paul A. Viola ,  Pei Yin ,  Ross G. Cutler ,  Xinding Sun ,  Yong Rui

IPC: G10L17/00

CPC classification number: G06K9/6256 ,  G06K9/4614 ,  G10L25/78 ,  G10L2021/02166 ,  H04N7/147 ,  H04N7/15 ,  H04N21/42203 ,  H04N21/4223 ,  H04N21/4394 ,  H04N21/44008 ,  H04N21/44213 ,  H04N21/4788

Abstract: Systems and methods for detecting people or speakers in an automated fashion are disclosed. A pool of features including more than one type of input (like audio input and video input) may be identified and used with a learning algorithm to generate a classifier that identifies people or speakers. The resulting classifier may be evaluated to detect people or speakers.

Abstract translation: 公开了以自动方式检测人或扬声器的系统和方法。 可以识别包括多于一种类型的输入（例如音频输入和视频输入）的功能池，并与学习算法一起使用以生成识别人或扬声器的分类器。 可以评估所得分类器以检测人或扬声器。

公开(公告)号：US07996762B2

公开(公告)日：2011-08-09

申请号：US12030616

申请日：2008-02-13

Applicant: Guo-Jun Qi ,  Xian-Sheng Hua ,  Yong Rui ,  Hong-Jiang Zhang ,  Shipeng Li

Inventor： Guo-Jun Qi ,  Xian-Sheng Hua ,  Yong Rui ,  Hong-Jiang Zhang ,  Shipeng Li

IPC: G06F17/00

CPC classification number: G06F17/30799 ,  G06K9/00711

Abstract: Correlative multi-label image annotation may entail annotating an image by indicating respective labels for respective concepts. In an example embodiment, a classifier is to annotate an image by implementing a labeling function that maps an input feature space and a label space to a combination feature vector. The combination feature vector models both features of individual ones of the concepts and correlations among the concepts.

Abstract translation: 相关多标签图像注释可能需要通过针对相应概念指示相应的标签来注释图像。 在示例实施例中，分类器是通过实现将输入特征空间和标签空间映射到组合特征向量的标记功能来注释图像。 组合特征向量模拟各个概念的特征和概念之间的相关性。