公开(公告)号：US07515172B2

公开(公告)日：2009-04-07

申请号：US11193702

申请日：2005-07-29

Applicant: Yong Rui ,  Anoop Gupta ,  Johnathan J. Cadiz ,  Ross Garrett Cutler

Inventor： Yong Rui ,  Anoop Gupta ,  Johnathan J. Cadiz ,  Ross Garrett Cutler

IPC: H04N7/14 ,  G06F3/00

CPC classification number: H04N7/142 ,  H04N7/147 ,  H04N7/15

Abstract: An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

公开(公告)号：US20090083010A1

公开(公告)日：2009-03-26

申请号：US12030616

申请日：2008-02-13

Applicant: Guo-Jun Qi ,  Xian-Sheng Hua ,  Yong Rui ,  Hong-Jiang Zhang ,  Shipeng Li

Inventor： Guo-Jun Qi ,  Xian-Sheng Hua ,  Yong Rui ,  Hong-Jiang Zhang ,  Shipeng Li

IPC: G06F17/10

CPC classification number: G06F17/30799 ,  G06K9/00711

Abstract: Correlative multi-label image annotation may entail annotating an image by indicating respective labels for respective concepts. In an example embodiment, a classifier is to annotate an image by implementing a labeling function that maps an input feature space and a label space to a combination feature vector. The combination feature vector models both features of individual ones of the concepts and correlations among the concepts.

Abstract translation: 相关多标签图像注释可能需要通过针对相应概念指示相应的标签来注释图像。 在示例实施例中，分类器是通过实现将输入特征空间和标签空间映射到组合特征向量的标记功能来注释图像。 组合特征向量模拟各个概念的特征和概念之间的相关性。

公开(公告)号：US07379848B2

公开(公告)日：2008-05-27

申请号：US11390895

申请日：2006-03-27

Applicant: Bin Yu ,  Yong Rui

Inventor： Bin Yu ,  Yong Rui

IPC: G21C17/00 ,  G06F11/30

CPC classification number: G06Q10/10

Abstract: An event-based system and process for recording and playback of collaborative electronic presentations is presented. The present system and process includes a technique for recording collaborative electronic presentations by capturing and storing the interactions between each participant and presentation data where each interaction event is timestamped and linked to a data file comprising the presentation data. The present system and process also includes a technique for playing back the recorded collaborative electronic presentation, which involves displaying the presentation data in an order it was originally presented and reproducing the recorded interactions between each participant and the displayed presentation data at the same point in the presentation that they were originally performed, based on the aforementioned timestamps.

Abstract translation: 介绍了一个基于事件的系统和进程，用于录制和回放协同电子演示文稿。 本系统和过程包括通过捕获和存储每个参与者与呈现数据之间的交互来记录协同电子呈现的技术，其中每个交互事件被加时间戳并链接到包括呈现数据的数据文件。 本系统和过程还包括一种用于回放记录的协同电子表现的技术，其涉及以原始呈现的顺序显示呈现数据，并且在相同的点处再现每个参与者和所显示的呈现数据之间的记录的交互 基于上述时间戳，他们最初执行的演示。

公开(公告)号：US20080005235A1

公开(公告)日：2008-01-03

申请号：US11428080

申请日：2006-06-30

Applicant: Rajesh Hegde ,  Prasun Dewan ,  Yong Rui

Inventor： Rajesh Hegde ,  Prasun Dewan ,  Yong Rui

IPC: G06F15/16

CPC classification number: H04L67/24 ,  G06Q10/10

Abstract: A system and process for providing a network and computer-based integrated development environment is presented that provides collaboration and information sharing for development project team members. Generally, this is accomplished by integrating a presence and activity awareness information module, a collaboration tools module, and a user interface into a single environment that is accessible over a distributed network and serves as a virtual development complex. The information module continuously collects, monitors and analyzes information about the presence of each team member and their activity in the project. The tools module provides a wide range of facilities for synchronous and asynchronous collaboration and information sharing between team members. Thus, all team members who use the virtual complex for their development work on the project can collaborate and interactively share required information regardless of their geographic and/or temporal disparity, and without having to leave the virtual development complex.

Abstract translation: 提供了一个提供网络和基于计算机的集成开发环境的系统和过程，为开发项目团队成员提供协作和信息共享。 通常，这是通过将存在和活动感知信息模块，协作工具模块和用户界面集成到可通过分布式网络访问并用作虚拟开发组合的单个环境中来实现的。 信息模块不断收集，监控和分析有关每个团队成员的存在及其在项目中的活动的信息。 工具模块为团队成员之间的同步和异步协作和信息共享提供了广泛的设施。 因此，使用虚拟复合体进行项目开发工作的所有团队成员都可以协作和交互地共享所需信息，而不管其地理和/或时间差异如何，而无需离开虚拟开发复杂。

公开(公告)号：US20070286520A1

公开(公告)日：2007-12-13

申请号：US11422693

申请日：2006-06-07

Applicant: Cha Zhang ,  Li-wei He ,  Yong Rui

Inventor： Cha Zhang ,  Li-wei He ,  Yong Rui

IPC: G06K9/40 ,  G06K9/34

CPC classification number: G06K9/00228 ,  H04N7/147

Abstract: Background blurring is an effective way to both preserve privacy and keep communication effective during video conferencing. The present image background blurring technique is a light weight real-time technique to perform background blurring using a fast background modeling procedure combined with an object (e.g., face) detector/tracker. A soft decision is made at each pixel whether it belongs to the foreground or the background based on multiple vision features. The classification results are mapped to a per-pixel blurring radius image to blur the background. In another embodiment, the image background blurring technique blurs the background of the image without using the object detector.

Abstract translation: 背景模糊是在视频会议中保持隐私和保持通信有效的有效方式。 目前的图像背景模糊技术是使用与对象（例如脸部）检测器/跟踪器组合的快速背景建模过程来执行背景模糊的轻量级实时技术。 基于多个视觉特征，在每个像素上做出软判决是否属于前景或背景。 分类结果映射到每像素模糊半径图像以模糊背景。 在另一个实施例中，图像背景模糊技术在不使用对象检测器的情况下模糊图像的背景。

公开(公告)号：US20070237099A1

公开(公告)日：2007-10-11

申请号：US11277905

申请日：2006-03-29

Applicant: Li-wei He ,  Dinei Florencio ,  Yong Rui

Inventor： Li-wei He ,  Dinei Florencio ,  Yong Rui

IPC: H04L12/16

CPC classification number: H04L12/1822 ,  H04L67/104 ,  H04L67/1061

Abstract: A decentralized computer network architecture and method that gathers metadata from local and remote clients and, based on that metadata, locally makes a decision whether to send a packet over the network. Each client listens to what other clients are doing, and only sends when the total number of concurrent speakers is below some threshold. In a multi-party voice conferencing embodiment, the threshold is a number of concurrent speakers that is restricted to less than a certain number. Under the decentralized computer network architecture, the type of network topology used to connect the clients is flexible, as long as each client is running a peer-aware system to decide locally whether to send their packets. The decentralized computer network architecture and method is distributed to run on each client, making it suitable for a wide variety of network topologies (such as full-mesh, bridge-based, or a hybrid of the two).

Abstract translation: 从本地和远程客户端收集元数据的分散计算机网络架构和方法，并且基于该元数据在本地做出是否通过网络发送分组的决定。 每个客户端监听其他客户端正在执行的操作，只有当并发扬声器的总数低于某个阈值时才发送。 在多方语音会议实施例中，阈值是限制在小于一定数量的并发扬声器的数量。 在分散式计算机网络架构下，用于连接客户端的网络拓扑的类型是灵活的，只要每个客户端都运行一个对等体感知系统来本地确定是否发送它们的数据包。 分布式计算机网络架构和方法分布在每个客户端上运行，使其适用于各种网络拓扑（如全网状，基于桥接或两者混合）。

公开(公告)号：US07231064B2

公开(公告)日：2007-06-12

申请号：US11282365

申请日：2005-11-17

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06K9/00

CPC classification number: G06K9/00234 ,  G06K9/3216 ,  G06K9/6207 ,  G06T7/251 ,  G06T7/277 ,  G06T2207/10016 ,  G06T2207/30201

Abstract: A system and method for object tracking using probabilistic mode-based multi-hypothesis tracking (MHT) provides for robust and computationally efficient tracking of moving objects such as heads and faces in complex environments. A mode-based multi-hypothesis tracker uses modes that are local maximums which are refined from initial samples in a parametric state space. Because the modes are highly representative, the mode-based multi-hypothesis tracker effectively models non-linear probabilistic distributions using a small number of hypotheses. Real-time tracking performance is achieved by using a parametric causal contour model to refine initial contours to nearby modes. In addition, one common drawback of conventional MHT schemes, i.e., producing only maximum likelihood estimates instead of a desired posterior probability distribution, is addressed by introducing an importance sampling framework into MHT, and estimating the posterior probability distribution from the importance function.

Abstract translation: 使用基于概率模式的多假设跟踪（MHT）的对象跟踪的系统和方法提供了在复杂环境中运动对象（例如头部和面部）的鲁棒和计算上有效的跟踪。 基于模式的多假设跟踪器使用在参数状态空间中从初始样本精化的局部最大值的模式。 由于模式具有很高的代表性，所以基于模式的多假设跟踪器使用少量假设来有效地建模非线性概率分布。 通过使用参数因果轮廓模型来将初始轮廓细化到附近模式，可以实现实时跟踪性能。 另外，常规MHT方案的一个共同缺点，即仅产生最大似然估计而不是期望的后验概率分布，通过将重要性采样框架引入到MHT中，并从重要性函数估计后验概率分布来解决。

公开(公告)号：US20070120979A1

公开(公告)日：2007-05-31

申请号：US11284496

申请日：2005-11-21

Applicant: Cha Zhang ,  Li-wei He ,  Yong Rui

Inventor： Cha Zhang ,  Li-wei He ,  Yong Rui

IPC: H04N7/18

CPC classification number: H04N7/185 ,  G08B13/19667 ,  H04N7/188

Abstract: A combined digital and mechanical tracking system and process for generating a video using a single digital video camera that tracks a person or object of interest moving in a scene is presented. This generally involves operating the camera at a higher resolution than is needed for the application, and cropping a sub-region out of the image captured that is output as the output video. The person or object being tracked is at least partially contained within the cropped sub-region. As the person or object moves within the field of view of the camera, the location of the cropped sub-region is also moved so as to keep the subject of interest within its boundaries. When the subject of interest moves to the boundary of the FOV of the camera, the camera is mechanically panned to keep the person or object inside its FOV.

Abstract translation: 呈现了组合的数字和机械跟踪系统和用于使用跟踪在场景中移动的感兴趣的对象的单个数字摄像机生成视频的过程。 这通常涉及以比应用所需要的更高的分辨率来操作相机，以及从作为输出视频输出的捕获的图像中剪切一个子区域。 被跟踪的人或物体至少部分地包含在裁剪的子区域内。 随着人或物体在照相机的视场内移动，裁剪的子区域的位置也被移动，以将感兴趣的对象保持在其边界内。 当感兴趣的主题移动到相机的FOV的边界时，相机被机械地平移以将人或物体保持在其FOV内。

公开(公告)号：US20060268101A1

公开(公告)日：2006-11-30

申请号：US11137252

申请日：2005-05-25

Applicant: Li-wei He ,  Michael Cohen ,  Yong Rui ,  Shinichi Manaka

Inventor： Li-wei He ,  Michael Cohen ,  Yong Rui ,  Shinichi Manaka

IPC: H04N7/14

CPC classification number: H04N7/147

Abstract: A method of digitally adding the appearance of makeup to a videoconferencing participant. The system and method for applying digital make-up operates in a loop processing sequential video frames. For each input frame, there are typically three general steps: 1) Locating the face and eye and mouth regions; 2) Applying digital make-up to the face, preferably with the exception of the eye and open mouth areas; and 3) Blending the make-up region with the rest of the face. In one embodiment of the invention, the background in the frame containing a video conferencing participant can also be modified so that other video conferencing participants cannot clearly see the background behind the participant in the image frame. In one such embodiment of the invention, the video conferencing participant tries to make his or her own image look comical or altered. In another embodiment of the invention, a particular remote participant tries to make another participant look funny to the other participants.

公开(公告)号：US07127071B2

公开(公告)日：2006-10-24

申请号：US11267678

申请日：2005-11-04

Applicant: Yong Rui ,  Dinei Florencio

Inventor： Yong Rui ,  Dinei Florencio

IPC: H04R3/00 ,  H04N7/14

CPC classification number: H04R3/005 ,  G10L21/0272 ,  G10L2021/02165

Abstract: A system and process for finding the location of a sound source using direct approaches having weighting factors that mitigate the effect of both correlated and reverberation noise is presented. When more than two microphones are used, the traditional time-delay-of-arrival (TDOA) based sound source localization (SSL) approach involves two steps. The first step computes TDOA for each microphone pair, and the second step combines these estimates. This two-step process discards relevant information in the first step, thus degrading the SSL accuracy and robustness. In the present invention, direct, one-step, approaches are employed. Namely, a one-step TDOA SSL approach and a steered beam (SB) SSL approach are employed. Each of these approaches provides an accuracy and robustness not available with the traditional two-step approaches.