公开(公告)号：US07512883B2

公开(公告)日：2009-03-31

申请号：US10883123

申请日：2004-06-30

Applicant: Michael Wallick ,  Yong Rui ,  Le-wei He

Inventor： Michael Wallick ,  Yong Rui ,  Le-wei He

IPC: G06F3/00

CPC classification number: H04M9/082

Abstract: A “virtual video studio”, as described herein, provides a highly portable real-time capability to automatically capture, record, and edit a plurality of video streams of a presentation, such as, for example, a speech, lecture, seminar, classroom instruction, talk-show, teleconference, etc., along with any accompanying exhibits, such as a corresponding slide presentation, using a suite of one or more unmanned cameras controlled by a set of videography rules. The resulting video output may then either be stored for later use, or broadcast in real-time to a remote audience. This real-time capability is achieved by using an abstraction of “virtual cameramen” and physical cameras in combination with a scriptable interface to the aforementioned videography rules for capturing and editing the recorded video to create a composite video of the presentation in real-time under the control of a “virtual director.”

Abstract translation: 如本文所述，“虚拟视频工作室”提供了高度便携的实时能力，以自动地捕获，记录和编辑演示文稿的多个视频流，例如语音，讲座，研讨会，教室 指导，谈话节目，电话会议等，以及任何伴随的展览，例如相应的幻灯片呈现，使用由一组视频规则控制的一个或多个无人摄像机的套件。 然后，所得到的视频输出可以被存储以供以后使用，或者实时地向远程受众广播。 这种实时功能是通过使用“虚拟摄像头”和物理摄像机的抽象结合上述视频规则的脚本接口来实现的，用于捕获和编辑记录的视频，以便实时地创建演示文稿的复合视频 控制“虚拟导演”。

公开(公告)号：US20090046139A1

公开(公告)日：2009-02-19

申请号：US12191270

申请日：2008-08-13

Applicant: Ross Cutler ,  Yong Rui ,  Anoop Gupta

Inventor： Ross Cutler ,  Yong Rui ,  Anoop Gupta

IPC: H04N7/14

CPC classification number: H04N7/15 ,  H04N7/152 ,  H04N7/155

Abstract: A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.

Abstract translation: 电话会议和会议记录的系统和方法。 该系统使用各种捕获设备（新颖的360度相机，白板摄像头，演示者相机，遥控摄像头和麦克风阵列），为希望参加会议的人们提供丰富的体验 距离。 该系统还结合扬声器群集，空间索引和时间压缩，为错过会议并希望观看的人们提供丰富的体验。

公开(公告)号：US07349008B2

公开(公告)日：2008-03-25

申请号：US10307088

申请日：2002-11-30

Applicant: Yong Rui ,  Anoop Gupta ,  Jonathan Thomas Grudin

Inventor： Yong Rui ,  Anoop Gupta ,  Jonathan Thomas Grudin

IPC: H04N7/18

CPC classification number: H04N7/181 ,  H04N7/185 ,  H04N7/188

Abstract: An automated camera management system and method for capturing presentations using videography rules. The system and method use technology components and aesthetic components represented by the videography rules to capture a presentation. In general, the automated camera management method captures a presentation using videography rules to determine camera positioning, camera movement, and switching or transition between cameras. The videography rules depend on the type of presentation room and the number of audio-visual camera units used to capture the presentation. The automated camera management system of the invention uses the above method to capture a presentation in a presentation room. The system includes a least one audio-visual (A-V) camera unit for capturing and tracking a subject based on vision or sound. The (A-V) camera unit includes any combination of the following components: (1) a pan-tilt-zoom (PTZ) camera; (2) a fixed camera; and (3) a microphone array.

Abstract translation: 一种使用摄影规则捕获演示的自动相机管理系统和方法。 该系统和方法使用由视频规则表示的技术组件和美学组件来捕获演示文稿。 通常，自动相机管理方法使用摄影规则捕获演示，以确定相机定位，相机移动以及相机之间的切换或转换。 视频规则取决于演示室的类型和用于捕获演示的视听相机单元的数量。 本发明的自动相机管理系统使用上述方法在演示室中捕获演示。 该系统包括至少一个视听（A-V）摄像机单元，用于基于视觉或声音捕获和跟踪被摄体。 （A-V）相机单元包括以下组件的任意组合：（1）俯仰放大（PTZ）相机; （2）固定摄像头; 和（3）麦克风阵列。

公开(公告)号：US07305095B2

公开(公告)日：2007-12-04

申请号：US11182142

申请日：2005-07-15

Applicant: Yong Rui

Inventor： Yong Rui

IPC: H03R3/00 ,  G10L11/06

CPC classification number: H04R3/005 ,  H04R2201/401

Abstract: A system and process is described for estimating the location of a speaker using signals output by a microphone array characterized by multiple pairs of audio sensors. The location of a speaker is estimated by first determining whether the signal data contains human speech components and filtering out noise attributable to stationary sources. The location of the person speaking is then estimated using a time-delay-of-arrival based SSL technique on those parts of the data determined to contain human speech components. A consensus location for the speaker is computed from the individual location estimates associated with each pair of microphone array audio sensors taking into consideration the uncertainty of each estimate. A final consensus location is also computed from the individual consensus locations computed over a prescribed number of sampling periods using a temporal filtering technique.

Abstract translation: 描述了一种系统和过程，用于使用由多对音频传感器表征的麦克风阵列输出的信号来估计扬声器的位置。 通过首先确定信号数据是否包含人类语音分量并滤除归因于固定源的噪声来估计扬声器的位置。 然后，使用基于时间延迟的SSL技术来估计说话人的位置，以确定包含人类语音组件的数据的那些部分。 考虑到每个估计的不确定性，从与每对麦克风阵列音频传感器相关联的各个位置估计计算扬声器的共识位置。 还可以使用时间滤波技术从在规定数量的采样周期上计算的单个共识位置计算最终共识位置。

公开(公告)号：US20070124370A1

公开(公告)日：2007-05-31

申请号：US11289671

申请日：2005-11-29

Applicant: Krishnamohan Nareddy ,  Andrew Wilson ,  Yong Rui

Inventor： Krishnamohan Nareddy ,  Andrew Wilson ,  Yong Rui

IPC: G06F15/16

CPC classification number: G06Q10/10

Abstract: A unique system and method that facilitates multi-user collaborative interactions is provided. Multiple users can provide input to an interactive surface at or about the same time without yielding control of the surface to any one user. The multiple users can share control of the surface and perform operations on various objects displayed on the surface. The objects can undergo a variety of manipulations and modifications depending on the particular application in use. Objects can be moved or copied between the interactive surface (a public workspace) and a more private workspace where a single user controls the workspace. The objects can also be grouped as desired

Abstract translation: 提供了一种促进多用户协作交互的独特系统和方法。 多个用户可以在或大约相同的时间向交互式表面提供输入，而不会使表面对任何一个用户的控制。 多个用户可以共享表面的控制，并对表面上显示的各种对象执行操作。 根据使用中的具体应用，对象可以进行各种操作和修改。 可以在交互式表面（公共工作区）和单个用户控制工作空间的更私有工作区之间移动或复制对象。 对象也可以根据需要进行分组

公开(公告)号：US20060167995A1

公开(公告)日：2006-07-27

申请号：US11035115

申请日：2005-01-12

Applicant: Yong Rui

Inventor： Yong Rui

IPC: G06F15/16

CPC classification number: H04N7/15 ,  H04N7/147 ,  H04N21/4143 ,  H04N21/42203 ,  H04N21/4223 ,  H04N21/4396 ,  H04N21/4788 ,  H04N21/6125

Abstract: A system and process for muting the audio transmission from a location of a participant engaged in a multi-party, computer network-based teleconference when that participant is working on a keyboard, is presented. The audio is muted as it is assumed the participant is doing something other than actively participation in the meeting when typing on the keyboard. If left un-muted the sound of typing would distract the other participant in the teleconference.

Abstract translation: 提出了一种系统和过程，用于在参与者正在使用键盘时从参与多方计算机网络的电话会议中的参与者的位置静音音频传输。 音频被静音，因为假设在键盘上键入时，参与者正在做积极参与会议的其他事情。 如果没有静音，打字的声音会分散电话会议中的其他参与者的注意力。

公开(公告)号：US20060035709A1

公开(公告)日：2006-02-16

申请号：US10915181

申请日：2004-08-10

Applicant: Zicheng Liu ,  Yong Rui

Inventor： Zicheng Liu ,  Yong Rui

IPC: A63F13/00

CPC classification number: A63F13/52 ,  A63F13/10 ,  A63F13/80 ,  A63F2300/66 ,  A63F2300/8064

Abstract: Disclosed are a unique DPC (detect point click) based game system and method. The DPC based game system involves generating one or a plurality of DPC images, presenting them to a game participant, and collecting the participant's clicks (that identify which object in the DPC image the participant believes to be the correct DPC object), and determining whether the participant's clicks represent the correct object. DPC images can be created in part by selecting a base image, altering some portion of the base image to create at least one confusion image, mapping these images to a geometric model, and applying one or more distortion filters to at least one of the base or confusing image to obscure the DPC object from clear view. Locating the DPC object nearly hidden in the DPC image can advance the participant in the DPC based game or other game including DPC images as a part thereof.

Abstract translation: 公开了一种基于独特的DPC（检测点点击）的游戏系统和方法。 基于DPC的游戏系统涉及生成一个或多个DPC图像，将其呈现给游戏参与者，并收集参与者的点击（识别参与者认为是正确的DPC对象的DPC图像中的哪个对象），以及确定是否 参与者的点击代表正确的对象。 DPC图像可以部分地通过选择基本图像来创建，改变基本图像的一些部分以创建至少一个混淆图像，将这些图像映射到几何模型，以及将一个或多个失真滤波器应用于基底中的至少一个 或令人困惑的图像从清晰的视图来掩盖DPC对象。 将DPC对象几乎隐藏在DPC图像中可以将参与者推送到基于DPC的游戏或其他游戏中，其中包括DPC图像作为其一部分。

公开(公告)号：US20050280700A1

公开(公告)日：2005-12-22

申请号：US11193976

申请日：2005-07-29

Applicant: Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

Inventor： Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

IPC: H04N7/14 ,  H04N7/15

CPC classification number: H04N7/142 ,  H04N7/147 ,  H04N7/15

Abstract: An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

Abstract translation: 一种用于通过计算机网络广播会议的自动化系统和方法。 会议是使用全方位摄像系统拍摄的，可以呈现给观众，包括现场和点播。 本发明的系统包括用于控制相机系统的自动相机管理系统和确定会议环境中的会议参与者的位置的分析模块。 本发明的方法包括使用本发明的系统通过计算机网络向观看者广播事件。 特别地，该方法包括使用全向摄像机系统拍摄该事件。 接下来，该方法确定事件环境中每个事件参与者的位置。 最后，向观众提供用于观看广播事件的用户界面。 该用户界面允许观看者选择观看者想要观看的哪个事件参与者。

公开(公告)号：US20050147278A1

公开(公告)日：2005-07-07

申请号：US11042015

申请日：2005-01-25

Applicant: Yong Rui ,  Yungqiang Chen

Inventor： Yong Rui ,  Yungqiang Chen

IPC: G06T1/00 ,  G06K9/00 ,  G06T1/20 ,  G06T7/00 ,  G06T7/20 ,  H04N7/15 ,  H04N7/26 ,  H04B1/66

CPC classification number: G06K9/00234 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30201

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

公开(公告)号：US20050086223A1

公开(公告)日：2005-04-21

申请号：US10970494

申请日：2004-10-21

Applicant: Yong Rui

Inventor： Yong Rui

IPC: G06F17/30 ,  G06F17/00

CPC classification number: G06K9/6253 ,  G06F17/30256 ,  G06K9/6215 ,  G06K9/6263 ,  Y10S707/99933 ,  Y10S707/99934 ,  Y10S707/99935 ,  Y10S707/99936 ,  Y10S707/99943 ,  Y10S707/99945 ,  Y10S707/99948

Abstract: An improved image retrieval process based on relevance feedback uses a hierarchical (per-feature) approach in comparing images. Multiple query vectors are generated for an initial image by extracting multiple low-level features from the initial image. When determining how closely a particular image in an image collection matches the initial image, a distance is calculated between the query vectors and corresponding low-level feature vectors extracted from the particular image. Once these individual distances are calculated, they are combined to generate an overall distance that represents how closely the two images match. According to other aspects, relevancy feedback received regarding previously retrieved images is used during the query vector generation and the distance determination to influence which images are subsequently retrieved.