公开(公告)号：US07349008B2

公开(公告)日：2008-03-25

申请号：US10307088

申请日：2002-11-30

申请人： Yong Rui ,  Anoop Gupta ,  Jonathan Thomas Grudin

发明人： Yong Rui ,  Anoop Gupta ,  Jonathan Thomas Grudin

IPC分类号： H04N7/18

CPC分类号： H04N7/181 ,  H04N7/185 ,  H04N7/188

摘要： An automated camera management system and method for capturing presentations using videography rules. The system and method use technology components and aesthetic components represented by the videography rules to capture a presentation. In general, the automated camera management method captures a presentation using videography rules to determine camera positioning, camera movement, and switching or transition between cameras. The videography rules depend on the type of presentation room and the number of audio-visual camera units used to capture the presentation. The automated camera management system of the invention uses the above method to capture a presentation in a presentation room. The system includes a least one audio-visual (A-V) camera unit for capturing and tracking a subject based on vision or sound. The (A-V) camera unit includes any combination of the following components: (1) a pan-tilt-zoom (PTZ) camera; (2) a fixed camera; and (3) a microphone array.

摘要翻译： 一种使用摄影规则捕获演示的自动相机管理系统和方法。 该系统和方法使用由视频规则表示的技术组件和美学组件来捕获演示文稿。 通常，自动相机管理方法使用摄影规则捕获演示，以确定相机定位，相机移动以及相机之间的切换或转换。 视频规则取决于演示室的类型和用于捕获演示的视听相机单元的数量。 本发明的自动相机管理系统使用上述方法在演示室中捕获演示。 该系统包括至少一个视听（A-V）摄像机单元，用于基于视觉或声音捕获和跟踪被摄体。 （A-V）相机单元包括以下组件的任意组合：（1）俯仰放大（PTZ）相机; （2）固定摄像头; 和（3）麦克风阵列。

公开(公告)号：US07506356B2

公开(公告)日：2009-03-17

申请号：US10970937

申请日：2004-10-22

申请人： Anoop Gupta ,  Li-Wei He ,  Francis C. Li ,  Yong Rui

发明人： Anoop Gupta ,  Li-Wei He ,  Francis C. Li ,  Yong Rui

IPC分类号： H04N7/173 ,  H04N7/16

CPC分类号： H04N21/26603 ,  G06F17/241 ,  G11B27/105 ,  G11B27/11 ,  G11B27/28 ,  G11B2220/20 ,  H04N5/76 ,  H04N5/781 ,  H04N5/85 ,  H04N5/907 ,  H04N7/17318 ,  H04N9/8042 ,  H04N21/23418 ,  H04N21/4312 ,  H04N21/4314 ,  H04N21/4334 ,  H04N21/440281 ,  H04N21/4622 ,  H04N21/4782 ,  H04N21/6125 ,  H04N21/84 ,  H04N21/8456

摘要： A program distribution system includes a plurality of set-top boxes that receive broadcast programming and segmentation data from content and information providers. The segmentation information indicates portions of programs that are to be included in skimmed or condensed versions of the received programming, and is produced using manual or automated methods. Automated methods include the use of ancillary production data to detect the most important parts of a program. A user interface allows a user to control time scale modification and skimming during playback, and also allows the user to easily browse to different points within the current program.

摘要翻译： 程序分配系统包括从内容和信息提供者接收广播节目和分段数据的多个机顶盒。 分割信息指示将被包括在接收到的节目的撇号或缩小版本中的节目的部分，并且使用手动或自动方法来产生。 自动化方法包括使用辅助生产数据来检测程序的最重要部分。 用户界面允许用户在播放期间控制时间刻度修改和缩放，并且还允许用户容易地浏览到当前节目内的不同点。

公开(公告)号：US07428000B2

公开(公告)日：2008-09-23

申请号：US10608313

申请日：2003-06-26

申请人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

发明人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

IPC分类号： H04N7/14

CPC分类号： H04N7/15 ,  H04N7/152 ,  H04N7/155

摘要： A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.

摘要翻译： 电话会议和会议记录的系统和方法。 该系统使用各种捕获设备（新颖的360度相机，白板摄像头，演示者相机，遥控摄像头和麦克风阵列），为希望参加会议的人们提供丰富的体验 距离。 该系统还结合扬声器群集，空间索引和时间压缩，为错过会议并希望观看的人们提供丰富的体验。

公开(公告)号：US07403894B2

公开(公告)日：2008-07-22

申请号：US11081118

申请日：2005-03-15

申请人： Yong Rui ,  Anoop Gupta ,  Alejandro Acero

发明人： Yong Rui ,  Anoop Gupta ,  Alejandro Acero

IPC分类号： G10L21/00

CPC分类号： G06F17/30787 ,  G06F17/30743 ,  G06F17/30749 ,  G06F17/30758 ,  G06F17/30843 ,  G06K9/00711

摘要： Audio/video programming content is made available to a receiver from a content provider, and meta data is made available to the receiver from a meta data provider. The meta data corresponds to the programming content, and identifies, for each of multiple portions of the programming content, an indicator of a likelihood that the portion is an exciting portion of the content. In one implementation, the meta data includes probabilities that segments of a baseball program are exciting, and is generated by analyzing the audio data of the baseball program for both excited speech and baseball hits. The meta data can then be used to generate a summary for the baseball program.

摘要翻译： 音频/视频节目内容从内容提供商可用于接收者，并且元数据从元数据提供者向接收者提供。 元数据对应于节目内容，并且针对节目内容的多个部分中的每一个识别该部分是内容的激动部分的可能性的指示符。 在一个实现中，元数据包括棒球节目的节段令人兴奋的概率，并且通过分析用于激发的语音和棒球命中的棒球节目的音频数据而产生。 然后可以使用元数据来生成棒球程序的摘要。

公开(公告)号：US07580054B2

公开(公告)日：2009-08-25

申请号：US11193976

申请日：2005-07-29

申请人： Yong Rui ,  Anoop Gupta ,  Johnathan J. Cadiz ,  Ross Garrett Cutler

发明人： Yong Rui ,  Anoop Gupta ,  Johnathan J. Cadiz ,  Ross Garrett Cutler

IPC分类号： H04N7/14 ,  G06F3/00

CPC分类号： H04N7/142 ,  H04N7/147 ,  H04N7/15

摘要： An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

公开(公告)号：US20090046139A1

公开(公告)日：2009-02-19

申请号：US12191270

申请日：2008-08-13

申请人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

发明人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

IPC分类号： H04N7/14

CPC分类号： H04N7/15 ,  H04N7/152 ,  H04N7/155

摘要： A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.

摘要翻译： 电话会议和会议记录的系统和方法。 该系统使用各种捕获设备（新颖的360度相机，白板摄像头，演示者相机，遥控摄像头和麦克风阵列），为希望参加会议的人们提供丰富的体验 距离。 该系统还结合扬声器群集，空间索引和时间压缩，为错过会议并希望观看的人们提供丰富的体验。

公开(公告)号：US20050280700A1

公开(公告)日：2005-12-22

申请号：US11193976

申请日：2005-07-29

申请人： Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

发明人： Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

IPC分类号： H04N7/14 ,  H04N7/15

CPC分类号： H04N7/142 ,  H04N7/147 ,  H04N7/15

摘要： An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

摘要翻译： 一种用于通过计算机网络广播会议的自动化系统和方法。 会议是使用全方位摄像系统拍摄的，可以呈现给观众，包括现场和点播。 本发明的系统包括用于控制相机系统的自动相机管理系统和确定会议环境中的会议参与者的位置的分析模块。 本发明的方法包括使用本发明的系统通过计算机网络向观看者广播事件。 特别地，该方法包括使用全向摄像机系统拍摄该事件。 接下来，该方法确定事件环境中每个事件参与者的位置。 最后，向观众提供用于观看广播事件的用户界面。 该用户界面允许观看者选择观看者想要观看的哪个事件参与者。

公开(公告)号：US08111282B2

公开(公告)日：2012-02-07

申请号：US12191270

申请日：2008-08-13

申请人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

发明人： Ross Cutler ,  Yong Rui ,  Anoop Gupta

IPC分类号： H04N7/14

CPC分类号： H04N7/15 ,  H04N7/152 ,  H04N7/155

摘要： A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.

摘要翻译： 电话会议和会议记录的系统和方法。 该系统使用各种捕获设备（新颖的360度相机，白板摄像头，演示者相机，遥控摄像头和麦克风阵列），为希望参加会议的人们提供丰富的体验 距离。 该系统还结合扬声器群集，空间索引和时间压缩，为错过会议并希望观看的人们提供丰富的体验。

公开(公告)号：US07916848B2

公开(公告)日：2011-03-29

申请号：US10677213

申请日：2003-10-01

申请人： Yong Rui ,  Anoop Gupta

发明人： Yong Rui ,  Anoop Gupta

IPC分类号： H04M3/42 ,  H04M1/64 ,  G10L13/00

CPC分类号： H04L65/4046 ,  H04L29/06027 ,  H04M3/56 ,  H04M2201/38 ,  H04M2201/41 ,  H04Q2213/13034 ,  H04Q2213/13091 ,  H04Q2213/1324 ,  H04Q2213/13248 ,  H04Q2213/13333 ,  H04Q2213/13337 ,  H04Q2213/13389

摘要： Indications of which participant is providing information during a multi-party conference. Each participant has equipment to display information being transferred during the conference. A sourcing signaler residing in the participant equipment provides a signal that indicates the identity of its participant when this participant is providing information to the conference. The source indicators of the other participant equipment receive the signal and cause a UI to indicate that the participant identified by the received signal is providing information (e.g. the UI can causes the identifier to change appearance). An audio discriminator is used to distinguish between an acoustic signal that was generated by a person speaking from that generated in a band-limited manner. The audio discriminator analyzes the spectrum of detected audio signals and generates several parameters from the spectrum and from past determinations to determine the source of an audio signal on a frame-by-frame basis.

摘要翻译： 参与者在多方会议期间提供信息的指示。 每个参与者都有设备在会议期间显示要传送的信息。 驻留在参与者设备中的采购信号器提供当该参与者向会议提供信息时指示其参与者身份的信号。 其他参与者设备的源指示符接收信号并使UI指示由接收到的信号识别的参与者提供信息（例如，UI可以使得标识符改变外观）。 使用音频鉴别器来区分由以频带限制的方式产生的声音所产生的声信号。 音频鉴别器分析检测到的音频信号的频谱，并从频谱和过去的确定中产生几个参数，以逐帧确定音频信号的来源。

公开(公告)号：US07852369B2

公开(公告)日：2010-12-14

申请号：US10184499

申请日：2002-06-27

申请人： Ross Cutler ,  Ivan Tashev ,  Yong Rui ,  Anoop Gupta

发明人： Ross Cutler ,  Ivan Tashev ,  Yong Rui ,  Anoop Gupta

IPC分类号： H04N7/14

CPC分类号： H04R3/02 ,  H04N5/2259 ,  H04N5/23203 ,  H04N7/142 ,  H04R2201/401

摘要： An omni-directional camera (a 360 degree camera) is proposed with an integrated microphone array. The primary application for such a camera is videoconferencing and meeting recording, and the device is designed to be placed on a meeting room table. The microphone array is in a planar configuration, and the microphones are located as close to the desktop as possible to eliminate sound reflections from the table. The camera is connected to the microphone array base with a thin cylindrical rod, which is acoustically invisible to the microphone array for the frequency range [50-4000] Hz. This provides a direct path from the person talking to all of the microphones in the array, and can therefore be used for sound source localization (determining the location of the talker) and beam-forming (improving the sound quality of the talker by filtering only sound from a particular direction). The camera array is elevated from the table to provide a near frontal viewpoint of the meeting participants.

摘要翻译： 提出了一种全方位摄像机（360度摄像机），集成了麦克风阵列。 这种相机的主要应用是视频会议和会议录制，设备被设计为放在会议室桌子上。 麦克风阵列处于平面配置，麦克风尽可能靠近桌面，以消除桌面的声音反射。 摄像机连接到麦克风阵列底座上，并带有一个薄的圆柱形杆，在[50-4000] Hz的频率范围内，麦克风阵列声学上不可见。 这提供了从人员通话到阵列中的所有麦克风的直接路径，因此可以用于声源定位（确定讲话者的位置）和波束形成（仅通过滤波来提高讲话者的声音质量 声音从特定的方向）。 相机阵列从表中提升，以提供会议参与者的近前视点。