公开(公告)号：US06859802B1

公开(公告)日：2005-02-22

申请号：US09660536

申请日：2000-09-13

Applicant: Yong Rui

Inventor： Yong Rui

IPC: G06F17/30

CPC classification number: G06K9/6253 ,  G06F17/30256 ,  G06K9/6215 ,  G06K9/6263 ,  Y10S707/99933 ,  Y10S707/99934 ,  Y10S707/99935 ,  Y10S707/99936 ,  Y10S707/99943 ,  Y10S707/99945 ,  Y10S707/99948

Abstract: An improved image retrieval process based on relevance feedback uses a hierarchical (per-feature) approach in comparing images. Multiple query vectors are generated for an initial image by extracting multiple low-level features from the initial image. When determining how closely a particular image in an image collection matches the initial image, a distance is calculated between the query vectors and corresponding low-level feature vectors extracted from the particular image. Once these individual distances are calculated, they are combined to generate an overall distance that represents how closely the two images match. According to other aspects, relevancy feedback received regarding previously retrieved images is used during the query vector generation and the distance determination to influence which images are subsequently retrieved.

公开(公告)号：US08111282B2

公开(公告)日：2012-02-07

申请号：US12191270

申请日：2008-08-13

Applicant: Ross Cutler ,  Yong Rui ,  Anoop Gupta

Inventor： Ross Cutler ,  Yong Rui ,  Anoop Gupta

IPC: H04N7/14

CPC classification number: H04N7/15 ,  H04N7/152 ,  H04N7/155

Abstract: A system and method for teleconferencing and recording of meetings. The system uses a variety of capture devices (a novel 360° camera, a whiteboard camera, a presenter view camera, a remote view camera, and a microphone array) to provide a rich experience for people who want to participate in a meeting from a distance. The system is also combined with speaker clustering, spatial indexing, and time compression to provide a rich experience for people who miss a meeting and want to watch it afterward.

Abstract translation: 电话会议和会议记录的系统和方法。 该系统使用各种捕获设备（新颖的360度相机，白板摄像头，演示者相机，遥控摄像头和麦克风阵列），为希望参加会议的人们提供丰富的体验 距离。 该系统还结合扬声器群集，空间索引和时间压缩，为错过会议并希望观看的人们提供丰富的体验。

公开(公告)号：US07916848B2

公开(公告)日：2011-03-29

申请号：US10677213

申请日：2003-10-01

Applicant: Yong Rui ,  Anoop Gupta

Inventor： Yong Rui ,  Anoop Gupta

IPC: H04M3/42 ,  H04M1/64 ,  G10L13/00

CPC classification number: H04L65/4046 ,  H04L29/06027 ,  H04M3/56 ,  H04M2201/38 ,  H04M2201/41 ,  H04Q2213/13034 ,  H04Q2213/13091 ,  H04Q2213/1324 ,  H04Q2213/13248 ,  H04Q2213/13333 ,  H04Q2213/13337 ,  H04Q2213/13389

Abstract: Indications of which participant is providing information during a multi-party conference. Each participant has equipment to display information being transferred during the conference. A sourcing signaler residing in the participant equipment provides a signal that indicates the identity of its participant when this participant is providing information to the conference. The source indicators of the other participant equipment receive the signal and cause a UI to indicate that the participant identified by the received signal is providing information (e.g. the UI can causes the identifier to change appearance). An audio discriminator is used to distinguish between an acoustic signal that was generated by a person speaking from that generated in a band-limited manner. The audio discriminator analyzes the spectrum of detected audio signals and generates several parameters from the spectrum and from past determinations to determine the source of an audio signal on a frame-by-frame basis.

Abstract translation: 参与者在多方会议期间提供信息的指示。 每个参与者都有设备在会议期间显示要传送的信息。 驻留在参与者设备中的采购信号器提供当该参与者向会议提供信息时指示其参与者身份的信号。 其他参与者设备的源指示符接收信号并使UI指示由接收到的信号识别的参与者提供信息（例如，UI可以使得标识符改变外观）。 使用音频鉴别器来区分由以频带限制的方式产生的声音所产生的声信号。 音频鉴别器分析检测到的音频信号的频谱，并从频谱和过去的确定中产生几个参数，以逐帧确定音频信号的来源。

公开(公告)号：US07852369B2

公开(公告)日：2010-12-14

申请号：US10184499

申请日：2002-06-27

Applicant: Ross Cutler ,  Ivan Tashev ,  Yong Rui ,  Anoop Gupta

Inventor： Ross Cutler ,  Ivan Tashev ,  Yong Rui ,  Anoop Gupta

IPC: H04N7/14

CPC classification number: H04R3/02 ,  H04N5/2259 ,  H04N5/23203 ,  H04N7/142 ,  H04R2201/401

Abstract: An omni-directional camera (a 360 degree camera) is proposed with an integrated microphone array. The primary application for such a camera is videoconferencing and meeting recording, and the device is designed to be placed on a meeting room table. The microphone array is in a planar configuration, and the microphones are located as close to the desktop as possible to eliminate sound reflections from the table. The camera is connected to the microphone array base with a thin cylindrical rod, which is acoustically invisible to the microphone array for the frequency range [50-4000] Hz. This provides a direct path from the person talking to all of the microphones in the array, and can therefore be used for sound source localization (determining the location of the talker) and beam-forming (improving the sound quality of the talker by filtering only sound from a particular direction). The camera array is elevated from the table to provide a near frontal viewpoint of the meeting participants.

Abstract translation: 提出了一种全方位摄像机（360度摄像机），集成了麦克风阵列。 这种相机的主要应用是视频会议和会议录制，设备被设计为放在会议室桌子上。 麦克风阵列处于平面配置，麦克风尽可能靠近桌面，以消除桌面的声音反射。 摄像机连接到麦克风阵列底座上，并带有一个薄的圆柱形杆，在[50-4000] Hz的频率范围内，麦克风阵列声学上不可见。 这提供了从人员通话到阵列中的所有麦克风的直接路径，因此可以用于声源定位（确定讲话者的位置）和波束形成（仅通过滤波来提高讲话者的声音质量 声音从特定的方向）。 相机阵列从表中提升，以提供会议参与者的近前视点。

公开(公告)号：US07774703B2

公开(公告)日：2010-08-10

申请号：US11351049

申请日：2006-02-09

Applicant: Sasa Junuzovic ,  Prasun Dewan ,  Yong Rui

Inventor： Sasa Junuzovic ,  Prasun Dewan ,  Yong Rui

IPC: G06F17/21

CPC classification number: G06F3/0481 ,  G06Q10/10

Abstract: Techniques are provided for indicating workspace awareness using one or more of a write shadow, a read shadow, and/or a shadowbar providing an indication of operations performed at associated locations by various users accessing a same document. A write shadow may be used to indicate a position in a document being modified by a user. A read shadow may be used to indicate a position being viewed by a user. A shadowbar may be used to indicate areas of overlap among users with a shading and coloring indicative of a degree of overlap.

Abstract translation: 提供了用于使用访问相同文档的各种用户的在相关联位置处执行的操作的指示的写影，读影和/或阴影栏中的一个或多个来指示工作空间感知的技术。 可以使用写入阴影来指示由用户修改的文档中的位置。 读影子可以用于指示用户正在观看的位置。 阴影栏可以用于指示具有指示重叠度的阴影和着色的用户之间的重叠区域。

公开(公告)号：US07620552B2

公开(公告)日：2009-11-17

申请号：US11073144

申请日：2005-03-04

Applicant: Yong Rui ,  Anoop Gupta ,  Alejandro Acero

Inventor： Yong Rui ,  Anoop Gupta ,  Alejandro Acero

IPC: G10L11/00

CPC classification number: G06F17/30787 ,  G06F17/30743 ,  G06F17/30749 ,  G06F17/30758 ,  G06F17/30843 ,  G06K9/00711

Abstract: Audio/video programming content is made available to a receiver from a content provider, and meta data is made available to the receiver from a meta data provider. The meta data corresponds to the programming content, and identifies, for each of multiple portions of the programming content, an indicator of a likelihood that the portion is an exciting portion of the content. In one implementation, the meta data includes probabilities that segments of a baseball program are exciting, and is generated by analyzing the audio data of the baseball program for both excited speech and baseball hits. The meta data can then be used to generate a summary for the baseball program.

Abstract translation: 音频/视频节目内容从内容提供商可用于接收者，并且元数据从元数据提供者向接收者提供。 元数据对应于节目内容，并且针对节目内容的多个部分中的每一个识别该部分是内容的激动部分的可能性的指示符。 在一个实现中，元数据包括棒球节目的节段令人兴奋的概率，并且通过分析用于激发的语音和棒球命中的棒球节目的音频数据而产生。 然后可以使用元数据来生成棒球程序的摘要。

公开(公告)号：US07612794B2

公开(公告)日：2009-11-03

申请号：US11137252

申请日：2005-05-25

Applicant: Li-wei He ,  Michael Cohen ,  Yong Rui ,  Shinichi Manaka

Inventor： Li-wei He ,  Michael Cohen ,  Yong Rui ,  Shinichi Manaka

IPC: H04N7/14 ,  G06K9/00

CPC classification number: H04N7/147

Abstract: A method of digitally adding the appearance of makeup to a videoconferencing participant. The system and method for applying digital make-up operates in a loop processing sequential video frames. For each input frame, there are typically three general steps: 1) Locating the face and eye and mouth regions; 2) Applying digital make-up to the face, preferably with the exception of the eye and open mouth areas; and 3) Blending the make-up region with the rest of the face. In one embodiment of the invention, the background in the frame containing a video conferencing participant can also be modified so that other video conferencing participants cannot clearly see the background behind the participant in the image frame. In one such embodiment of the invention, the video conferencing participant tries to make his or her own image look comical or altered. In another embodiment of the invention, a particular remote participant tries to make another participant look funny to the other participants.

Abstract translation: 将化妆品外观数字化添加到视频会议参与者的方法。 用于应用数字化妆的系统和方法在循环处理顺序视频帧中操作。 对于每个输入框架，通常有三个一般步骤：1）定位脸部和眼睛和嘴部区域; 2）应用数字化妆面部，最好除了眼睛和开口区域外; 和3）将化妆区域与面部的其余部分混合。 在本发明的一个实施例中，还可以修改包含视频会议参与者的帧的背景，使得其他视频会议参与者不能清楚地看到图像帧中的参与者后面的背景。 在本发明的一个这样的实施例中，视频会议参与者尝试使他或她自己的图像看上去滑稽或改变。 在本发明的另一个实施例中，特定的远程参与者尝试使另一参与者对其他参与者看起来很滑稽。

公开(公告)号：US07428315B2

公开(公告)日：2008-09-23

申请号：US11042766

申请日：2005-01-25

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06K9/00 ,  G06K9/62 ,  G06K9/68 ,  G06K9/70 ,  G06K9/74

CPC classification number: G06K9/00234 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30201

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

Abstract translation: 多个人的自动检测和跟踪包括接收视频和/或音频内容的帧并且识别帧中的新的面部区域的候选区域。 使用一个或多个分级验证级别来验证人脸是否在候选区域中，并且如果所述一个或多个分层验证级别验证人脸在候选区域中，则指示使候选区域包括面部。 使用多个音频和/或视频提示从帧到帧跟踪视频内容中的每个验证的面部。

公开(公告)号：US07313808B1

公开(公告)日：2007-12-25

申请号：US09565820

申请日：2000-05-05

Applicant: Anoop Gupta ,  Li-Wei He ,  Francis C. Li ,  Yong Rui

Inventor： Anoop Gupta ,  Li-Wei He ,  Francis C. Li ,  Yong Rui

IPC: H04N7/173 ,  H04N7/16 ,  H04N5/91 ,  G06F15/16 ,  G06F15/00

CPC classification number: H04N7/163 ,  G11B27/034 ,  G11B27/28 ,  G11B27/34 ,  G11B2220/2516 ,  H04N5/76 ,  H04N5/765 ,  H04N5/781 ,  H04N5/783 ,  H04N9/8042 ,  H04N9/8205 ,  H04N21/4147 ,  H04N21/4325 ,  H04N21/4334 ,  H04N21/44008 ,  H04N21/440245 ,  H04N21/4622 ,  H04N21/482 ,  H04N21/8153 ,  H04N21/8456 ,  H04N21/8549

Abstract: A program distribution system includes a plurality of set-top boxes that receive broadcast programming and segmentation data from content and information providers. The segmentation information indicates portions of programs that are to be included in skimmed or condensed versions of the received programming, and is produced using manual or automated methods. Automated methods include the use of ancillary production data to detect the most important parts of a program. A user interface allows a user to control time scale modification and skimming during playback, and also allows the user to easily browse to different points within the current program.

Abstract translation: 程序分配系统包括从内容和信息提供者接收广播节目和分段数据的多个机顶盒。 分割信息指示将被包括在接收到的节目的撇号或缩小版本中的节目的部分，并且使用手动或自动方法来产生。 自动化方法包括使用辅助生产数据来检测程序的最重要部分。 用户界面允许用户在播放期间控制时间刻度修改和缩放，并且还允许用户容易地浏览到当前节目内的不同点。

公开(公告)号：US07171025B2

公开(公告)日：2007-01-30

申请号：US11042457

申请日：2005-01-25

Applicant: Yong Rui ,  Yunqiang Chen

Inventor： Yong Rui ,  Yunqiang Chen

IPC: G06K9/00 ,  G06K9/48 ,  G06K9/40

CPC classification number: G06K9/00234 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30201

Abstract: Automatic detection and tracking of multiple individuals includes receiving a frame of video and/or audio content and identifying a candidate area for a new face region in the frame. One or more hierarchical verification levels are used to verify whether a human face is in the candidate area, and an indication made that the candidate area includes a face if the one or more hierarchical verification levels verify that a human face is in the candidate area. A plurality of audio and/or video cues are used to track each verified face in the video content from frame to frame.

Abstract translation: 多个人的自动检测和跟踪包括接收视频和/或音频内容的帧并且识别帧中的新的面部区域的候选区域。 使用一个或多个分级验证级别来验证人脸是否在候选区域中，并且如果所述一个或多个分层验证级别验证人脸在候选区域中，则指示使候选区域包括面部。 使用多个音频和/或视频提示从帧到帧跟踪视频内容中的每个验证的面部。