公开(公告)号：US20020164151A1

公开(公告)日：2002-11-07

申请号：US09846461

申请日：2001-05-01

Applicant: Koninklijke Philips Electronics N.V.

Inventor： Radu S. Jasinschi ,  Nevenka Dimitrova

IPC: H04N005/783

CPC classification number: G06F17/30796 ,  G06F17/30858 ,  G11B27/11 ,  G11B27/28 ,  G11B2220/20 ,  G11B2220/41 ,  G11B2220/65 ,  G11B2220/90

Abstract: For use in a multimedia analysis system capable of analyzing the content of multimedia signals, there is disclosed an apparatus and method for creating a multimedia table of contents of videotaped material. In one advantageous embodiment, the apparatus of the present invention comprises a multimedia table of contents controller that is capable of receiving video signals, audio signals, and text signals of said videotaped material, and capable of combining portions of the video signals, audio signals, and text signals to create a table of contents of the videotaped material. The controller is capable of segmenting video signals with both a coarse and fine segmentation application. The controller is also capable of locating boundaries of elements of the videotaped material with both a coarse and fine boundary detection application. An index module of the controller links elements of the table of contents with combinations of audio, visual, and transcript cues. A retrieval module retrieves and displays a table of contents in response to a user request.

Abstract translation: 为了在能够分析多媒体信号的内容的多媒体分析系统中使用，公开了一种用于创建录像材料的多媒体内容表的装置和方法。 在一个有利的实施例中，本发明的装置包括能够接收所述录像资料的视频信号，音频信号和文本信号的内容控制器的多媒体表，并且能够将视频信号，音频信号， 和文字信号来创建录像资料的目录。 该控制器能够利用粗细和细分割应用来分割视频信号。 控制器还能够利用粗略和精细的边界检测应用来定位录像带材料的元件的边界。 控制器的索引模块将内容的元素与音频，视觉和转录提示的组合相连接。 检索模块根据用户请求检索并显示内容表。

公开(公告)号：US20040098376A1

公开(公告)日：2004-05-20

申请号：US10295668

申请日：2002-11-15

Applicant: KONINKLIJKE PHILIPS ELECTRONICS N.V.

Inventor： Dongge Li ,  Nevenka Dimitrova

IPC: G06F007/00

CPC classification number: G06K9/00711 ,  G06F17/30026 ,  G06F17/30035 ,  G06F17/30047 ,  G06F17/30743 ,  G06F17/30775 ,  G06F17/30787 ,  G06F17/30799 ,  Y10S707/99933

Abstract: A method and system which enable a user to query a multimedia archive in one media modality and automatically retrieve correlating data in another media modality without the need for manually associating the data items through a data structure. The correlation method finds the maximum correlation between the data items without being affected by the distribution of the data in the respective subspace of each modality. Once the direction of correlation is disclosed, extracted features can be transferred from one subspace to another.

Abstract translation: 一种方法和系统，其使得用户能够以一种媒体模式查询多媒体档案并且自动地检索另一种媒体模式中的相关数据，而不需要通过数据结构手动关联数据项。 相关方法在数据项之间找到最大的相关性，而不受每个模态各个子空间中数据分布的影响。 一旦公开了相关方向，提取的特征可以从一个子空间转移到另一个子空间。

公开(公告)号：US20040085340A1

公开(公告)日：2004-05-06

申请号：US10284219

申请日：2002-10-30

Applicant: Koninklijke Philips Electronics N.V

Inventor： Nevenka Dimitrova ,  Radu S. Jasinschi

IPC: G09G005/00

CPC classification number: H04N5/23264 ,  G11B27/031 ,  G11B27/28 ,  G11B2220/216 ,  G11B2220/2545 ,  G11B2220/2562 ,  G11B2220/90 ,  H04N5/145 ,  H04N5/147 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/262

Abstract: A method and apparatus for editing a source video that has already been taken to stabilize images in the video. To eliminate jerky motion from a video, changes in shots are first detected. Then, any jerkiness within the video of that shot is classified and the video is segmented further into smaller segments based on this classification. The jerkiness within the selected segments is removed. The corrected shot, comprising a plurality of frames, is then added to the preceding shot until all shots of the video have been appropriately corrected for jerkiness. To help the user identify the shots being edited, keyframes or snapshots of the shots are displayed, thereby allowing the user to decide whether processing of the shot is desired and which shots should be incorporated into the final video.

Abstract translation: 用于编辑已经被采取以稳定视频中的图像的源视频的方法和装置。 为了消除视频中的抖动，首先会检测到镜头的变化。 然后，该镜头的视频内的任何动作被分类，并且基于该分类将视频进一步分割成较小的片段。 删除所选段中的动作。 然后，将包括多个帧的校正后的镜头添加到前一个镜头，直到视频的所有镜头已经被适当地校正为抖动。 为了帮助用户识别正在编辑的照片，显示拍摄的关键帧或快照，从而允许用户决定是否期望拍摄的处理以及应该将哪些拍摄结合到最终视频中。

公开(公告)号：US20030229629A1

公开(公告)日：2003-12-11

申请号：US10165904

申请日：2002-06-10

Applicant: Koninklijke Philips Electronics N.V.

Inventor： Radu S. Jasinschi ,  Nevenka Dimitrova ,  John Zimmerman

IPC: G06F017/30

CPC classification number: H04N21/475 ,  G06F17/30828 ,  H04N7/17318 ,  H04N21/26603 ,  H04N21/44222 ,  H04N21/4532 ,  H04N21/454 ,  H04N21/4622 ,  H04N21/4722 ,  H04N21/4782 ,  H04N21/84 ,  H04N21/858 ,  Y10S707/99933 ,  Y10S707/99934 ,  Y10S707/99935

Abstract: A method, process and system for performing content augmentation of personal profiles includes (a) building a user history of a plurality of augmented content information of relevant TV programs; (b) analyzing user queries and determining a degree to which the user queried for additional content information; (c) inferring values about the user from user queries for additional content information so as to augment the additional content information; (d) updating the augmented content information to at least one of the user history, Internet and specialized databases; (e) linking individual ones of the plurality of augmented content information to each other; and (f) determining inferences about the user's interests and preferences based on the linkage of the plurality of augmented content information. The updating of the augmented content information includes segmenting and indexing of multimedia content. A feedback system is created where user queries for more information and purchases from the Internet and specialized databases will result in additional augmented content information about the particular user.

Abstract translation: 用于执行个人简档的内容增加的方法，过程和系统包括（a）构建相关电视节目的多个增强内容信息的用户历史; （b）分析用户查询并确定用户查询附加内容信息的程度; （c）从附加内容信息的用户查询推断关于用户的值，以便增加附加内容信息; （d）将增强内容信息更新为用户历史，因特网和专用数据库中的至少一个; （e）将所述多个增强内容信息中的各个彼此连接; 以及（f）基于所述多个增强内容信息的链接来确定关于所述用户的兴趣和偏好的推断。 增强内容信息的更新包括多媒体内容的分段和索引。 创建反馈系统，其中用户从因特网和专用数据库查询更多信息和购买将导致关于特定用户的附加增强内容信息。

公开(公告)号：US20030123728A1

公开(公告)日：2003-07-03

申请号：US10034738

申请日：2001-12-28

Applicant: Koninklijke Philips Electronics N.V.

Inventor： Nevenka Dimitrova ,  Jacquelyn Annette Martino

IPC: G06K009/34

CPC classification number: G06F3/011 ,  H04N7/002 ,  H04N7/181

Abstract: An interactive imaging system and method thereof are provided. The invention provides a real-time interactive video system. The input signals to the system are given through an array of cameras, sensors and microphones. The input signals are generated by human (or pet) presence and involvement. A set of software modules is invoked based on a nullrulenull framework created by the user, e.g., artist or designer, of the interactive system. The nullrulesnull define which set of input signals are connected to certain portions, i.e., impressible regions, of an image on a display of the system or connected to certain portions on a mosaiced display. The inventive system allows the user to build a set of nullrulesnull as to how the impressible regions of the displayed images can change based on motion, color, and/or texture of a nullvisitornull interacting with the system.

Abstract translation: 提供了一种交互式成像系统及其方法。 本发明提供一种实时交互式视频系统。 通过摄像机，传感器和麦克风阵列给出系统的输入信号。 输入信号由人（或宠物）存在和参与产生。 基于由交互式系统的用户（例如，艺术家或设计者）创建的“规则”框架来调用一组软件模块。 “规则”定义哪一组输入信号连接到系统的显示器上或连接到镶嵌显示器上的某些部分上的图像的某些部分（即，可压缩区域）。 本发明的系统允许用户构建一组关于如何基于与系统交互的“访问者”的运动，颜色和/或纹理来显示的图像的可压缩区域可以改变的“规则”。

公开(公告)号：US20030117530A1

公开(公告)日：2003-06-26

申请号：US10028378

申请日：2001-12-21

Applicant: Koninklijke Philips Electronics N.V.

Inventor： Thomas McGee ,  Lalitha Agnihotri ,  Nevenka Dimitrova ,  Radu Serban Jasinschi

IPC: H04N009/64

CPC classification number: H04N5/44 ,  H04N21/44008 ,  H04N21/812 ,  H04N21/84 ,  H04N21/8456

Abstract: Techniques are disclosed for detecting commercials or other particular types of video content in a video signal. In an illustrative embodiment, color histograms are extracted from frames of the video signal. For each of at least a subset of the extracted color histograms, the extracted color histogram is compared to a family histogram. If the extracted color histogram falls within a specified range of the family histogram, the family histogram is updated to include the extracted color histogram as a new member. If the extracted color histogram does not fall within the specified range of the family histogram, the family histogram is considered complete and the extracted color histogram is utilized to generate a new family histogram for use in processing subsequent extracted color histograms. The resulting family histograms are utilized to detect commercials or other particular type of video content in the video signal.

Abstract translation: 公开了用于检测视频信号中的商业广告或其他特定类型的视频内容的技术。 在说明性实施例中，从视频信号的帧中提取颜色直方图。 对于提取的颜色直方图的至少一个子集中的每一个，将所提取的颜色直方图与族直方图进行比较。 如果提取的颜色直方图落入家族直方图的指定范围内，则更新系列直方图以将所提取的颜色直方图包括为新成员。 如果提取的颜色直方图不在家庭直方图的指定范围内，则家族直方图被认为是完整的，并且所提取的颜色直方图被用于生成用于处理随后提取的颜色直方图的新家族直方图。 所得到的系列直方图用于检测视频信号中的广告或其他特定类型的视频内容。

公开(公告)号：US20030117428A1

公开(公告)日：2003-06-26

申请号：US10024778

申请日：2001-12-20

Applicant: KONINKLIJKE PHILIPS ELECTRONICS N.V.

Inventor： Dongge Li ,  John D. Zimmerman ,  Nevenka Dimitrova

IPC: G09G005/00

CPC classification number: G06F16/785 ,  G06F16/739 ,  G06F16/745 ,  G06F16/7834 ,  G06F16/7844 ,  G06F16/786

Abstract: A visualization system captures and analyzes a video signal to extract features in the video signal to render a graphical multi-dimensional visual representation of the program. The visualization system includes a memory and a processor and is programmed to extract features, augment the feature extraction with supplemental information, and render a visual summary to be displayed on a display device. Using the visual summary, a user can more easily determine the nature of a particular video program.

Abstract translation: 可视化系统捕获并分析视频信号以提取视频信号中的特征以呈现节目的图形多维视觉表示。 可视化系统包括存储器和处理器，并且被编程为提取特征，利用补充信息来增强特征提取，并呈现要在显示装置上显示的视觉摘要。 使用视觉摘要，用户可以更容易地确定特定视频节目的性质。

公开(公告)号：US20030090505A1

公开(公告)日：2003-05-15

申请号：US10298968

申请日：2002-11-18

Applicant: KONINKLIJKE PHILIPS ELECTRONICS N.V.

Inventor： Thomas McGee ,  Nevenka Dimitrova ,  Jan Herman Elenbaas

IPC: G06F003/00 ,  H04N005/445 ,  G06F013/00 ,  H04N005/222 ,  G09G005/00

CPC classification number: G06F17/30802 ,  G06F17/30814 ,  G06F17/30858 ,  G06K9/00711 ,  G11B27/105 ,  G11B27/107 ,  G11B27/11 ,  G11B27/28 ,  G11B27/326 ,  G11B27/328 ,  G11B27/34 ,  G11B2220/2562 ,  G11B2220/65 ,  G11B2220/90 ,  H04N5/147 ,  H04N19/142 ,  H04N19/179 ,  H04N19/503 ,  H04N19/87 ,  H04N21/458 ,  H04N21/812

Abstract: A video indexing system analyzes contents of source video and develops a visual table of contents using selected images. A system for detecting significant scenes detects video cuts from one scene to another, and static scenes based on DCT coefficients and macroblocks. A keyframe filtering process filters out less desired frames including, for example, unicolor frames, or those frames having a same object as a primary focus or one primary focuses. Commercials may also be detected and frames of commercials eliminated. The significant scenes and static scenes are detected based on a threshold which is set based on the category of the video.

公开(公告)号：US20020186768A1

公开(公告)日：2002-12-12

申请号：US09854511

申请日：2001-05-14

Applicant: Koninklijke Philips Electronics N.V.

Inventor： Nevenka Dimitrova ,  Thomas McGee ,  Gerhardus Mekenkamp ,  Edwin Salomons

IPC: H04N007/12

CPC classification number: H04N21/44008 ,  H04N19/137 ,  H04N19/142 ,  H04N19/61 ,  H04N21/235 ,  H04N21/2353 ,  H04N21/435 ,  H04N21/812

Abstract: The process of compressing video requires the calculation of a variety data that are used in the process of compression. The invention exploits some or all of these data for purposes of content detection. For example, these data may be leveraged for purposes of commercial detection. The luminance, motion vector field, residual values, quantizer, bit rate, etc. may all be used either directly or in combination, as signatures of content. A process for content detection may employ one or more features as indicators of the start and/or end of a sequence containing a particular type of content and other features as verifiers of the type of content bounded by these start/end indicators. The features may be combined and/or refined to produce higher-level feature data with good computational economy and content-classification utility.

Abstract translation: 压缩视频的过程需要计算在压缩过程中使用的各种数据。 本发明利用这些数据中的一些或全部用于内容检测的目的。 例如，这些数据可以用于商业检测的目的。 亮度，运动矢量场，残差值，量化器，比特率等都可以直接地或组合地用作内容的签名。 用于内容检测的过程可以使用一个或多个特征作为包含特定类型的内容和其他特征的序列的开始和/或结束的指示，作为由这些开始/结束指示符限定的内容类型的验证者。 这些特征可以被组合和/或改进以产生具有良好计算经济性和内容分类效用的较高级别的特征数据。