公开(公告)号：US5408274A

公开(公告)日：1995-04-18

申请号：US29435

申请日：1993-03-11

申请人： Shih-Fu Chang ,  David Messerschmitt ,  Wen-Lung Chen

发明人： Shih-Fu Chang ,  David Messerschmitt ,  Wen-Lung Chen

IPC分类号： H04N5/262 ,  H04N7/26 ,  H04N7/50 ,  H04N21/2365 ,  H04N21/434 ,  H04N7/133 ,  H04N7/137

CPC分类号： H04N5/262 ,  H04N19/40 ,  H04N19/48 ,  H04N19/61 ,  H04N19/90 ,  H04N21/2365 ,  H04N21/4347

摘要： Inverse motion compensating devices are used to transform motion compensated transform domain video signals to corresponding transform domain video signals. A compositing mechanism receives the transform domain video signals from the inverse motion compensating devices and performs transform domain video compositing operations directly on the transform domain video signals. The compositing operations result in a single composited signal incorporating each of the transform domain video signals. The single composited signal may be encoded for motion compensation to generate a single motion compensated transform domain video signal suitable for transmission. After transmission, inverse transform domain operations and inverse motion compensation operations may be performed to reconstruct the composited signal. The composited signal may then be projected on a video display device.

摘要翻译： 逆运动补偿装置用于将运动补偿的变换域视频信号转换成相应的变换域视频信号。 合成机构从逆运动补偿装置接收变换域视频信号，直接对变换域视频信号进行变换域视频合成操作。 合成操作导致结合每个变换域视频信号的单个合成信号。 单个合成信号可以被编码用于运动补偿以产生适合于传输的单个运动补偿变换域视频信号。 在传输之后，可以执行逆变换域操作和反向运动补偿操作以重建合成信号。 合成信号然后可以投影在视频显示设备上。

公开(公告)号：US09239877B2

公开(公告)日：2016-01-19

申请号：US13169330

申请日：2011-06-27

申请人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

公开(公告)号：US08135221B2

公开(公告)日：2012-03-13

申请号：US12574716

申请日：2009-10-07

申请人： Wei Jiang ,  Courtenay Cotton ,  Shih-Fu Chang ,  Daniel P. Ellis ,  Alexander C. Loui

发明人： Wei Jiang ,  Courtenay Cotton ,  Shih-Fu Chang ,  Daniel P. Ellis ,  Alexander C. Loui

IPC分类号： G06K9/62 ,  G06K9/54

CPC分类号： G06K9/00765 ,  G10L25/00

摘要： A method for determining a classification for a video segment, comprising the steps of: breaking the video segment into a plurality of short-term video slices, each including a plurality of video frames and an audio signal; analyzing the video frames for each short-term video slice to form a plurality of region tracks; analyzing each region track to form a visual feature vector and a motion feature vector; analyzing the audio signal for each short-term video slice to determine an audio feature vector; forming a plurality of short-term audio-visual atoms for each short-term video slice by combining the visual feature vector and the motion feature vector for a particular region track with the corresponding audio feature vector; and using a classifier to determine a classification for the video segment responsive to the short-term audio-visual atoms.

摘要翻译： 一种用于确定视频段的分类的方法，包括以下步骤：将视频段分解成多个短视频片段，每个短片段包括多个视频帧和音频信号; 分析每个短期视频片段的视频帧以形成多个区域轨道; 分析每个区域轨迹以形成视觉特征向量和运动特征向量; 分析每个短期视频片段的音频信号以确定音频特征向量; 通过将特定区域轨道的视觉特征向量和运动特征向量与相应的音频特征向量组合，形成每个短期视频片段的多个短期视听原子; 并且使用分类器来确定响应于短期视听原子的视频片段的分类。

公开(公告)号：US20110064136A1

公开(公告)日：2011-03-17

申请号：US12874337

申请日：2010-09-02

申请人： Shih-Fu Chang ,  Horace J. Meng

发明人： Shih-Fu Chang ,  Horace J. Meng

IPC分类号： H04N11/02

CPC分类号： G11B27/28 ,  G11B27/034

摘要： A system and method is provided for editing and parsing compressed digital information. The compressed digital information may include visual information which is edited and parsed in the compressed domain. In a preferred embodiment, the present invention provides a method for detecting moving objects in a compressed digital bitstream which represents a sequence of fields or frames of video information for one or more captured scenes of video.

摘要翻译： 提供了一种用于编辑和解析压缩数字信息的系统和方法。 压缩的数字信息可以包括在压缩域中编辑和解析的视觉信息。 在优选实施例中，本发明提供了一种用于检测压缩数字比特流中的运动对象的方法，该压缩数字比特流表示视频的一个或多个拍摄场景的视频信息的字段或帧序列。

公开(公告)号：US07254285B1

公开(公告)日：2007-08-07

申请号：US09831215

申请日：1999-11-05

申请人： Seungup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence D. Bergman ,  Atul Puri ,  Qian Huang

发明人： Seungup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence D. Bergman ,  Atul Puri ,  Qian Huang

IPC分类号： G06K9/60

CPC分类号： G06K9/4685

摘要： Systems and methods for describing image content establish image description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). For image content, image objects can include global objects (O0 8) and local objects (O1 2 and O2 6). The image objects are further defined by a number of features of different classes (36, 38 and 40), which in turn are further defined by a number of feature descriptors. The relationships between and among the objects in the object set are defined by the object hierarchy (26) and entity relation graphs (28). The image description records provide a standard vehicle for describing the content and context of image information for subsequent access and processing by computer applications such as search engines, filters, and archive systems.

摘要翻译： 用于描述图像内容的系统和方法建立包括对象集（24），对象层次（26）和实体关系图（28）的图像描述记录。 对于图像内容，图像对象可以包括全局对象（O 0 8）和本地对象（O 1 2和O 2 6）。 图像对象由不同类别（36,38和40）的许多特征进一步限定，这些特征又由许多特征描述符进一步限定。 对象集合中的对象之间和之间的关系由对象层次结构（26）和实体关系图（28）定义。 图像描述记录提供用于描述图像信息的内容和上下文的标准车辆，用于随后由计算机应用（例如搜索引擎，过滤器和归档系统）的访问和处理。

公开(公告)号：US06879703B2

公开(公告)日：2005-04-12

申请号：US10220776

申请日：2002-01-10

申请人： Ching-Yung Lin ,  Shih-Fu Chang

发明人： Ching-Yung Lin ,  Shih-Fu Chang

IPC分类号： G06T1/00 ,  H04N1/32 ,  G06K9/10

CPC分类号： G06T1/0057 ,  G06T1/0042 ,  G06T1/005 ,  G06T2201/0052 ,  G06T2201/0061 ,  H04N1/32165 ,  H04N1/32187 ,  H04N1/32277 ,  H04N1/3232 ,  H04N2201/3236 ,  H04N2201/327

摘要： Digital watermarks are embedded in image data (102)in order to enable authentication of the image data and/or replacement of rejected portions of the image data. Authentication codes are derived by comparing selected discrete cosine transform (DCT) (104) coefficients within DCT data (106) derived from the original, spatial-domain image data. The authentication codes thus generated are embedded in DCT coefficients (612) other than the ones which were used to derive the authentication codes. The resulting, watermarked data can be sent or made available to one or more recipients who can compress or otherwise use the watermarked data. Image data derived from the watermarked data—e.g, compressed versions of the watermarked data—can be authenticated by: extracting the embedded authentication codes, comparing DCT coefficients derived from the coefficients from which the original authentication codes were generated; and determining whether the compared DCT coefficients are consistent with the extracted authentication codes.

摘要翻译： 数字水印被嵌入在图像数据（102）中，以便能够对图像数据进行认证和/或替换图像数据的被拒绝的部分。 通过比较从原始的空间域图像数据导出的DCT数据（106）内的选定的离散余弦变换（DCT）（104）系数，导出认证码。 这样生成的认证码被嵌入除了用于导出认证码的那些之外的DCT系数（612）中。 所得到的水印数据可以被发送或使其可用于可压缩或以其他方式使用水印数据的一个或多个接收者。 从水印数据导出的图像数据（例如，水印数据的压缩版本）可以通过以下方式来认证：提取嵌入的认证码，比较从产生原始认证码的系数导出的DCT系数; 以及确定所述比较的DCT系数是否与所提取的认证码一致。

公开(公告)号：US08364673B2

公开(公告)日：2013-01-29

申请号：US12969101

申请日：2010-12-15

申请人： Shih-Fu Chang ,  Eric Zavesky

发明人： Shih-Fu Chang ,  Eric Zavesky

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30274 ,  G06F17/30277 ,  G06F17/30967 ,  G06F17/30994

摘要： Systems and methods for searching a database of media content wherein the user can dynamically and interactively perform searches and navigate search results. One or more search anchors are received, and at least one of the search anchors is associated with an anchor cell on a navigation map. One or more documents assigned to at least one cell on the navigation map can be determined, and the cells are populated with search results based at least in part on the search anchors. At least one of the documents is then displayed to a user.

摘要翻译： 用于搜索媒体内容的数据库的系统和方法，其中用户可以动态地和交互地执行搜索并导航搜索结果。 接收一个或多个搜索锚点，并且搜索锚点中的至少一个与导航地图上的锚小区相关联。 可以确定分配给导航地图上的至少一个单元的一个或多个文档，并且至少部分地基于搜索锚点来填充具有搜索结果的单元。 然后，至少一个文档被显示给用户。

公开(公告)号：US20110314367A1

公开(公告)日：2011-12-22

申请号：US13165553

申请日：2011-06-21

申请人： Shih-Fu Chang ,  Jun Wang ,  Tony Jebara

发明人： Shih-Fu Chang ,  Jun Wang ,  Tony Jebara

IPC分类号： G06F17/20

CPC分类号： G06F16/437

摘要： A system and method for labeling and classifying multimedia data is provided that includes novel label propagation techniques and classification function characteristics. The system and method corrects and propagates a small number of potentially erroneous labels to a large amount of multimedia data and generate optimal ways of ranking, classification, and presentation of the data sets. The disclosed systems and methods improve upon prior systems and methods and provide an improved approach to the problems of imbalanced data sets and incorrect label data.

摘要翻译： 提供了一种用于标记和分类多媒体数据的系统和方法，其包括新颖的标签传播技术和分类功能特征。 该系统和方法将少量潜在错误的标签校正并传播到大量的多媒体数据，并产生数据集的排序，分类和呈现的最佳方式。 所公开的系统和方法改进了现有系统和方法，并且提供了对不平衡数据集和不正确标签数据的问题的改进方法。

公开(公告)号：US07599965B1

公开(公告)日：2009-10-06

申请号：US11616315

申请日：2006-12-27

申请人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

公开(公告)号：US20090157736A1

公开(公告)日：2009-06-18

申请号：US12372052

申请日：2009-02-17

申请人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30 ,  G06F15/16

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。