公开(公告)号：US08718386B2

公开(公告)日：2014-05-06

申请号：US12710666

申请日：2010-02-23

申请人： Madirakshi Das ,  Alexander C. Loui

发明人： Madirakshi Das ,  Alexander C. Loui

IPC分类号： G06K9/62

CPC分类号： G06K9/6267 ,  G06F17/30274 ,  G06K9/00563 ,  G06K9/00677 ,  H04N5/2251 ,  H04N5/232

摘要： A method for organizing an event timeline for a digital image collection, includes using a processor for detecting events in the digital image collection and each event's associated timespan; determining the detected events that are significant in the digital image collection; and organizing the event timeline so that the event timeline shows the significant events and a clustered representation of the other events, made available to the user at different time granularities. The organized event timeline is also used for selecting images for generating output.

摘要翻译： 一种用于组织数字图像集合的事件时间线的方法，包括使用处理器来检测数字图像集合中的事件和每个事件的相关联的时间段; 确定在数字图像收集中显着的检测到的事件; 并组织事件时间线，以便事件时间线显示其他事件的重要事件和聚集表示，使用户以不同的时间粒度可用。 组织的事件时间轴也用于选择用于生成输出的图像。

公开(公告)号：US20140056432A1

公开(公告)日：2014-02-27

申请号：US13591489

申请日：2012-08-22

申请人： Alexander C. Loui ,  Wei Jiang ,  Kevin Michael Gobeyn ,  Charles Parker

发明人： Alexander C. Loui ,  Wei Jiang ,  Kevin Michael Gobeyn ,  Charles Parker

IPC分类号： H04R29/00

CPC分类号： G10L25/51

摘要： A method for determining a semantic concept associated with an audio signal captured using an audio sensor. A data processor is used to automatically analyze the audio signal using a plurality of semantic concept detectors to determine corresponding preliminary semantic concept detection values, each semantic concept detector being adapted to detect a particular semantic concept. The preliminary semantic concept detection values are analyzed using a joint likelihood model based on predetermined pair-wise likelihoods that particular pairs of semantic concepts co-occur to determine updated semantic concept detection values. One or more semantic concepts are determined based on the updated semantic concept detection values. The semantic concept detectors and the joint likelihood model are trained together with a joint training process using training audio signals, at least some of which are known to be associated with a plurality of semantic concepts.

摘要翻译： 一种用于确定与使用音频传感器捕获的音频信号相关联的语义概念的方法。 数据处理器用于使用多个语义概念检测器自动分析音频信号，以确定对应的初步语义概念检测值，每个语义概念检测器适于检测特定的语义概念。 基于预定的成对似然性，使用联合似然模型来分析初步语义概念检测值，特定的语义概念对共同出现以确定更新的语义概念检测值。 基于更新的语义概念检测值来确定一个或多个语义概念。 语义概念检测器和联合似然模型与使用训练音频信号的联合训练过程一起训练，其中至少一些已知与多个语义概念相关联。

公开(公告)号：US20140037269A1

公开(公告)日：2014-02-06

申请号：US13565926

申请日：2012-08-03

申请人： Mrityunjay Kumar ,  Alexander C. Loui ,  Bruce Harold Pillman

发明人： Mrityunjay Kumar ,  Alexander C. Loui ,  Bruce Harold Pillman

IPC分类号： G11B27/00

CPC分类号： G06K9/00765 ,  G06K9/6249 ,  G11B27/034 ,  G11B27/28

摘要： A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. A summary is formed based on the determined video frame clusters.

摘要翻译： 一种用于从视频序列中识别一组关键视频帧的方法，包括提取每个视频帧的特征向量，并且应用组稀疏算法来表示特定视频帧的特征向量作为另一个的特征向量的组稀疏组合 视频帧。 分析与组稀疏组合相关联的加权系数，以确定时间上相邻的类似视频帧的视频帧聚类。 基于确定的视频帧聚类形成摘要。

公开(公告)号：US20140037215A1

公开(公告)日：2014-02-06

申请号：US13565911

申请日：2012-08-03

申请人： Mrityunjay Kumar ,  Alexander C. Loui ,  Bruce Harold Pillman

发明人： Mrityunjay Kumar ,  Alexander C. Loui ,  Bruce Harold Pillman

IPC分类号： G06K9/48

CPC分类号： G06K9/48 ,  G06K9/00718 ,  G06K9/00744 ,  G06K9/00751 ,  G06K9/00765 ,  G06K9/6224

摘要： A method for identifying a set of key video frames from a video sequence comprising extracting feature vectors for each video frame and applying a group sparsity algorithm to represent the feature vector for a particular video frame as a group sparse combination of the feature vectors for the other video frames. Weighting coefficients associated with the group sparse combination are analyzed to determine video frame clusters of temporally-contiguous, similar video frames. A set of key video frames are selected based on the determined video frame clusters.

摘要翻译： 一种用于从视频序列中识别一组关键视频帧的方法，包括提取每个视频帧的特征向量，并且应用组稀疏算法来表示特定视频帧的特征向量作为另一个的特征向量的组稀疏组合 视频帧。 分析与组稀疏组合相关联的加权系数，以确定时间上相邻的类似视频帧的视频帧聚类。 基于所确定的视频帧集群来选择一组关键视频帧。

公开(公告)号：US08612441B2

公开(公告)日：2013-12-17

申请号：US13021188

申请日：2011-02-04

申请人： Mark D. Wood ,  Alexander C. Loui

发明人： Mark D. Wood ,  Alexander C. Loui

IPC分类号： G06F17/30 ,  G06F7/00

CPC分类号： G06F17/30867 ,  G06F17/30244 ,  G06F17/30247 ,  G06F17/30268 ,  G06F17/30525 ,  G06F17/3074 ,  G06F17/30781 ,  G06F17/30997

摘要： A method of identifying one or more particular images from an image collection, includes indexing the image collection to provide image descriptors for each image in the image collection such that each image is described by one or more of the image descriptors; receiving a query from a user specifying at least one keyword for an image search; and using the keyword(s) to search a second collection of tagged images to identify co-occurrence keywords. The method further includes using the identified co-occurrence keywords to provide an expanded list of keywords; using the expanded list of keywords to search the image descriptors to identify a set of candidate images satisfying the keywords; grouping the set of candidate images according to at least one of the image descriptors, and selecting one or more representative images from each grouping; and displaying the representative images to the user.

公开(公告)号：US08386490B2

公开(公告)日：2013-02-26

申请号：US12912820

申请日：2010-10-27

申请人： Wei Jiang ,  Alexander C. Loui

发明人： Wei Jiang ,  Alexander C. Loui

IPC分类号： G06F7/00

CPC分类号： G06F17/30038

摘要： A method of classifying a set of semantic concepts on a second multimedia collection based upon adapting a set of semantic concept classifiers and updating concept affinity relations that were developed to classify the set of semantic concepts for a first multimedia collection. The method comprises providing the second multimedia collection from a different domain and a processor automatically classifying the semantic concepts from the second multimedia collection by adapting the semantic concept classifiers and updating the concept affinity relations to the second multimedia collection based upon the local smoothness over the concept affinity relations and the local smoothness over data affinity relations.

摘要翻译： 一种基于适应一组语义概念分类器并且更新用于对第一多媒体集合的语义概念集合进行分类而开发的概念亲和度关系来对第二多媒体集合上的一组语义概念进行分类的方法。 该方法包括从不同的域提供第二多媒体集合，并且处理器通过基于概念上的局部平​​滑度来适应语义概念分类器并且将概念兴趣关系更新到第二多媒体集合来自动地对来自第二多媒体集合的语义概念进行分类 亲和关系和数据关联关系的局部平滑度。

公开(公告)号：US08358856B2

公开(公告)日：2013-01-22

申请号：US12331927

申请日：2008-12-10

申请人： Alexander C. Loui ,  Jiang Wei

发明人： Alexander C. Loui ,  Jiang Wei

IPC分类号： G06K9/62

CPC分类号： G06K9/00664 ,  G06F17/30256 ,  G06F17/30802 ,  G06F17/30805 ,  G06F17/30808 ,  G06K9/00711

摘要： A system and method for semantic event detection in digital image content records is provided in which an event-level “Bag-of-Features” (BOF) representation is used to model events, and generic semantic events are detected in a concept space instead of an original low-level visual feature space based on the BOF representation.

摘要翻译： 提供了一种用于数字图像内容记录中的语义事件检测的系统和方法，其中使用事件级特征（BOF）表示来对事件进行建模，并且在概念空间中而不是原始信息中检测到通用语义事件 基于BOF表示的低级视觉特征空间。

公开(公告)号：US20120002868A1

公开(公告)日：2012-01-05

申请号：US12828330

申请日：2010-07-01

申请人： Alexander C. Loui ,  Madirakshi Das ,  Xu Chen

发明人： Alexander C. Loui ,  Madirakshi Das ,  Xu Chen

IPC分类号： G06K9/62 ,  G06K9/48

CPC分类号： G06K9/00677

摘要： A method for identifying digital images having matching backgrounds from a collection of digital images, comprising using a processor to perform the steps of: determining a set of one or more feature values for each digital image in the collection of digital images, wherein the set of feature values includes an edge compactness feature value that is an indication of the number of objects in the digital image that are useful for scene matching; determining a subset of the collection of digital images that are good candidates for scene matching by applying a classifier responsive to the determined feature values; applying a scene matching algorithm to the subset of the collection of digital images to identify groups of digital images having matching backgrounds; and storing an indication of the identified groups of digital images having matching backgrounds in a processor-accessible memory.

摘要翻译： 一种用于从数字图像集合中识别具有匹配背景的数字图像的方法，包括使用处理器执行以下步骤：确定数字图像集合中的每个数字图像的一个或多个特征值的集合，其中所述一组 特征值包括边缘紧凑特征值，其是数字图像中用于场景匹配的对象的数量的指示; 通过响应于所确定的特征值应用分类器来确定数字图像的集合的子集，其是场景匹配的良好候选; 将场景匹配算法应用于数字图像集合的子集，以识别具有匹配背景的数字图像组; 以及将所识别的具有匹配背景的数字图像组的指示存储在处理器可访问存储器中。

公开(公告)号：US08028249B2

公开(公告)日：2011-09-27

申请号：US11196991

申请日：2005-09-08

申请人： Alexander C. Loui ,  Frank Marino

发明人： Alexander C. Loui ,  Frank Marino

IPC分类号： G06F3/048 ,  G06F3/14

CPC分类号： G06F17/30274 ,  G06F17/30064 ,  G06F17/30265

摘要： A display system and method for operating a display and a collection of digital multimedia objects are provided. A first selection set of predefined organizational metaphors is presented and a selection of a first organizational metaphor from the first selection set is received. A second selection set of predefined organizational metaphors other than the first selected organizational metaphor is presented and a selection of a second organizational metaphor from the second selection set is received. A result is presented on the display having one of at least two group icons, each group icon indicating a group of digital multimedia objects chosen from the collection according to rules associated with the selected organizational metaphors and the content of the digital multimedia objects or any metadata associated with the digital multimedia objects. Wherein the group of digital multimedia objects indicated by each group icon are chosen according to result presentation rules.

摘要翻译： 提供了一种用于操作显示器和数字多媒体对象的集合的显示系统和方法。 提出了预定义的组织隐喻的第一选择集，并且接收到来自第一选择集的第一组织隐喻的选择。 提出除了第一选定的组织隐喻之外的第二选择集预定义的组织隐喻，并且接收到来自第二选择集的第二组织隐喻的选择。 在具有至少两个组图标中的一个的显示器上呈现结果，每个组图标指示根据与所选择的组织隐喻相关联的规则以及数字多媒体对象的内容或任何元数据从集合中选择的一组数字多媒体对象 与数字多媒体对象相关联。 其中，根据结果呈现规则选择由每个组图标指示的数字多媒体对象组。

公开(公告)号：US20110099478A1

公开(公告)日：2011-04-28

申请号：US12983904

申请日：2011-01-04

申请人： Andrew C. Gallagher ,  Samuel M. Fryer ,  Alexander C. Loui ,  Jason R. Oliver ,  Neal Eckhaus ,  Kenneth A. Parulski

发明人： Andrew C. Gallagher ,  Samuel M. Fryer ,  Alexander C. Loui ,  Jason R. Oliver ,  Neal Eckhaus ,  Kenneth A. Parulski

IPC分类号： G06F17/30 ,  G06F3/048 ,  G06F21/00

CPC分类号： H04N1/32128 ,  G06F17/30265 ,  G06F17/30551 ,  G06K9/00677

摘要： A method for associating event times or time periods with digital images in a collection for determining if a digital image is of interest, includes storing a collection of digital images each having an associated capture time; comparing the associated capture time in the collection with a special event time to determine if a digital image in the collection is of interest, wherein the comparing step includes calculation of a special event time associated with a special event based on the calendar time associated with the special event and using such information to perform the comparison step; and associating digital images of interest with the special event.

摘要翻译： 一种用于将事件时间或时间段与集合中的数字图像相关联以确定数字图像是否感兴趣的方法，包括存储每个具有相关联的捕获时间的数字图像的集合; 将所述集合中的相关联的捕获时间与特殊事件时间进行比较，以确定所述集合中的数字图像是否是感兴趣的，其中所述比较步骤包括基于与所述特定事件相关联的日历时间来计算与特殊事件相关联的特殊事件时间 特殊事件并使用这些信息来执行比较步骤; 并将感兴趣的数字图像与特殊事件相关联。