Identifying video highlights using audio-visual objects
    1.
    发明申请
    Identifying video highlights using audio-visual objects 审中-公开
    使用视听对象识别视频亮点

    公开(公告)号:US20060059120A1

    公开(公告)日:2006-03-16

    申请号:US10928829

    申请日:2004-08-27

    IPC分类号: G06F17/30

    摘要: A method identifies highlight segments in a video including a sequence of frames. Audio objects are detected to identify frames associated with audio events in the video, and visual objects are detected to identify frames associated with visual events. Selected visual objects are matched with an associated audio object to form an audio-visual object only if the selected visual object matches the associated audio object, the audio-visual object identifying a candidate highlight segment. The candidate highlight segments are further refined, using low level features, to eliminate false highlight segments.

    摘要翻译: 一种方法识别包括帧序列的视频中的高亮段。 检测音频对象以识别与视频中的音频事件相关联的帧,并且检测可视对象以识别与视觉事件相关联的帧。 仅当所选择的视觉对象与相关联的音频对象匹配时,所选择的可视对象与相关联的音频对象匹配才能形成视听对象,该视听对象识别候选高亮段。 候选高亮段进一步细化,使用低级特征,消除假高光段。

    Method for detecting short term unusual events in videos
    4.
    发明授权
    Method for detecting short term unusual events in videos 失效
    视频中短期异常事件的检测方法

    公开(公告)号:US07327885B2

    公开(公告)日:2008-02-05

    申请号:US10610467

    申请日:2003-06-30

    IPC分类号: G06K9/46 H04H9/00 H04N7/18

    摘要: A method detects short term, unusual events in a video. First, features are extracted features from the audio and the video portions of the video. Segments of the video are labeled according to the features. A global sliding window is applied to the labeled segments to determine global characteristics over time, while a local sliding window is applied only to the labeled segments of the global sliding window to determine local characteristic over time. The local window is substantially shorter in time than the global window. A distance between the global and local characteristic is measured to determine occurrences of the unusual short time events.

    摘要翻译: 一种方法可以检测视频中的短期,异常事件。 首先,功能是从视频的音频和视频部分中提取的特征。 视频的片段根据功能进行标注。 将全局滑动窗口应用于标记的段以确定随时间的全局特性,而局部滑动窗口仅应用于全局滑动窗口的标记段以确定随时间的局部特性。 本地窗口在时间上比全局窗口短得多。 测量全局和局部特性之间的距离,以确定异常短时间事件的发生。

    Task specific audio classification for identifying video highlights
    6.
    发明申请
    Task specific audio classification for identifying video highlights 有权
    用于识别视频亮点的任务特定音频分类

    公开(公告)号:US20070162924A1

    公开(公告)日:2007-07-12

    申请号:US11326818

    申请日:2006-01-06

    IPC分类号: H04N7/16 H04H9/00

    摘要: A method classifies segments of a video using an audio signal of the video and a set of classes. Selected classes of the set are combined as a subset of important classes, the subset of important classes being important for a specific highlighting task, the remaining classes of the set are combined as a subset of other classes. The subset of important classes and classes are trained with training audio data to form a task specific classifier. Then, the audio signal can be classified using the task specific classifier as either important or other to identify highlights in the video corresponding to the specific highlighting task. The classified audio signal can be used to segment and summarize the video.

    摘要翻译: 一种方法使用视频的音频信号和一组类来分类视频的片段。 集合的所选类被组合为重要类的子集,重要类的子集对于特定高亮任务是重要的,集合的剩余类被组合为其他类的子集。 通过训练音频数据来训练重要类和类的子集,以形成任务特定的分类器。 然后,可以使用任务专用分类器将音频信号分类为重要的或其他的,以识别与特定突出显示任务相对应的视频中的亮点。 分类音频信号可用于分割和总结视频。

    Unusual event detection using motion activity descriptors
    8.
    发明授权
    Unusual event detection using motion activity descriptors 失效
    使用运动活动描述符的异常事件检测

    公开(公告)号:US06823011B2

    公开(公告)日:2004-11-23

    申请号:US09997497

    申请日:2001-11-19

    IPC分类号: H04N712

    摘要: A method detects an unusual event in a video. Motion vectors are extracted from each frame in a video acquired by a camera of a scene. Zero run-length parameters are determined for each frame from the motion vectors. The zero run-length parameters are summed over predetermined time intervals of the video, and a distance is determined between the sum of the zero run-lengths of a current time interval and the sum of the zero run-lengths of a previous time interval. Then, the unusual event is detected if the distance is greater than a predetermined threshold.

    摘要翻译: 一种方法检测视频中的异常事件。 在由场景的相机获取的视频中的每个帧中提取运动矢量。 从运动矢量为每个帧确定零游程长度参数。 零游程长度参数在视频的预定时间间隔上相加,并且在当前时间间隔的零游程长度与前一时间间隔的零游程长度之和之间确定距离。 然后,如果距离大于预定阈值,则检测到异常事件。

    Multimedia event detection and summarization
    9.
    发明授权
    Multimedia event detection and summarization 失效
    多媒体事件检测与总结

    公开(公告)号:US07409407B2

    公开(公告)日:2008-08-05

    申请号:US10840824

    申请日:2004-05-07

    IPC分类号: G06F17/30 G06F17/00

    摘要: A method detects events in multimedia. Features are extracted from the multimedia. The features are sampled using a sliding window to obtain samples. A context model is constructed for each sample. An affinity matrix is determined from the models and a commutative distance metric between each pair of context models. A second generation eigenvector is determined for the affinity matrix, and the samples are then clustered into events according to the second generation eigenvector.

    摘要翻译: 一种方法来检测多媒体中的事件。 功能从多媒体提取。 使用滑动窗口对特征进行采样以获得样品。 为每个样本构建上下文模型。 从模型和每对上下文模型之间的交换距离度量确定亲和度矩阵。 针对亲和度矩阵确定第二代特征向量,然后根据第二代特征向量将样本聚类成事件。