Method and apparatus for generating a summary of an audio/visual data stream
    1.
    发明授权
    Method and apparatus for generating a summary of an audio/visual data stream 失效
    用于生成音频/视频数据流的概要的方法和装置

    公开(公告)号:US08542983B2

    公开(公告)日:2013-09-24

    申请号:US12994164

    申请日:2009-06-02

    IPC分类号: H04N5/93

    CPC分类号: G11B27/02

    摘要: A method of generating a summary of an audio/visual data stream is provided, the data stream comprising a plurality of consecutive frames having audio and visual properties. A plurality of shots of an audio/visual data stream are detected (step 204). A plurality of segments of the audio/visual data stream are determined (step 206), each segment comprising a plurality of the shots of the data stream having similar visual properties. A segment of the determined plurality of segments is selected (step 208). For each shot of said selected segment of said data stream, the audio in a plurality of consecutive frames which occur after the end of said shot is extracted (step 210). At least one of the shots is selected based on the extracted audio (step 212). A summary is generated to include the selected at least one of the shots (step 214).

    摘要翻译: 提供了一种产生音频/视频数据流的概要的方法,所述数据流包括具有音频和视觉属性的多个连续帧。 检测音频/视频数据流的多个镜头(步骤204)。 确定音频/视频数据流的多个段(步骤206),每个段包括具有相似视觉特性的数据流的多个镜头。 选择确定的多个段的段(步骤208)。 对于所述数据流的所述选择的段的每个镜头,提取在所述镜头结束之后出现的多个连续帧中的音频(步骤210)。 基于所提取的音频来选择拍摄中的至少一个(步骤212)。 生成摘要以包括所选择的至少一个拍摄(步骤214)。

    METHOD AND APPARATUS FOR GENERATING A SEQUENCE OF A PLURALITY OF IMAGES TO BE DISPLAYED WHILST ACCOMPANIED BY AUDIO
    2.
    发明申请
    METHOD AND APPARATUS FOR GENERATING A SEQUENCE OF A PLURALITY OF IMAGES TO BE DISPLAYED WHILST ACCOMPANIED BY AUDIO 审中-公开
    用于产生多余图像的序列的方法和装置将被显示在音频附近

    公开(公告)号:US20110184542A1

    公开(公告)日:2011-07-28

    申请号:US13122601

    申请日:2009-09-28

    IPC分类号: G06F17/00

    摘要: A sequence of a plurality of images to be displayed as a slide show whilst accompanied by an audio item is generated by extracting (209) at least one feature of an audio item, such as pace, —extracting (203) at least one feature of each of a plurality of images; and determining (215) the next image to generate a sequence of selected ones of the plurality of images to be displayed whilst accompanied by the audio item on the basis of the extracted at least one feature of the audio item and on the basis of the extracted at least one feature of the image.

    摘要翻译: 通过提取(209)音频项目的至少一个特征(例如,步速, - 提取(203))至少一个特征,生成要显示为幻灯片放映的多个图像的序列,同时伴随着音频项目 多个图像中的每一个; 以及基于所提取的所述音频项目的至少一个特征,并且基于所提取的所述音频项目的所述至少一个特征,确定(215)所述下一个图像以生成要显示的所述多个图像中的所选择的图像的序列,同时伴随所述音频项目 图像的至少一个特征。

    METHOD FOR CONTROLLING A SECOND MODALITY BASED ON A FIRST MODALITY
    3.
    发明申请
    METHOD FOR CONTROLLING A SECOND MODALITY BASED ON A FIRST MODALITY 审中-公开
    基于第一模态控制第二模态的方法

    公开(公告)号:US20120117373A1

    公开(公告)日:2012-05-10

    申请号:US13383677

    申请日:2010-07-06

    IPC分类号: G06F9/06

    摘要: A method for controlling a second modality based on a first modality is provided. The method comprises the steps: providing a first modality comprising time-dependent characteristics and a second modality capable of changing its appearance over time; automatically determining changes in the appearance of the second modality based on the time-dependent characteristics of the first modality; adjusting a smoothing degree by means of a user input device; and adapting the determined changes in appearance of the second modality based on the smoothing degree and on boundaries present in the time-dependent characteristics of the first modality to arrive at resulting changes in the appearance of the second modality.

    摘要翻译: 提供了一种基于第一模态来控制第二模态的方法。 该方法包括以下步骤:提供包括时间相关特性的第一模态和能够随时间改变其外观的第二模态; 基于第一模态的时间依赖特性自动确定第二模态的外观的变化; 通过用户输入装置调整平滑度; 以及基于所述平滑度和所述第一模态的时间相关特性中存在的边界来适应所确定的所述第二模态的变化的变化,以得到所述第二模态的出现的变化。

    METHOD AND APPARATUS FOR SELECTING A REPRESENTATIVE IMAGE
    4.
    发明申请
    METHOD AND APPARATUS FOR SELECTING A REPRESENTATIVE IMAGE 审中-公开
    选择代表性图像的方法和装置

    公开(公告)号:US20120082378A1

    公开(公告)日:2012-04-05

    申请号:US13377841

    申请日:2010-06-08

    IPC分类号: G06K9/62 G06K9/46 G06K9/00

    CPC分类号: G06F16/58

    摘要: A method of selecting at least one representative image from a plurality of images, the method comprising the steps of: dividing (201) the plurality of images into clusters according to a predetermined characteristic of the content of the plurality of images; selecting (203) at least one of the clusters based on the number of images in each of the clusters; and selecting (205) at least one image from the selected at least one cluster as the representative image.

    摘要翻译: 一种从多个图像中选择至少一个代表图像的方法,所述方法包括以下步骤:根据所述多个图像的内容的预定特征将所述多个图像分割(201)成簇; 基于每个聚类中的图像数目来选择(203)至少一个聚类; 以及从所选择的至少一个群集中选择(205)至少一个图像作为代表图像。

    METHOD AND APPARATUS FOR PRESENTING A SUMMARY OF A CONTENT ITEM
    5.
    发明申请
    METHOD AND APPARATUS FOR PRESENTING A SUMMARY OF A CONTENT ITEM 审中-公开
    用于提供内容项目概要的方法和装置

    公开(公告)号:US20110066961A1

    公开(公告)日:2011-03-17

    申请号:US12992632

    申请日:2009-05-18

    IPC分类号: G06F3/048

    CPC分类号: G06F16/40 G06F16/70

    摘要: A summary comprising a plurality of selected segments of the content item is presented to a user (step 202) and a user input is received (step 204). The non-selected segments located between a previously presented segment and the segment being presented at the time of receiving said user input are determined (step 206) and each non-selected segment is assigned a ranking value (step 208). At least one non-selected segment is presented (step 210). Presentation of the selected segment being presented at the time of receiving the user input is resumed (step 212).

    摘要翻译: 向用户呈现包括内容项目的多个所选段的摘要(步骤202)并且接收到用户输入(步骤204)。 确定位于先前呈现的段和在接收所述用户输入时呈现的段之间的未选择的段(步骤206),并为每个未选择的段指定排序值(步骤208)。 呈现至少一个未选择的段(步骤210)。 恢复在接收到用户输入时呈现的所选择的段的呈现(步骤212)。

    METHOD AND APPARATUS FOR DETERMINING A VALUE OF AN ATTRIBUTE TO BE ASSOCIATED WITH AN IMAGE
    6.
    发明申请
    METHOD AND APPARATUS FOR DETERMINING A VALUE OF AN ATTRIBUTE TO BE ASSOCIATED WITH AN IMAGE 审中-公开
    用于确定与图像相关的属性的值的方法和装置

    公开(公告)号:US20120121171A1

    公开(公告)日:2012-05-17

    申请号:US13386922

    申请日:2010-07-20

    IPC分类号: G06K9/00

    CPC分类号: G06T7/90 G06T2207/10024

    摘要: A method for determining a value of an attribute to be associated with an image, the method comprising the steps of: determining saturation of each of a plurality of pixels of an image; selecting a set of a plurality of pixels from the pixels of the image having a saturation above a predetermined level; determining a value of an attribute on the basis of the selected set of pixels; and associating the determined value of the attribute with the image.

    摘要翻译: 一种用于确定与图像相关联的属性的值的方法,所述方法包括以下步骤:确定图像的多个像素中的每一个的饱和度; 从具有高于预定水平的饱和度的图像的像素中选择一组多个像素; 基于所选择的像素集合确定属性的值; 以及将确定的属性值与图像相关联。

    DOMINANT COLOR DESCRIPTORS
    7.
    发明申请
    DOMINANT COLOR DESCRIPTORS 审中-公开
    主要色彩描述

    公开(公告)号:US20100092077A1

    公开(公告)日:2010-04-15

    申请号:US12445473

    申请日:2007-10-12

    IPC分类号: G06K9/00

    CPC分类号: G06K9/4652 G06F16/5838

    摘要: A system computes a combined dominant color descriptor (DCD) of a plurality of images (IM 1, IM 2, IM n). The system comprises an input 206 for receiving a plurality of respective dominant color descriptors (DCD 1, DCD 2, DCD n) of respective images of the plurality of images (IM 1, IM 2, IM n). The system further comprises means 202 for generating a collection of generated color values (IM) based on dominant colors included in the received dominant color descriptors (DCD 1, DCD 2, DCD n), and means 204 for computing at least one dominant color of the collection of generated color values (IM) for inclusion in the combined dominant color descriptor (DCD). In the collection, at least one generated color value is included representing a dominant color in one of the received dominant color descriptors.

    摘要翻译: 系统计算多个图像(IM 1,IM 2,IM n)的组合主色色描述符(DCD)。 该系统包括用于接收多个图像(IM 1,IM 2,IM n)的各个图像的多个相应主要颜色描述符(DCD 1,DCD 2,DCD n)的输入端206。 该系统还包括用于基于包括在所接收的主要颜色描述符(DCD 1,DCD 2,DCD n)中的主要颜色生成生成的颜色值(IM)的集合的装置202,以及用于计算至少一个主色 收集生成的颜色值(IM)以包含在组合的主色色描述符(DCD)中。 在集合中,包括在所接收的主色色描述符之一中表示主色的至少一个生成的颜色值。

    DEVICE AND A METHOD FOR PLAYING AUDIO-VIDEO CONTENT
    8.
    发明申请
    DEVICE AND A METHOD FOR PLAYING AUDIO-VIDEO CONTENT 审中-公开
    设备和播放音视频内容的方法

    公开(公告)号:US20100122277A1

    公开(公告)日:2010-05-13

    申请号:US12307941

    申请日:2007-06-27

    申请人: PEDRO FONSECA

    发明人: PEDRO FONSECA

    IPC分类号: H04H60/33

    摘要: A device and a method for playing audio-video content (205) during which loss of attention of a user (192) is detected. Loss of attention of the user generates at least one attention loss marker (255) that is stored in an attention loss storage unit (210). The user may revert playback to a point in time corresponding to the attention loss marker using a user interface unit (190). By storing markers corresponding to points of attention loss by the user and requiring explicit user input, the attention loss detector may detect attention loss with an accuracy lower than would otherwise be the case. Optionally, storing of the attention loss markers may be made conditional upon a content analysis unit (420), such as a commercial block detector. An attention loss marker indication (260) may be made visible to the user to indicate that at least one attention loss marker has been detected.

    摘要翻译: 一种用于播放音频 - 视频内容(205)的装置和方法,在此期间检测到用户(192)的注意力的丧失。 用户的注意丧失产生存储在注意力丢失存储单元(210)中的至少一个注意力丢失标记(255)。 用户可以使用用户界面单元(190)将播放恢复到与注意丢失标记相对应的时间点。 通过存储与用户的注意力损失点相对应的标记,并且需要明确的用户输入,注意力损失检测器可以以比否则为更低的精度来检测注意力损失。 任选地,注意丢失标记的存储可以根据诸如商业块检测器的内容分析单元(420)进行。 注意丢失标记指示(260)可以使用户可见,以指示已经检测到至少一个注意力损失标记。