Integrated motion-still capture system with indexing capability

    公开(公告)号:US06937273B1

    公开(公告)日:2005-08-30

    申请号:US09606513

    申请日:2000-06-29

    申请人: Alexander C. Loui

    发明人: Alexander C. Loui

    摘要: A system for recording and displaying a multimedia presentation, includes a digital camera having a solid state image sensor for selectively generating a sampled analog video image signal or a higher resolution sampled analog still image signal, and a microphone for generating an analog audio signal. An analog to digital converter converts the sampled analog video image signals and audio signal to a digital image signal and digital audio signal and an audio visual encoder in the camera compresses the digital video signal and associated digital audio signal to form a compressed video bit stream. The camera is operated to periodically capture a higher resolution still image to form a still image file while capturing a video sequence. A pointer linking a captured high resolution still image with a corresponding frame in the compressed video bit stream is appended to the still image file. An object oriented image processing system, includes an image processing computer, an object oriented operating system, an image memory for storing the compressed video bit stream and the still image files as objects, a graphic user interface including a display and operator input device, a decoder for decoding the compressed video bit stream, and an application program for generating low resolution index images from the higher resolution still images with pointers linking the index images to the high resolution still images and storing the index images with their associated pointers as objects in the image memory, for displaying a plurality of the low resolution index images on the graphic user interface and responsive to operator selection of an index image from the displayed index images, employing the pointers stored with the selected index image and the associated high resolution still image, to retrieve a corresponding portion of the compressed motion image, decompressing the retrieved portion of the compressed motion image, and displaying the decompressed portion of the motion image.

    Event clustering of images using foreground/background segmentation
    42.
    发明授权
    Event clustering of images using foreground/background segmentation 有权
    使用前景/背景分割的图像的事件聚类

    公开(公告)号:US06915011B2

    公开(公告)日:2005-07-05

    申请号:US09819385

    申请日:2001-03-28

    摘要: An event clustering method uses foreground and background segmentation for clustering images from a group into similar events. Initially, each image is divided into a plurality of blocks, thereby providing block-based images. Utilizing a block-by-block comparison, each block-based image is segmented into a plurality of regions comprising at least a foreground and a background. One or more luminosity, color, position or size features are extracted from the regions and the extracted features are utilized to estimate and compare the similarity of the regions comprising the foreground and background in successive images in the group. Then, a measure of the total similarity between successive images is computed, thereby providing image distance between successive images, and event clusters are delimited from the image distances.

    摘要翻译: 事件聚类方法使用前景和背景分割将图像从一组聚类到类似的事件。 最初,每个图像被分成多个块,从而提供基于块的图像。 利用逐块比较,将每个基于块的图像分割成包括至少前景和背景的多个区域。 从区域提取一个或多个亮度,颜色,位置或大小特征,并且使用提取的特征来估计和比较组中连续图像中包括前景和背景的区域的相似度。 然后,计算连续图像之间的总相似度的度量,从而提供连续图像之间的图像距离,并且从图像距离界定事件簇。

    Video summarization using audio and visual cues

    公开(公告)号:US10134440B2

    公开(公告)日:2018-11-20

    申请号:US13099391

    申请日:2011-05-03

    IPC分类号: G11B27/034 G11B27/11

    摘要: A method for producing an audio-visual slideshow for a video sequence having an audio soundtrack and a corresponding video track including a time sequence of image frames, comprising: segmenting the audio soundtrack into a plurality of audio segments; subdividing the audio segments into a sequence of audio frames; determining a corresponding audio classification for each audio frame; automatically selecting a subset of the audio segments responsive to the audio classification for the corresponding audio frames; for each of the selected audio segments automatically analyzing the corresponding image frames to select one or more key image frames; merging the selected audio segments to form an audio summary; forming an audio-visual slideshow by combining the selected key frames with the audio summary, wherein the selected key frames are displayed synchronously with their corresponding audio segment; and storing the audio-visual slideshow in a processor-accessible storage memory.

    IMAGING WORKFLOW USING FACIAL AND NON-FACIAL FEATURES
    44.
    发明申请
    IMAGING WORKFLOW USING FACIAL AND NON-FACIAL FEATURES 审中-公开
    使用真实和非物理特征的成像工作流程

    公开(公告)号:US20170046561A1

    公开(公告)日:2017-02-16

    申请号:US15335273

    申请日:2016-10-26

    IPC分类号: G06K9/00 G06K9/62 G06F17/30

    摘要: A method for determining an impact score for a digital image includes providing the digital image wherein the digital image includes faces; using a processor to determine an image feature for the faces; using the processor to compute an object impact score for the faces, wherein the object impact score is based at least upon one of the determined image features; weighting the object impact score for the faces based on one of the determined image features for a face; using the processor to compute an impact score for the digital image by combining the weighted object impact scores for the faces in the image; and storing the computed impact score in a processor accessible memory.

    摘要翻译: 用于确定数字图像的影响分数的方法包括提供数字图像,其中所述数字图像包括面部; 使用处理器来确定面部的图像特征; 使用所述处理器来计算面部的对象影响分数,其中所述对象影响分数至少基于所确定的图像特征之一; 基于面部的所确定的图像特征之一对所述面部的对象影响分数进行加权; 使用处理器通过组合图像中的面部的加权对象影响分数来计算数字图像的影响分数; 以及将所计算的影响分数存储在处理器可访问存储器中。

    System for generating tag layouts
    45.
    发明授权
    System for generating tag layouts 有权
    用于生成标签布局的系统

    公开(公告)号:US08928929B2

    公开(公告)日:2015-01-06

    申请号:US13598260

    申请日:2012-08-29

    摘要: Generating a tag layout from a set of tags and an ordering of the set of tags, wherein each tag includes a text label and a size for the text label, is disclosed. The system includes a processor accessible memory for receiving an ordered set of tags, each tag including a text label and a size for the text label, and at least one closed shape corresponding to a space for the tag layout. The system further includes a processor for generating the tag layout by computing a scale factor for either the closed shape or the size of the text labels in the set of tags such that all the tags in the set of tags fit within the closed shape, and the processor stores the generated tag layout in the memory.

    摘要翻译: 公开了一组标签生成标签布局以及该标签集的顺序,其中每个标签包括文本标签和文本标签的尺寸。 该系统包括用于接收有序集合标签的处理器可访问存储器,每个标签包括文本标签和文本标签的尺寸,以及至少一个对应于标签布局的空间的封闭形状。 该系统还包括一个处理器,用于通过计算一组标签中的封闭形状或文本标签的尺寸的比例因子来生成标签布局,使得该组标签中的所有标签适合于封闭形状,以及 处理器将生成的标签布局存储在存储器中。

    Identifying collection images with special events
    46.
    发明授权
    Identifying collection images with special events 失效
    用特殊事件识别收集图像

    公开(公告)号:US08717461B2

    公开(公告)日:2014-05-06

    申请号:US12796698

    申请日:2010-06-09

    IPC分类号: H04N5/76 G06K9/62

    摘要: A method for associating event times or time periods with digital images in a collection for determining if a digital image is of interest, includes storing a collection of digital images each having an associated capture time; comparing the associated capture time in the collection with a special event time to determine if a digital image in the collection is of interest, wherein the comparing step includes calculation of a special event time associated with a special event based on the calendar time associated with the special event and using such information to perform the comparison step; and associating digital images of interest with the special event.

    摘要翻译: 一种用于将事件时间或时间段与集合中的数字图像相关联以确定数字图像是否感兴趣的方法,包括存储每个具有相关联的捕获时间的数字图像的集合; 将所述集合中的相关联的捕获时间与特殊事件时间进行比较,以确定所述集合中的数字图像是否是感兴趣的,其中所述比较步骤包括基于与所述特定事件相关联的日历时间来计算与特殊事件相关联的特殊事件时间 特殊事件并使用这些信息来执行比较步骤; 并将感兴趣的数字图像与特殊事件相关联。

    Method for fast scene matching
    47.
    发明授权
    Method for fast scene matching 有权
    快速场景匹配的方法

    公开(公告)号:US08548256B2

    公开(公告)日:2013-10-01

    申请号:US12828330

    申请日:2010-07-01

    IPC分类号: G06K9/68

    CPC分类号: G06K9/00677

    摘要: A method for identifying digital images having matching backgrounds from a collection of digital images, comprising using a processor to perform the steps of: determining a set of one or more feature values for each digital image in the collection of digital images, wherein the set of feature values includes an edge compactness feature value that is an indication of the number of objects in the digital image that are useful for scene matching; determining a subset of the collection of digital images that are good candidates for scene matching by applying a classifier responsive to the determined feature values; applying a scene matching algorithm to the subset of the collection of digital images to identify groups of digital images having matching backgrounds; and storing an indication of the identified groups of digital images having matching backgrounds in a processor-accessible memory.

    摘要翻译: 一种用于从数字图像集合中识别具有匹配背景的数字图像的方法,包括使用处理器执行以下步骤:确定数字图像集合中的每个数字图像的一个或多个特征值的集合,其中所述一组 特征值包括边缘紧凑特征值,其是数字图像中用于场景匹配的对象的数量的指示; 通过响应于所确定的特征值应用分类器来确定数字图像的集合的子集,其是场景匹配的良好候选; 将场景匹配算法应用于数字图像集合的子集,以识别具有匹配背景的数字图像组; 以及将所识别的具有匹配背景的数字图像组的指示存储在处理器可访问存储器中。

    VIDEO CONCEPT CLASSIFICATION USING VIDEO SIMILARITY SCORES
    48.
    发明申请
    VIDEO CONCEPT CLASSIFICATION USING VIDEO SIMILARITY SCORES 失效
    使用视频相似度的视频概念分类

    公开(公告)号:US20130089304A1

    公开(公告)日:2013-04-11

    申请号:US13269753

    申请日:2011-10-10

    IPC分类号: H04N5/93

    摘要: A method for determining a semantic concept classification for a digital video clip, comprising: receiving an audio-visual dictionary including a plurality of audio-visual grouplets, the audio-visual grouplets including visual background and foreground codewords, audio background and foreground codewords, wherein the codewords in a particular audio-visual grouplet were determined to be correlated with each other; determining reference video codeword similarity scores for a set of reference video clips; determining codeword similarity scores for the digital video clip; determining a reference video similarity score for each reference video clip representing a similarity between the digital video clip and the reference video clip responsive to the audio-visual grouplets, the codeword similarity scores and the reference video codeword similarity scores; and determining one or more semantic concept classifications using trained semantic classifiers responsive to the determined reference video similarity scores.

    摘要翻译: 一种用于确定数字视频剪辑的语义概念分类的方法,包括:接收包括多个视听小组的视听词典,所述视听小组包括视觉背景和前景码字,音频背景和前景码字,其中 确定特定视听小组中的码字彼此相关; 确定一组参考视频剪辑的参考视频码字相似性得分; 确定所述数字视频剪辑的码字相似性得分; 响应于所述视听小组,所述码字相似度得分和所述参考视频码字相似性得分,确定表示所述数字视频剪辑和所述参考视频剪辑之间的相似性的每个参考视频剪辑的参考视频相似性分数; 以及响应于所确定的参考视频相似性分数,使用经过训练的语义分类器来确定一个或多个语义概念分类。

    Detecting significant events in consumer image collections
    49.
    发明授权
    Detecting significant events in consumer image collections 有权
    检测消费者图像集合中的重大事件

    公开(公告)号:US08340436B2

    公开(公告)日:2012-12-25

    申请号:US12487686

    申请日:2009-06-19

    IPC分类号: G06K9/62

    CPC分类号: G06F17/30265 G06K9/00711

    摘要: A method for determining significant events in a digital image collection, including, using a processor for generating image counts time-series from the image collection; computing a model of the image counts time-series; and using the image counts time-series and the model to determine significant events.

    摘要翻译: 一种用于确定数字图像集合中的重要事件的方法,包括使用处理器从图像集合生成图像计数时间序列; 计算图像计数模型的时间序列; 并使用图像计数时间序列和模型来确定重要事件。

    Estimating aesthetic quality of digital images
    50.
    发明授权
    Estimating aesthetic quality of digital images 有权
    估计数字图像的审美品质

    公开(公告)号:US08311364B2

    公开(公告)日:2012-11-13

    申请号:US12566706

    申请日:2009-09-25

    IPC分类号: G06K9/36 G06K9/00

    摘要: A method for estimating the aesthetic quality of an input digital image comprising using a digital image processor for performing the following: determining one or more vanishing point(s) associated with the input digital image by automatically analyzing the digital image; computing a compositional model from at least the positions of the vanishing point(s); and producing an aesthetic quality parameter for the input digital image responsive to the compositional model, wherein the aesthetic quality parameter is an estimate for the aesthetic quality of the input digital image.

    摘要翻译: 一种用于估计输入数字图像的美学质量的方法,包括使用数字图像处理器执行以下操作:通过自动分析数字图像来确定与输入数字图像相关联的一个或多个消失点; 从消失点的至少位置计算组成模型; 以及响应于所述组合模型产生用于所述输入数字图像的美学质量参数,其中所述美学质量参数是所述输入数字图像的美学质量的估计。