Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes
    1.
    发明授权
    Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes 有权
    通过选择,可视化和与故事板关键帧的交互来分析固定摄像机视频的方法和系统

    公开(公告)号:US08089563B2

    公开(公告)日:2012-01-03

    申请号:US11324557

    申请日:2006-01-03

    IPC分类号: H04N5/14 H04N7/18 G06K9/34

    摘要: Techniques for generating a storyboard are disclosed. In one embodiment of the invention the storyboard is comprised of videos from one or more cameras based on the identification of activity in the video. Various embodiments of the invention include an assessment of the importance of the activity, the creation of a storyboard presentation based on importance and interaction techniques for seeing more details or alternate views of the video. In one embodiment, motion detection is used to determine activity in one or more synchronized video streams. Periods of activity are recognized and assigned importance assessments based on the activity, important locations in the video streams, and events from other sensors. In different embodiments, the interface consists of a storyboard and a map.

    摘要翻译: 公开了生成故事板的技术。 在本发明的一个实施例中,故事板由来自一个或多个相机的视频组成,基于视频中活动的识别。 本发明的各种实施例包括评估活动的重要性,基于重要性的创建故事板呈现以及用于观看视频的更多细节或替代视图的交互技术。 在一个实施例中,运动检测用于确定一个或多个同步视频流中的活动。 根据活动,视频流中的重要位置以及来自其他传感器的事件,识别和分配活动的时间段并进行重要性评估。 在不同的实施例中,界面由故事板和地图组成。

    Methods and interfaces for visualizing activity across video frames in an action keyframe
    2.
    发明授权
    Methods and interfaces for visualizing activity across video frames in an action keyframe 有权
    用于在动作关键帧中的视频帧之间可视化活动的方法和接口

    公开(公告)号:US07623677B2

    公开(公告)日:2009-11-24

    申请号:US11324355

    申请日:2006-01-03

    IPC分类号: G06K9/00 H04N7/18 H04N5/14

    CPC分类号: G06F17/30811

    摘要: Techniques for generating action keyframes for a fixed-position camera based on the identification of activity in the video, an assessment of the importance of the activity, object recognition in the video, and interaction techniques for seeing more details of the video are presented. In different embodiments of the invention, the importance of activity is determined based on the amount of activity, important locations in the video streams, detected features such as faces, and events from other sensors.

    摘要翻译: 提供了基于视频中的活动识别,活动重要性的评估,视频中的对象识别以及用于观看视频的更多细节的交互技术来生成针对固定位置摄像机的动作关键帧的技术。 在本发明的不同实施例中,活动的重要性基于活动量,视频流中的重要位置,检测到的特征(例如面部)和来自其它传感器的事件来确定。

    Methods and interfaces for event timeline and logs of video streams
    3.
    发明授权
    Methods and interfaces for event timeline and logs of video streams 有权
    事件时间线和视频流日志的方法和接口

    公开(公告)号:US07996771B2

    公开(公告)日:2011-08-09

    申请号:US11324971

    申请日:2006-01-03

    IPC分类号: G06F3/00

    摘要: Techniques for generating timelines and event logs from one or more fixed-position cameras based on the identification of activity in the video are presented. Various embodiments of the invention include an assessment of the importance of the activity, the creation of a timeline identifying events of interest, and interaction techniques for seeing more details of an event or alternate views of the video. In one embodiment, motion detection is used to determine activity in one or more synchronized video streams. In another embodiment, events are determined based on periods of activity and assigned importance assessments based on the activity, important locations in the video streams, and events from other sensors. In different embodiments, the interface consists of a timeline, event log, and map.

    摘要翻译: 提出了基于视频中的活动识别从一个或多个固定位置摄像机生成时间线和事件日志的技术。 本发明的各种实施例包括评估活动的重要性,创建识别感兴趣事件的时间线以及用于查看视频的事件或替代视图的更多细节的交互技术。 在一个实施例中,运动检测用于确定一个或多个同步视频流中的活动。 在另一个实施例中,基于活动的周期和基于活动的重要性评估,视频流中的重要位置以及来自其他传感器的事件来确定事件。 在不同的实施例中,接口由时间线,事件日志和地图组成。

    Video enabled tele-presence control host
    4.
    发明授权
    Video enabled tele-presence control host 有权
    视频启用远程存在控制主机

    公开(公告)号:US07995090B2

    公开(公告)日:2011-08-09

    申请号:US10629403

    申请日:2003-07-28

    IPC分类号: H04N7/15

    摘要: A method for exchanging information in a shared interactive environment, comprising selecting a first physical device in a first live video image wherein the first physical device has information associated with it, causing the information to be transferred to a second physical device in a second live video image wherein the transfer is brought about by manipulating a visual representation of the information, wherein the manipulation includes interacting with the first live video image and the second live video image, wherein the first physical device and the second physical device are part of the shared interactive environment, and wherein the first physical device and the second physical device are not the same.

    摘要翻译: 一种用于在共享交互环境中交换信息的方法,包括:选择第一实时视频图像中的第一物理设备,其中所述第一物理设备具有与其相关联的信息,使得所述信息被传送到第二实时视频中的第二物理设备 图像,其中通过操纵所述信息的视觉表示来实现所述传送,其中所述操纵包括与所述第一实况视频图像和所述第二实况视频图像进行交互,其中所述第一物理设备和所述第二物理设备是所述共享交互的一部分 环境,并且其中所述第一物理设备和所述第二物理设备不相同。

    Systems and methods for organizing files in a graph-based layout
    5.
    发明授权
    Systems and methods for organizing files in a graph-based layout 有权
    用于在基于图形的布局中组织文件的系统和方法

    公开(公告)号:US08832119B2

    公开(公告)日:2014-09-09

    申请号:US12137718

    申请日:2008-06-12

    CPC分类号: G06F17/30058

    摘要: An adaptive, interactive visual workspace for viewing groups of files based on their relationships. Relationships of files are visualized using iterative refinement of categories through a direct-manipulation graph-based layout. The visual workspace starts with a fully connected graph linking thumbnail images of related files that is then partitioned into neighborhoods in response to a user creating file stacks corresponding to different categories. Normalized spring lengths improve the overall quality of the layout. Different modes for membership in neighborhoods avoid confusing motion of files and help a user to manually organize the workspace. Additionally, retrieved files can be added without having to significantly move the previous files. Different visualization techniques indicate which files are related to each other. Different zoom rates are used for file location, and surrogate sizes allow users to increase the separation between files while still increasing the surrogate sizes.

    摘要翻译: 一个自适应的交互式视觉工作区,用于根据他们的关系来查看文件组。 文件的关系通过直接操作图形布局的类别迭代细化进行可视化。 可视化工作区以完全连接的图形开始,将图形相关联的文件链接起来,然后将其分成邻域,以响应用户创建对应于不同类别的文件堆栈。 标准化的弹簧长度提高了布局的整体质量。 用于居民区成员身份的不同模式可避免混淆文件运动,并帮助用户手动组织工作区。 此外,可以添加检索到的文件,而不必显着移动以前的文件。 不同的可视化技术指出哪些文件是相互关联的。 文件位置使用不同的缩放比例,替代尺寸允许用户增加文件之间的间隔,同时仍然增加代理大小。

    Genetic segmentation method for data, such as image data streams
    6.
    发明授权
    Genetic segmentation method for data, such as image data streams 有权
    用于数据的遗传分割方法,如图像数据流

    公开(公告)号:US06819795B1

    公开(公告)日:2004-11-16

    申请号:US09611389

    申请日:2000-07-07

    IPC分类号: G06K934

    CPC分类号: G11B27/28

    摘要: A method, information system, and computer-readable medium is provided for segmenting a plurality of data, such as multimedia data, and in particular an image document stream. Segment boundary points may be used for retrieving and/or browsing the plurality of data. Similarly, segment boundary points may be used to summarize the plurality of data. Examples of image document streams include video, PowerPoint slides, and NoteLook pages. A genetic method having a fitness or evaluation function using information retrieval concepts, such as importance and precedence, is used to obtain segment boundary points. The genetic method is able to evaluate a large amount of data in a cost effective manner. The genetic method is also able to run incrementally on streaming video and adapt to usage patterns by considering frequently accessed images.

    摘要翻译: 提供了一种方法,信息系统和计算机可读介质,用于分割多个数据,例如多媒体数据,特别是图像文档流。 段边界点可用于检索和/或浏览多个数据。 类似地,段边界点可以用于汇总多个数据。 图像文档流的示例包括视频,PowerPoint幻灯片和NoteLook页面。 使用具有使用诸如重要性和优先级之类的信息检索概念的适应度或评价函数的遗传方法来获得段边界点。 遗传方法能够以成本有效的方式评估大量数据。 遗传方法还能够在流式视频上逐步运行,并通过考虑频繁访问的图像来适应使用模式。

    Methods and apparatuses for interactive similarity searching, retrieval and browsing of video
    7.
    发明授权
    Methods and apparatuses for interactive similarity searching, retrieval and browsing of video 有权
    视频互动相似搜索,检索和浏览的方法和装置

    公开(公告)号:US07246314B2

    公开(公告)日:2007-07-17

    申请号:US10859832

    申请日:2004-06-03

    IPC分类号: G06F15/00 G06F14/00

    摘要: Methods for interactive selecting video queries consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

    摘要翻译: 公开了用于交互式选择由用于视频相似性搜索的视频的训练图像组成的视频查询和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧,或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量,计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧,从帧的变换中提取特征向量,并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性,这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度,从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

    System and method for presenting video search results

    公开(公告)号:US20060106764A1

    公开(公告)日:2006-05-18

    申请号:US10986735

    申请日:2004-11-12

    IPC分类号: G06F17/30

    摘要: The invention displays video search results in a form that makes it easy for users to determine which results are truly relevant. Each story returned as a search result is visualized as a collage of keyframes from the story's shots. The selected keyframes and their sizes depend on the corresponding shots' respective relevance. Shot relevance depends on the search retrieval score of the shot and, in some embodiments, also depends on the search retrieval score of the shot's parent story. Once areas have been determined, the keyframes are scaled and/or cropped to fit into the area. In one embodiment, users can mark one or more shots as being relevant to the search. In one embodiment, a timeline is created and displayed with one or more neighbor stories that are each part of the video and which are closest in time of creation to the selected story.

    Method and apparatus for organizing digital media based on face recognition
    9.
    发明申请
    Method and apparatus for organizing digital media based on face recognition 有权
    基于人脸识别的数字媒体组织方法和装置

    公开(公告)号:US20050105806A1

    公开(公告)日:2005-05-19

    申请号:US10734259

    申请日:2003-12-15

    CPC分类号: G06K9/00677 G06F17/30247

    摘要: In one aspect, the present invention is directed to a method and an apparatus for organizing digital media, particularly digital photos, using face recognition. According to a first aspect of the present invention, a computer-based method for organizing digital photos comprises: extracting objects of interest from a plurality of photographs; cropping said plurality of photographs to generate images of isolated objects of interest; applying a recognition algorithm to determine the similarity of isolated objects of interest with a reference; displaying a plurality of objects arranged as a function of the determined similarity; and receiving user input to associate said objects with a particular classification.

    摘要翻译: 一方面,本发明涉及一种使用人脸识别来组织数字媒体,特别是数字照片的方法和装置。 根据本发明的第一方面,一种用于组织数字照片的基于计算机的方法包括:从多张照片提取感兴趣的对象; 裁剪所述多张照片以产生感兴趣的孤立物体的图像; 应用识别算法来确定所分离的感兴趣对象与参考的相似性; 显示作为所确定的相似度的函数排列的多个对象; 以及接收用户输入以将所述对象与特定分类相关联。

    Methods and apparatuses for interactive similarity searching, retrieval, and browsing of video
    10.
    发明授权
    Methods and apparatuses for interactive similarity searching, retrieval, and browsing of video 有权
    视频互动相似检索,检索和浏览的方法和装置

    公开(公告)号:US06774917B1

    公开(公告)日:2004-08-10

    申请号:US09266558

    申请日:1999-03-11

    IPC分类号: G06F1500

    摘要: Method for interactive selecting video consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

    摘要翻译: 公开了一种用于交互式选择视频组合的视频相似性搜索的视频的训练图像和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧,或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量,计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧,从帧的变换中提取特征向量,并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性,这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度,从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。