System and method for video navigation and client side indexing
    1.
    发明授权
    System and method for video navigation and client side indexing 有权
    视频导航和客户端索引的系统和方法

    公开(公告)号:US07401351B2

    公开(公告)日:2008-07-15

    申请号:US09738905

    申请日:2000-12-14

    IPC分类号: H04N7/173

    摘要: A system is provided where a number of representative video snapshots are displayed on a timeline indicating a position to jump to in a video using control buttons, such as fast forward, reverse, or a timeline scroll bar. The video snapshots are obtained by opening a low resolution connection to a video server to receive forward looking video segments. The forward looking video segments are summarized and the representative video snapshots are selected and displayed to provide a reference frame for the user to select a timeline position, or snapshots directly linked to positions in the higher resolution video. Backward looking video segments may be similarly summarized from the low resolution connection, or alternatively from video previously played. As the video progresses, new forward looking video segments are received and new representative video snapshots are summarized and displayed in close proximity with the video being played.

    摘要翻译: 提供了一种系统,其中使用诸如快进,反向或时间轴滚动条的控制按钮在时间线上显示许多代表性的视频快照,其指示在视频中跳转的位置。 视频快照是通过打开与视频服务器的低分辨率连接来接收前视视频片段而获得的。 总结前视视频片段并且选择和显示代表性视频快照以提供用于用户选择时间线位置的参考帧或者直接链接到较高分辨率视频中的位置的快照。 可以从低分辨率连接或者替代地从先前播放的视频来类似地总结向后看的视频片段。 随着视频的进行,接收到新的前瞻性视频片段,并且新的代表性视频快照被汇总并显示在正在播放的视频附近。

    Document re-authoring systems and methods for providing device-independent access to the world wide web
    2.
    发明授权
    Document re-authoring systems and methods for providing device-independent access to the world wide web 失效
    用于提供与万维网无关的设备的文档重新创作系统和方法

    公开(公告)号:US06857102B1

    公开(公告)日:2005-02-15

    申请号:US09239295

    申请日:1999-01-29

    摘要: An automatic re-authoring system and method re-author a document originally designed for display on a desktop computer screen for display on a smaller display screen, such as those used with a PDA or a cellular telephone. The automatic re-authoring system and method input a document to be re-authored and re-authoring parameters, such as display screen size, default font and the like. The automatic re-authoring system and method convert the document into a number of pages, where each page is fully displayable with only at most a minimal amount of scrolling on the display screen of the PDA or cellular phone. At each stage of the re-authoring, a number of different transformations are applied to the original document or a selected re-authored page. The selected re-authored page is the best page resulting from the previous re-authoring stage. The best page at each stage is determined based on the re-authoring parameters and the content of the document being re-authored.

    摘要翻译: 自动重新创作系统和方法重新编写最初设计用于在台式计算机屏幕上显示的文档,以在较小的显示屏幕上显示,例如与PDA或蜂窝电话一起使用的文档。 自动重写系统和方法输入要重新编写的文档和重新创作参数,如显示屏尺寸,默认字体等。 自动重新创作系统和方法将文档转换成多页,其​​中每个页面完全可显示,在PDA或蜂窝电话的显示屏上最多只有最少的滚动。 在重新创作的每个阶段,对原始文档或选定的重新编写的页面应用了许多不同的转换。 所选的重新创作页面是以前重新创作阶段产生的最佳页面。 每个阶段的最佳页面都是基于重新创作参数和重新创作的文档的内容来确定的。

    Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes
    4.
    发明授权
    Method and system for analyzing fixed-camera video via the selection, visualization, and interaction with storyboard keyframes 有权
    通过选择,可视化和与故事板关键帧的交互来分析固定摄像机视频的方法和系统

    公开(公告)号:US08089563B2

    公开(公告)日:2012-01-03

    申请号:US11324557

    申请日:2006-01-03

    IPC分类号: H04N5/14 H04N7/18 G06K9/34

    摘要: Techniques for generating a storyboard are disclosed. In one embodiment of the invention the storyboard is comprised of videos from one or more cameras based on the identification of activity in the video. Various embodiments of the invention include an assessment of the importance of the activity, the creation of a storyboard presentation based on importance and interaction techniques for seeing more details or alternate views of the video. In one embodiment, motion detection is used to determine activity in one or more synchronized video streams. Periods of activity are recognized and assigned importance assessments based on the activity, important locations in the video streams, and events from other sensors. In different embodiments, the interface consists of a storyboard and a map.

    摘要翻译: 公开了生成故事板的技术。 在本发明的一个实施例中,故事板由来自一个或多个相机的视频组成,基于视频中活动的识别。 本发明的各种实施例包括评估活动的重要性,基于重要性的创建故事板呈现以及用于观看视频的更多细节或替代视图的交互技术。 在一个实施例中,运动检测用于确定一个或多个同步视频流中的活动。 根据活动,视频流中的重要位置以及来自其他传感器的事件,识别和分配活动的时间段并进行重要性评估。 在不同的实施例中,界面由故事板和地图组成。

    Methods and interfaces for event timeline and logs of video streams
    5.
    发明授权
    Methods and interfaces for event timeline and logs of video streams 有权
    事件时间线和视频流日志的方法和接口

    公开(公告)号:US07996771B2

    公开(公告)日:2011-08-09

    申请号:US11324971

    申请日:2006-01-03

    IPC分类号: G06F3/00

    摘要: Techniques for generating timelines and event logs from one or more fixed-position cameras based on the identification of activity in the video are presented. Various embodiments of the invention include an assessment of the importance of the activity, the creation of a timeline identifying events of interest, and interaction techniques for seeing more details of an event or alternate views of the video. In one embodiment, motion detection is used to determine activity in one or more synchronized video streams. In another embodiment, events are determined based on periods of activity and assigned importance assessments based on the activity, important locations in the video streams, and events from other sensors. In different embodiments, the interface consists of a timeline, event log, and map.

    摘要翻译: 提出了基于视频中的活动识别从一个或多个固定位置摄像机生成时间线和事件日志的技术。 本发明的各种实施例包括评估活动的重要性,创建识别感兴趣事件的时间线以及用于查看视频的事件或替代视图的更多细节的交互技术。 在一个实施例中,运动检测用于确定一个或多个同步视频流中的活动。 在另一个实施例中,基于活动的周期和基于活动的重要性评估,视频流中的重要位置以及来自其他传感器的事件来确定事件。 在不同的实施例中,接口由时间线,事件日志和地图组成。

    Systems and methods for organizing files in a graph-based layout
    6.
    发明授权
    Systems and methods for organizing files in a graph-based layout 有权
    用于在基于图形的布局中组织文件的系统和方法

    公开(公告)号:US08832119B2

    公开(公告)日:2014-09-09

    申请号:US12137718

    申请日:2008-06-12

    CPC分类号: G06F17/30058

    摘要: An adaptive, interactive visual workspace for viewing groups of files based on their relationships. Relationships of files are visualized using iterative refinement of categories through a direct-manipulation graph-based layout. The visual workspace starts with a fully connected graph linking thumbnail images of related files that is then partitioned into neighborhoods in response to a user creating file stacks corresponding to different categories. Normalized spring lengths improve the overall quality of the layout. Different modes for membership in neighborhoods avoid confusing motion of files and help a user to manually organize the workspace. Additionally, retrieved files can be added without having to significantly move the previous files. Different visualization techniques indicate which files are related to each other. Different zoom rates are used for file location, and surrogate sizes allow users to increase the separation between files while still increasing the surrogate sizes.

    摘要翻译: 一个自适应的交互式视觉工作区,用于根据他们的关系来查看文件组。 文件的关系通过直接操作图形布局的类别迭代细化进行可视化。 可视化工作区以完全连接的图形开始,将图形相关联的文件链接起来,然后将其分成邻域,以响应用户创建对应于不同类别的文件堆栈。 标准化的弹簧长度提高了布局的整体质量。 用于居民区成员身份的不同模式可避免混淆文件运动,并帮助用户手动组织工作区。 此外,可以添加检索到的文件,而不必显着移动以前的文件。 不同的可视化技术指出哪些文件是相互关联的。 文件位置使用不同的缩放比例,替代尺寸允许用户增加文件之间的间隔,同时仍然增加代理大小。

    Genetic segmentation method for data, such as image data streams
    7.
    发明授权
    Genetic segmentation method for data, such as image data streams 有权
    用于数据的遗传分割方法,如图像数据流

    公开(公告)号:US06819795B1

    公开(公告)日:2004-11-16

    申请号:US09611389

    申请日:2000-07-07

    IPC分类号: G06K934

    CPC分类号: G11B27/28

    摘要: A method, information system, and computer-readable medium is provided for segmenting a plurality of data, such as multimedia data, and in particular an image document stream. Segment boundary points may be used for retrieving and/or browsing the plurality of data. Similarly, segment boundary points may be used to summarize the plurality of data. Examples of image document streams include video, PowerPoint slides, and NoteLook pages. A genetic method having a fitness or evaluation function using information retrieval concepts, such as importance and precedence, is used to obtain segment boundary points. The genetic method is able to evaluate a large amount of data in a cost effective manner. The genetic method is also able to run incrementally on streaming video and adapt to usage patterns by considering frequently accessed images.

    摘要翻译: 提供了一种方法,信息系统和计算机可读介质,用于分割多个数据,例如多媒体数据,特别是图像文档流。 段边界点可用于检索和/或浏览多个数据。 类似地,段边界点可以用于汇总多个数据。 图像文档流的示例包括视频,PowerPoint幻灯片和NoteLook页面。 使用具有使用诸如重要性和优先级之类的信息检索概念的适应度或评价函数的遗传方法来获得段边界点。 遗传方法能够以成本有效的方式评估大量数据。 遗传方法还能够在流式视频上逐步运行,并通过考虑频繁访问的图像来适应使用模式。

    Methods and interfaces for visualizing activity across video frames in an action keyframe
    8.
    发明授权
    Methods and interfaces for visualizing activity across video frames in an action keyframe 有权
    用于在动作关键帧中的视频帧之间可视化活动的方法和接口

    公开(公告)号:US07623677B2

    公开(公告)日:2009-11-24

    申请号:US11324355

    申请日:2006-01-03

    IPC分类号: G06K9/00 H04N7/18 H04N5/14

    CPC分类号: G06F17/30811

    摘要: Techniques for generating action keyframes for a fixed-position camera based on the identification of activity in the video, an assessment of the importance of the activity, object recognition in the video, and interaction techniques for seeing more details of the video are presented. In different embodiments of the invention, the importance of activity is determined based on the amount of activity, important locations in the video streams, detected features such as faces, and events from other sensors.

    摘要翻译: 提供了基于视频中的活动识别,活动重要性的评估,视频中的对象识别以及用于观看视频的更多细节的交互技术来生成针对固定位置摄像机的动作关键帧的技术。 在本发明的不同实施例中,活动的重要性基于活动量,视频流中的重要位置,检测到的特征(例如面部)和来自其它传感器的事件来确定。

    Methods and apparatuses for interactive similarity searching, retrieval and browsing of video
    9.
    发明授权
    Methods and apparatuses for interactive similarity searching, retrieval and browsing of video 有权
    视频互动相似搜索,检索和浏览的方法和装置

    公开(公告)号:US07246314B2

    公开(公告)日:2007-07-17

    申请号:US10859832

    申请日:2004-06-03

    IPC分类号: G06F15/00 G06F14/00

    摘要: Methods for interactive selecting video queries consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

    摘要翻译: 公开了用于交互式选择由用于视频相似性搜索的视频的训练图像组成的视频查询和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧,或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量,计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧,从帧的变换中提取特征向量,并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性,这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度,从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

    System and method for presenting video search results

    公开(公告)号:US20060106764A1

    公开(公告)日:2006-05-18

    申请号:US10986735

    申请日:2004-11-12

    IPC分类号: G06F17/30

    摘要: The invention displays video search results in a form that makes it easy for users to determine which results are truly relevant. Each story returned as a search result is visualized as a collage of keyframes from the story's shots. The selected keyframes and their sizes depend on the corresponding shots' respective relevance. Shot relevance depends on the search retrieval score of the shot and, in some embodiments, also depends on the search retrieval score of the shot's parent story. Once areas have been determined, the keyframes are scaled and/or cropped to fit into the area. In one embodiment, users can mark one or more shots as being relevant to the search. In one embodiment, a timeline is created and displayed with one or more neighbor stories that are each part of the video and which are closest in time of creation to the selected story.