公开(公告)号：US07508382B2

公开(公告)日：2009-03-24

申请号：US10833062

申请日：2004-04-28

Applicant: Laurent Denoue ,  Jonathan T. Foote

Inventor： Laurent Denoue ,  Jonathan T. Foote

IPC: G06F3/033 ,  G06F3/041 ,  G06F3/046

CPC classification number: G06F3/04883 ,  G06F3/016 ,  G06F3/03545 ,  G06F3/03546

Abstract: This invention relates to a force-feedback apparatus which includes a stylus that is equipped with an electromagnetic device or a freely rotating ball. The stylus is functionally coupled to a controller which is capable of exerting a magnetic field to the electromagnetic device or to the rotating ball, which results in a force being created between the stylus and a surface. This invention also relates to a method of using a force-feedback stylus including moving a force-feedback stylus over a surface, controlling a force-feedback device via a controller coupled to the force-feedback stylus and applying a force to the force-feedback stylus via the force-feedback device, the force being determined for at least features on the surface.

Abstract translation: 本发明涉及一种力反馈装置，其包括配备有电磁装置或自由旋转的球的触针。 触针在功能上耦合到能够对电磁装置或旋转球施加磁场的控制器，这导致在触针和表面之间产生力。 本发明还涉及一种使用力反馈测针的方法，包括在表面上移动力反馈测针，通过耦合到力反馈测针的控制器来控制力反馈装置并向力反馈施加力 触针通过力反馈装置，该力被确定为表面上的至少特征。

公开(公告)号：US07424150B2

公开(公告)日：2008-09-09

申请号：US10728777

申请日：2003-12-08

Applicant: Matthew L. Cooper ,  Jonathan T. Foote

Inventor： Matthew L. Cooper ,  Jonathan T. Foote

IPC: G06K9/34

CPC classification number: G11B27/28

Abstract: A stream of ordered information, such as, for example, audio, video and/or text data, can be windowed and parameterized. A similarity between the parameterized and windowed stream of ordered information can be determined, and a probabilistic decomposition or probabilistic matrix factorization, such as non-negative matrix factorization, can be applied to the similarity matrix. The component matrices resulting from the decomposition indicate major components or segments of the ordered information. Excerpts can then be extracted from the stream of ordered information based on the component matrices to generate a summary of the stream of ordered information.

Abstract translation: 可以对有序信息流（例如音频，视频和/或文本数据）进行加窗和参数化。 可以确定有序信息的参数化和窗口流之间的相似性，并且可以将概率分解或概率矩阵分解（例如非负矩阵因式分解）应用于相似矩阵。 由分解产生的分量矩阵表示有序信息的主要组成部分。 然后可以基于分量矩阵从有序信息流中提取摘录，以生成有序信息流的摘要。

公开(公告)号：US07327347B2

公开(公告)日：2008-02-05

申请号：US10325913

申请日：2002-12-23

Applicant: David M. Hilbert ,  William N. Schilit ,  Matthew L. Cooper ,  Jonathan T. Foote

Inventor： David M. Hilbert ,  William N. Schilit ,  Matthew L. Cooper ,  Jonathan T. Foote

IPC: G09G5/00

CPC classification number: G06F17/30265

Abstract: Methods and systems for classifying images, such as photographs, allow a user to incorporate subjective judgments regarding photograph qualities when making classification decisions. A slide-show interface allows a user to classify and advance photographs with a one-key action or a single interaction event. The interface presents related information relevant to a displayed photograph that is to be classified, such as contiguous photographs, similar photographs, and other versions of the same photograph. The methods and systems provide an overview interface which allows a user to review and refine classification decisions in the context of the original sequence of photographs.

Abstract translation: 用于分类图像（如照片）的方法和系统允许用户在进行分类决定时纳入关于照片质量的主观判断。 幻灯片显示界面允许用户使用单键操作或单个交互事件对照片进行分类和推进。 该界面显示与要分类的显示照片相关的相关信息，例如相邻照片，相似照片和相同照片的其他版本。 方法和系统提供概览界面，其允许用户在原始照片序列的上下文中审查和改进分类决定。

公开(公告)号：US07246314B2

公开(公告)日：2007-07-17

申请号：US10859832

申请日：2004-06-03

Applicant: Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

Inventor： Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

IPC: G06F15/00 ,  G06F14/00

CPC classification number: G06K9/00758 ,  G06F17/30814 ,  G06F17/30825 ,  G06F17/3084

Abstract: Methods for interactive selecting video queries consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

Abstract translation: 公开了用于交互式选择由用于视频相似性搜索的视频的训练图像组成的视频查询和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧，或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量，计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧，从帧的变换中提取特征向量，并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性，这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度，从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

公开(公告)号：US07154526B2

公开(公告)日：2006-12-26

申请号：US10617549

申请日：2003-07-11

Applicant: Jonathan T. Foote ,  John Adcock ,  Qiong Liu ,  Timothy E. Black

Inventor： Jonathan T. Foote ,  John Adcock ,  Qiong Liu ,  Timothy E. Black

IPC: H04N7/14

CPC classification number: H04N7/142

Abstract: A system in accordance with one embodiment of the present invention comprises a device for facilitating video communication between a remote participant and another location. The device can comprise a screen adapted to display the remote participant, the screen having a posture adapted to be controlled by the remote participant. A camera can be mounted adjacent to the screen, and can allow the subject to view a selected conference participant or a desired location such that when the camera is trained on the selected participant or desired location a gaze of the remote participant displayed by the screen appears substantially directed at the selected participant or desired location.

Abstract translation: 根据本发明的一个实施例的系统包括用于促进远程参与者和另一位置之间的视频通信的装置。 设备可以包括适于显示远程参与者的屏幕，屏幕具有适于由远程参与者控制的姿势。 摄像机可以安装在屏幕附近，并且可以允许被摄体观看所选择的会议参与者或期望的位置，使得当在所选择的参与者或期望位置上训练相机时，屏幕显示的远程参与者的凝视出现 基本上指向所选择的参与者或期望位置。

公开(公告)号：US06774917B1

公开(公告)日：2004-08-10

申请号：US09266558

申请日：1999-03-11

Applicant: Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

Inventor： Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

IPC: G06F1500

CPC classification number: G06K9/00758 ,  G06F17/30814 ,  G06F17/30825 ,  G06F17/3084

Abstract: Method for interactive selecting video consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

Abstract translation: 公开了一种用于交互式选择视频组合的视频相似性搜索的视频的训练图像和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧，或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量，计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧，从帧的变换中提取特征向量，并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性，这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度，从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

公开(公告)号：US07778469B2

公开(公告)日：2010-08-17

申请号：US10678935

申请日：2003-10-03

Applicant: Matthew L. Cooper ,  Jonathan T. Foote

Inventor： Matthew L. Cooper ,  Jonathan T. Foote

IPC: G06K9/34 ,  G06K9/62

CPC classification number: G11B27/28 ,  G06K9/00711

Abstract: Embodiments of the present invention provide a system and method for discriminatively selecting keyframes that are representative of segments of a source digital media and at the same time distinguishable from other keyframes representing other segments of the digital media. The method and system, in one embodiment, includes pre-processing the source digital media to obtain feature vectors for frames of the media. Discriminatively selecting a keyframe as a representative for each segment of a source digital media wherein said discriminative selection includes determining a similarity measure for each candidate keyframe and determining a dis-similarity measure for each candidate keyframe and selecting the keyframe with the highest goodness value computing from the similarity and dis-similarity measures.

Abstract translation: 本发明的实施例提供了一种系统和方法，用于区分性地选择代表源数字媒体的片段的关键帧，并且同时与代表数字媒体的其他片段的其他关键帧可分辨。 在一个实施例中，该方法和系统包括预处理源数字媒体以获得媒体帧的特征向量。 识别性地选择关键帧作为源数字媒体的每个片段的代表，其中所述鉴别选择包括确定每个候选关键帧的相似性度量，并且确定每个候选关键帧的不相似性度量，并且选择具有最高善计值计算的关键帧 相似和不相似的措施。

公开(公告)号：US07383509B2

公开(公告)日：2008-06-03

申请号：US10243220

申请日：2002-09-13

Applicant: Jonathan T. Foote ,  Matthew L. Cooper ,  David Michael Hilbert ,  William N. Schilit

Inventor： Jonathan T. Foote ,  Matthew L. Cooper ,  David Michael Hilbert ,  William N. Schilit

IPC: G06F3/00

CPC classification number: G09B7/00 ,  G09B5/00 ,  G10L15/26 ,  G10L2021/105

Abstract: The present invention provides a system and method for automatically combining image and audio data to create a multimedia presentation. In one embodiment, audio and image data are received by the system. The audio data includes a list of events that correspond to points of interest in an audio file. The audio data may also include an audio file or audio stream. The received images are then matched to the audio file or stream using the time. In one embodiment, the events represent times within the audio file or stream at which there is a certain feature or characteristic in the audio file. The audio events list may be processed to remove, sort or predict or otherwise generate audio events. Images processing may also occur, and may include image analysis to determine image matching to the event list, deleting images, and processing images to incorporate effects. Image effects may include cropping, panning, zooming and other visual effects.

Abstract translation: 本发明提供一种用于自动组合图像和音频数据以创建多媒体呈现的系统和方法。 在一个实施例中，系统接收音频和图像数据。 音频数据包括与音频文件中的兴趣点对应的事件的列表。 音频数据还可以包括音频文件或音频流。 然后使用该时间将接收到的图像与音频文件或流进行匹配。 在一个实施例中，事件表示在音频文件或音频文件中具有特定特征的音频文件或流中的时间。 可以处理音频事件列表以移除，排序或预测或以其他方式生成音频事件。 也可能发生图像处理，并且可以包括图像分析以确定与事件列表的图像匹配，删除图像以及处理图像以合并效果。 图像效果可能包括裁剪，平移，缩放和其他视觉效果。

公开(公告)号：US07277118B2

公开(公告)日：2007-10-02

申请号：US09989638

申请日：2001-11-20

Applicant: Jonathan T. Foote

Inventor： Jonathan T. Foote

IPC: H04N7/00 ,  H04N5/225 ,  H04N13/02

CPC classification number: G03B37/04 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/33 ,  G06T7/97 ,  G06T2207/10012 ,  H04N5/23238 ,  H04N5/247 ,  H04N5/2628 ,  H04N13/128 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081 ,  H04N2013/0088

Abstract: A camera array captures plural component images which are combined into a single scene. In one embodiment, each camera of the array is a fixed digital camera. The images from each camera are warped to a common coordinate system and the disparity between overlapping images is reduced using disparity estimation techniques.

Abstract translation: 相机阵列捕获组合成单个场景的多个分量图像。 在一个实施例中，阵列的每个摄像机是固定数字照相机。 来自每个摄像机的图像变形到共同的坐标系，并且使用差异估计技术来减少重叠图像之间的差异。

公开(公告)号：US07203380B2

公开(公告)日：2007-04-10

申请号：US09992617

申请日：2001-11-16

Applicant: Patrick Chiu ,  Shingo Uchihashi ,  John S. Boreczky ,  Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn D. Wilcox

Inventor： Patrick Chiu ,  Shingo Uchihashi ,  John S. Boreczky ,  Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn D. Wilcox

IPC: G06K9/36

CPC classification number: H04N5/262

Abstract: A method, system, and apparatus for easily creating a video collage from a video is provided. By segmenting the video into a set number of video segments and providing an interface for a user to select images which represent the video segments and insert the selected images into a video collage template, a video collage may be easily created in a short amount of time. The system is designed to assign values to the video inserted in a video collage and compact the video based on these values thereby creating a small file which may be easily stored or transmitted.

Abstract translation: 提供了一种用于从视频轻松创建视频拼贴的方法，系统和装置。 通过将视频分割成一定数量的视频片段并提供用于用户选择表示视频段的图像并将所选择的图像插入到视频拼贴模板中的界面，可以在短时间内容易地创建视频拼贴 。 该系统旨在为插入到视频拼贴中的视频分配值，并基于这些值压缩视频，从而创建可容易地存储或传输的小文件。