公开(公告)号：US07333135B2

公开(公告)日：2008-02-19

申请号：US10271133

申请日：2002-10-15

Applicant: Jonathan T. Foote ,  Donald G. Kimber

Inventor： Jonathan T. Foote ,  Donald G. Kimber

IPC: H04N5/232 ,  H04N5/225

CPC classification number: H04N7/18

Abstract: A system, method and apparatus for remotely annotating an object. An embodiment of the present invention includes a video camera projector that captures video images of a local object and projects annotations made by a user at a remote location onto said local object.

Abstract translation: 一种用于远程注释对象的系统，方法和装置。 本发明的一个实施例包括摄像机投影仪，其捕获本地对象的视频图像，并将远程位置处的用户作出的注释投影到所述本地对象上。

公开(公告)号：US07068723B2

公开(公告)日：2006-06-27

申请号：US10086817

申请日：2002-02-28

Applicant: Jonathan T. Foote ,  John Boreczky

Inventor： Jonathan T. Foote ,  John Boreczky

IPC: H04N7/18

CPC classification number: G06F17/30843 ,  G06F17/30017 ,  G06F17/30719 ,  G06F17/30743 ,  G06F17/30775 ,  G11B27/031 ,  G11B27/28

Abstract: Optimal summaries of a linear media source are automatically produced by parameterizing a linear media source. The parameterized linear media source is used to create a similarity array in which each array element includes the value of a similarity measurement between a two portions of the parameterized media signal. A segment fitness function, adapted for measuring the similarity between a segment of the parameterized media signal and the entire parameterized media signal, is optimized to find an optimal segment location. The portion of the linear media source corresponding to the optimal segment location is selected as the optimal summary. This method produces optimal summaries of any type of linear media, such as video, audio, or text information.

公开(公告)号：US07624166B2

公开(公告)日：2009-11-24

申请号：US10727310

申请日：2003-12-02

Applicant: Jonathan T. Foote ,  Qiong Liu ,  Matthew Cooper ,  John Boreczky

Inventor： Jonathan T. Foote ,  Qiong Liu ,  Matthew Cooper ,  John Boreczky

IPC: G06F15/16

CPC classification number: H04B10/1143 ,  H04B10/116

Abstract: Methods and systems for transferring media between media source devices and media sink devices are disclosed. Remote control units are used to indicate the media sink and media source devices for transferring media data between these elements.

Abstract translation: 公开了在介质源设备和介质宿设备之间传送介质的方法和系统。 远程控制单元用于指示用于在这些元素之间传送媒体数据的媒体接收器和媒体源设备。

公开(公告)号：US07508382B2

公开(公告)日：2009-03-24

申请号：US10833062

申请日：2004-04-28

Applicant: Laurent Denoue ,  Jonathan T. Foote

Inventor： Laurent Denoue ,  Jonathan T. Foote

IPC: G06F3/033 ,  G06F3/041 ,  G06F3/046

CPC classification number: G06F3/04883 ,  G06F3/016 ,  G06F3/03545 ,  G06F3/03546

Abstract: This invention relates to a force-feedback apparatus which includes a stylus that is equipped with an electromagnetic device or a freely rotating ball. The stylus is functionally coupled to a controller which is capable of exerting a magnetic field to the electromagnetic device or to the rotating ball, which results in a force being created between the stylus and a surface. This invention also relates to a method of using a force-feedback stylus including moving a force-feedback stylus over a surface, controlling a force-feedback device via a controller coupled to the force-feedback stylus and applying a force to the force-feedback stylus via the force-feedback device, the force being determined for at least features on the surface.

Abstract translation: 本发明涉及一种力反馈装置，其包括配备有电磁装置或自由旋转的球的触针。 触针在功能上耦合到能够对电磁装置或旋转球施加磁场的控制器，这导致在触针和表面之间产生力。 本发明还涉及一种使用力反馈测针的方法，包括在表面上移动力反馈测针，通过耦合到力反馈测针的控制器来控制力反馈装置并向力反馈施加力 触针通过力反馈装置，该力被确定为表面上的至少特征。

公开(公告)号：US07246314B2

公开(公告)日：2007-07-17

申请号：US10859832

申请日：2004-06-03

Applicant: Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

Inventor： Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

IPC: G06F15/00 ,  G06F14/00

CPC classification number: G06K9/00758 ,  G06F17/30814 ,  G06F17/30825 ,  G06F17/3084

Abstract: Methods for interactive selecting video queries consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

Abstract translation: 公开了用于交互式选择由用于视频相似性搜索的视频的训练图像组成的视频查询和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧，或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量，计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧，从帧的变换中提取特征向量，并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性，这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度，从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

公开(公告)号：US07154526B2

公开(公告)日：2006-12-26

申请号：US10617549

申请日：2003-07-11

Applicant: Jonathan T. Foote ,  John Adcock ,  Qiong Liu ,  Timothy E. Black

Inventor： Jonathan T. Foote ,  John Adcock ,  Qiong Liu ,  Timothy E. Black

IPC: H04N7/14

CPC classification number: H04N7/142

Abstract: A system in accordance with one embodiment of the present invention comprises a device for facilitating video communication between a remote participant and another location. The device can comprise a screen adapted to display the remote participant, the screen having a posture adapted to be controlled by the remote participant. A camera can be mounted adjacent to the screen, and can allow the subject to view a selected conference participant or a desired location such that when the camera is trained on the selected participant or desired location a gaze of the remote participant displayed by the screen appears substantially directed at the selected participant or desired location.

Abstract translation: 根据本发明的一个实施例的系统包括用于促进远程参与者和另一位置之间的视频通信的装置。 设备可以包括适于显示远程参与者的屏幕，屏幕具有适于由远程参与者控制的姿势。 摄像机可以安装在屏幕附近，并且可以允许被摄体观看所选择的会议参与者或期望的位置，使得当在所选择的参与者或期望位置上训练相机时，屏幕显示的远程参与者的凝视出现 基本上指向所选择的参与者或期望位置。

公开(公告)号：US06915009B2

公开(公告)日：2005-07-05

申请号：US09947385

申请日：2001-09-07

Applicant: Jonathan T. Foote ,  Matthew Cooper

Inventor： Jonathan T. Foote ,  Matthew Cooper

IPC: H04N5/91 ,  G06K9/62 ,  G06K9/34

CPC classification number: G06K9/00711 ,  G06K9/00718 ,  G06K9/00765 ,  G06K9/6218

Abstract: Techniques segmenting ordered information such as audio, video and text are provided by windowing and parameterizing an ordered information stream and storing of the parameterized and windowed information into a two-dimensional representation such as a matrix. The similarity between the parameter vectors is determined and an orthogonal matrix decomposition such as singular value decomposition is applied to the similarity matrix. The singular values or eigenvalues of the resulting decomposition indicate major components or segments of the ordered information. The boundaries of the major components may be determined using the determined singular vectors to provide, for example, smart cut-and-paste of ordered information in which boundaries are automatically identified by the singular vectors; automatic categorization and retrieval of ordered information and automatic summarization of ordered information.

Abstract translation: 通过对有序信息流进行窗口化和参数化以及将参数化和加窗信息存储为诸如矩阵的二维表示来提供分类诸如音频，视频和文本的有序信息的技术。 确定参数向量之间的相似度，并将正交矩阵分解（如奇异值分解）应用于相似矩阵。 所得分解的奇异值或特征值表示有序信息的主要组成部分。 可以使用所确定的奇异向量来确定主要分量的边界，以提供例如智能切割和粘贴有序信息，其中边界由单个向量自动识别; 有序信息的自动分类和检索以及有序信息的自动汇总。

公开(公告)号：US06774917B1

公开(公告)日：2004-08-10

申请号：US09266558

申请日：1999-03-11

Applicant: Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

Inventor： Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn Wilcox

IPC: G06F1500

CPC classification number: G06K9/00758 ,  G06F17/30814 ,  G06F17/30825 ,  G06F17/3084

Abstract: Method for interactive selecting video consisting of training images from a video for a video similarity search and for displaying the results of the similarity search are disclosed. The user selects a time interval in the video as a query definition of training images for training an image class statistical model. Time intervals can be as short as one frame or consist of disjoint segments or shots. A statistical model of the image class defined by the training images is calculated on-the-fly from feature vectors extracted from transforms of the training images. For each frame in the video, a feature vector is extracted from the transform of the frame, and a similarity measure is calculated using the feature vector and the image class statistical model. The similarity measure is derived from the likelihood of a Gaussian model producing the frame. The similarity is then presented graphically, which allows the time structure of the video to be visualized and browsed. Similarity can be rapidly calculated for other video files as well, which enables content-based retrieval by example. A content-aware video browser featuring interactive similarity measurement is presented. A method for selecting training segments involves mouse click-and-drag operations over a time bar representing the duration of the video; similarity results are displayed as shades in the time bar. Another method involves selecting periodic frames of the video as endpoints for the training segment.

Abstract translation: 公开了一种用于交互式选择视频组合的视频相似性搜索的视频的训练图像和用于显示相似性搜索的结果的方法。 用户选择视频中的时间间隔作为用于训练图像类统计模型的训练图像的查询定义。 时间间隔可以短到一帧，或者由不相交的片段或镜头组成。 从训练图像变换中提取的特征向量，计算由训练图像定义的图像类别的统计模型。 对于视频中的每个帧，从帧的变换中提取特征向量，并且使用特征向量和图像类统计模型来计算相似度度量。 相似性度量是从产生帧的高斯模型的可能性得出的。 然后以图形方式呈现相似性，这允许视频的时间结构可视化和浏览。 也可以为其他视频文件快速计算相似度，从而实现基于内容的检索。 介绍了具有交互式相似度测量功能的内容感知视频浏览器。 用于选择训练段的方法涉及通过表示视频持续时间的时间条来进行鼠标点击和拖动操作; 相似度结果在时间栏中显示为阴影。 另一种方法是选择视频的周期帧作为训练段的端点。

公开(公告)号：US07277118B2

公开(公告)日：2007-10-02

申请号：US09989638

申请日：2001-11-20

Applicant: Jonathan T. Foote

Inventor： Jonathan T. Foote

IPC: H04N7/00 ,  H04N5/225 ,  H04N13/02

CPC classification number: G03B37/04 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/33 ,  G06T7/97 ,  G06T2207/10012 ,  H04N5/23238 ,  H04N5/247 ,  H04N5/2628 ,  H04N13/128 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081 ,  H04N2013/0088

Abstract: A camera array captures plural component images which are combined into a single scene. In one embodiment, each camera of the array is a fixed digital camera. The images from each camera are warped to a common coordinate system and the disparity between overlapping images is reduced using disparity estimation techniques.

Abstract translation: 相机阵列捕获组合成单个场景的多个分量图像。 在一个实施例中，阵列的每个摄像机是固定数字照相机。 来自每个摄像机的图像变形到共同的坐标系，并且使用差异估计技术来减少重叠图像之间的差异。

公开(公告)号：US07203380B2

公开(公告)日：2007-04-10

申请号：US09992617

申请日：2001-11-16

Applicant: Patrick Chiu ,  Shingo Uchihashi ,  John S. Boreczky ,  Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn D. Wilcox

Inventor： Patrick Chiu ,  Shingo Uchihashi ,  John S. Boreczky ,  Jonathan T. Foote ,  Andreas Girgensohn ,  Lynn D. Wilcox

IPC: G06K9/36

CPC classification number: H04N5/262

Abstract: A method, system, and apparatus for easily creating a video collage from a video is provided. By segmenting the video into a set number of video segments and providing an interface for a user to select images which represent the video segments and insert the selected images into a video collage template, a video collage may be easily created in a short amount of time. The system is designed to assign values to the video inserted in a video collage and compact the video based on these values thereby creating a small file which may be easily stored or transmitted.

Abstract translation: 提供了一种用于从视频轻松创建视频拼贴的方法，系统和装置。 通过将视频分割成一定数量的视频片段并提供用于用户选择表示视频段的图像并将所选择的图像插入到视频拼贴模板中的界面，可以在短时间内容易地创建视频拼贴 。 该系统旨在为插入到视频拼贴中的视频分配值，并基于这些值压缩视频，从而创建可容易地存储或传输的小文件。