公开(公告)号：US07327899B2

公开(公告)日：2008-02-05

申请号：US11465703

申请日：2006-08-18

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07260257B2

公开(公告)日：2007-08-21

申请号：US10178443

申请日：2002-06-19

申请人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

发明人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

IPC分类号： C06K9/00

CPC分类号： G06F17/30843 ,  G06Q10/1095 ,  G11B27/105 ,  G11B27/28 ,  G11B27/34 ,  H04N5/77 ,  H04N9/806

摘要： A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

摘要翻译： 使用数码相机和麦克风捕获会议的白板内容和音频信号的系统。 该系统可以改装任何现有的白板。 它通过分析捕获的快照的顺序来计算白板上笔划的时间戳。 它也会在每次擦除之前自动产生代表白板上所有写入内容的一组关键帧。 白板内容作为视觉索引，有效地浏览音频会议。 该系统不仅可以捕获白板内容，还可以帮助用户有效，安全地查看和管理所捕获的会议内容。

公开(公告)号：US07259784B2

公开(公告)日：2007-08-21

申请号：US10177315

申请日：2002-06-21

申请人： Ross Cutler

发明人： Ross Cutler

IPC分类号： H04N9/73 ,  H04N13/02 ,  H04N15/00

CPC分类号： G06T5/40 ,  G06T5/008 ,  G06T7/30 ,  G06T2200/32 ,  G06T2207/20221 ,  G06T2207/30201 ,  H04N1/3876 ,  H04N1/6027 ,  H04N5/23238 ,  H04N5/247 ,  H04N9/73 ,  H04N17/002

摘要： A practical, real-time calibration of digital omnidirectional cameras in the areas of de-vignetting, brightness, contrast, and white balance control. Novel solutions for the color calibration of an omnidirectional camera rig, and an efficient method for devignetting images are presented. Additionally, a context-specific method of stitching images together into a panorama or a mosaic is provided.

摘要翻译： 数字全向摄像机在去晕影，亮度，对比度和白平衡控制领域的实用，实时校准。 提出了一种用于全向摄像机的颜色校准的新颖解决方案，以及一种有效的去角度偏移图像的方法。 另外，提供将图像拼接成全景图或马赛克的上下文特定方法。

公开(公告)号：US20070058879A1

公开(公告)日：2007-03-15

申请号：US11227046

申请日：2005-09-15

申请人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

发明人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06K9/40 ,  G06K9/36

CPC分类号： G06T5/006 ,  G06T7/68 ,  G06T7/80 ,  G06T2200/32

摘要： A panoramic camera is configured to automatically determine parameters of a table upon which the camera is situated as well as positional information of the camera relative to the table. In an initialization stage, table edges are detected to create an edge map. A Hough transformation-like symmetry voting operation is performed to clean up the edge map and to determine camera offset, camera orientation and camera tilt. The table is then fit to a table model to determine table parameters. In an operational stage, table edges are detected to create an edge map and the table model is fit to the edge map. The output can then be used for further panoramic image processing such as head size normalization, zooming, compensation for camera movement, etc.

摘要翻译： 全景相机被配置为自动确定相机所在的表的参数以及相机相对于表的位置信息。 在初始化阶段，检测表边缘以创建边缘图。 执行霍夫变换对称投票操作来清理边缘图并确定相机偏移，相机方向和相机倾斜度。 然后将表适合于表模型以确定表参数。 在操作阶段，检测表边缘以创建边缘图，并且表模型适合边缘图。 然后可以将输出用于进一步的全景图像处理，例如头部尺寸归一化，变焦，相机移动补偿等。

公开(公告)号：US07184609B2

公开(公告)日：2007-02-27

申请号：US11106311

申请日：2005-04-14

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US20060164552A1

公开(公告)日：2006-07-27

申请号：US11041427

申请日：2005-01-21

申请人： Ross Cutler

发明人： Ross Cutler

IPC分类号： H04N7/00

CPC分类号： H04N5/2628 ,  H04N7/147 ,  H04N7/148 ,  H04N21/21805 ,  H04N21/234363 ,  H04N21/234372 ,  H04N21/2662 ,  H04N21/4223 ,  H04N21/4728

摘要： Techniques are described for embedding a panoramic image in standard resolution. A panoramic image is received from a panoramic camera and a location of a speaker is determined, either automatically or manually. A portion of the panoramic image is cropped to isolate the speaker and the cropped portion of the image is enlarged to standard video resolution. The panoramic image is combined with the cropped portion and transmitted via a standard video streaming format. In at least one implementation, the panoramic image is normalized so that face sizes of persons in the image appear approximately equal regardless of the distance each person is situated relative to the camera.

摘要翻译： 描述了以标准分辨率嵌入全景图像的技术。 从全景相机接收全景图像，并自动或手动确定扬声器的位置。 全景图像的一部分被裁剪以隔离扬声器，并且图像的裁剪部分被放大到标准视频分辨率。 全景图像与裁剪的部分组合并通过标准视频流格式传输。 在至少一个实施方案中，全景图像被归一化，使得图像中的人的面部尺寸看起来大致相等，而不管每个人相对于照相机的距离。

公开(公告)号：US20060101377A1

公开(公告)日：2006-05-11

申请号：US10968861

申请日：2004-10-19

申请人： Kentaro Toyama ,  Ramaswamy Hariharan ,  Ross Cutler ,  John Douceur ,  Nuria Oliver ,  Eric Ringger ,  Daniel Robbins ,  Matthew Uyttendaele

发明人： Kentaro Toyama ,  Ramaswamy Hariharan ,  Ross Cutler ,  John Douceur ,  Nuria Oliver ,  Eric Ringger ,  Daniel Robbins ,  Matthew Uyttendaele

IPC分类号： G06F9/44 ,  G06F12/14 ,  G06F17/21 ,  G06F12/16 ,  G06F12/00 ,  G06F17/24

CPC分类号： G06Q30/02

摘要： A location history is a collection of locations over time for an object. A stay is a single instance of an object spending some time in one place, and a destination is any place where one or more objects have experienced a stay. Location histories are parsed using stays and destinations. In a described implementation, each location of a location history is recorded as a spatial position and a corresponding time at which the spatial position is acquired. Stays are extracted from a location history by analyzing locations thereof with regard to a temporal threshold and a spatial threshold. Specifically, two or more locations are considered a stay if they exceed a minimum stay duration and are within a maximum roaming distance. Each stay includes a location, a starting time, and an ending time. Destinations are produced from the extracted stays using a clustering operation and a predetermined scaling factor.

摘要翻译： 位置历史记录是对象的一段时间内的位置集合。 逗留是在一个地方花费一些时间的对象的单个实例，目的地是一个或多个对象经历了逗留的任何地方。 使用停留和目的地解析位置历史记录。 在描述的实现中，将位置历史的每个位置记录为空间位置和获取空间位置的对应时间。 通过相对于时间阈值和空间阈值分析其位置，从位置历史中提取静止。 具体来说，如果两个或多个位置超过最小停留持续时间并处于最大漫游距离内，则将其视为停留。 每个住宿包括一个位置，一个起始时间和一个结束时间。 使用聚类操作和预定缩放因子从所提取的逗留中产生目的地。

公开(公告)号：US20050280700A1

公开(公告)日：2005-12-22

申请号：US11193976

申请日：2005-07-29

申请人： Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

发明人： Yong Rui ,  Anoop Gupta ,  Johnathan Cadiz ,  Ross Cutler

IPC分类号： H04N7/14 ,  H04N7/15

CPC分类号： H04N7/142 ,  H04N7/147 ,  H04N7/15

摘要： An automated system and method for broadcasting meetings over a computer network. The meeting is filmed using an omni-directional camera system and capable of being presented to a viewer both live and on-demand. The system of the present invention includes an automated camera management system for controlling the camera system and an analysis module determining the location of meeting participants in the meeting environments. The method of the present invention includes using the system of the present invention to broadcast an event to a viewer over a computer network. In particular, the method includes filming the event using an omni-directional camera system. Next, the method determines the location of each event participant in the event environment. Finally, a viewer is provided with a user interface for viewing the broadcast event. This user interface allows a viewer to choose which event participant that the viewer would like to view.

摘要翻译： 一种用于通过计算机网络广播会议的自动化系统和方法。 会议是使用全方位摄像系统拍摄的，可以呈现给观众，包括现场和点播。 本发明的系统包括用于控制相机系统的自动相机管理系统和确定会议环境中的会议参与者的位置的分析模块。 本发明的方法包括使用本发明的系统通过计算机网络向观看者广播事件。 特别地，该方法包括使用全向摄像机系统拍摄该事件。 接下来，该方法确定事件环境中每个事件参与者的位置。 最后，向观众提供用于观看广播事件的用户界面。 该用户界面允许观看者选择观看者想要观看的哪个事件参与者。