公开(公告)号：US20070058879A1

公开(公告)日：2007-03-15

申请号：US11227046

申请日：2005-09-15

申请人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

发明人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06K9/40 ,  G06K9/36

CPC分类号： G06T5/006 ,  G06T7/68 ,  G06T7/80 ,  G06T2200/32

摘要： A panoramic camera is configured to automatically determine parameters of a table upon which the camera is situated as well as positional information of the camera relative to the table. In an initialization stage, table edges are detected to create an edge map. A Hough transformation-like symmetry voting operation is performed to clean up the edge map and to determine camera offset, camera orientation and camera tilt. The table is then fit to a table model to determine table parameters. In an operational stage, table edges are detected to create an edge map and the table model is fit to the edge map. The output can then be used for further panoramic image processing such as head size normalization, zooming, compensation for camera movement, etc.

摘要翻译： 全景相机被配置为自动确定相机所在的表的参数以及相机相对于表的位置信息。 在初始化阶段，检测表边缘以创建边缘图。 执行霍夫变换对称投票操作来清理边缘图并确定相机偏移，相机方向和相机倾斜度。 然后将表适合于表模型以确定表参数。 在操作阶段，检测表边缘以创建边缘图，并且表模型适合边缘图。 然后可以将输出用于进一步的全景图像处理，例如头部尺寸归一化，变焦，相机移动补偿等。

公开(公告)号：US20070206878A1

公开(公告)日：2007-09-06

申请号：US11465703

申请日：2006-08-18

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07327899B2

公开(公告)日：2008-02-05

申请号：US11465703

申请日：2006-08-18

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07260257B2

公开(公告)日：2007-08-21

申请号：US10178443

申请日：2002-06-19

申请人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

发明人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

IPC分类号： C06K9/00

CPC分类号： G06F17/30843 ,  G06Q10/1095 ,  G11B27/105 ,  G11B27/28 ,  G11B27/34 ,  H04N5/77 ,  H04N9/806

摘要： A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

摘要翻译： 使用数码相机和麦克风捕获会议的白板内容和音频信号的系统。 该系统可以改装任何现有的白板。 它通过分析捕获的快照的顺序来计算白板上笔划的时间戳。 它也会在每次擦除之前自动产生代表白板上所有写入内容的一组关键帧。 白板内容作为视觉索引，有效地浏览音频会议。 该系统不仅可以捕获白板内容，还可以帮助用户有效，安全地查看和管理所捕获的会议内容。

公开(公告)号：US07184609B2

公开(公告)日：2007-02-27

申请号：US11106311

申请日：2005-04-14

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07770116B2

公开(公告)日：2010-08-03

申请号：US11565596

申请日：2006-11-30

申请人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

发明人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

IPC分类号： G06F3/00 ,  G06F3/14

CPC分类号： G06F17/30843 ,  G06Q10/1095 ,  G11B27/105 ,  G11B27/28 ,  G11B27/34 ,  H04N5/77 ,  H04N9/806

摘要： A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

摘要翻译： 使用数码相机和麦克风捕获会议的白板内容和音频信号的系统。 该系统可以改装任何现有的白板。 它通过分析捕获的快照的顺序来计算白板上笔划的时间戳。 它也会在每次擦除之前自动产生代表白板上所有写入内容的一组关键帧。 白板内容作为视觉索引，有效地浏览音频会议。 该系统不仅可以捕获白板内容，还可以帮助用户有效，安全地查看和管理所捕获的会议内容。

公开(公告)号：US20070126755A1

公开(公告)日：2007-06-07

申请号：US11565596

申请日：2006-11-30

申请人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

发明人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

IPC分类号： G09G5/00

CPC分类号： G06F17/30843 ,  G06Q10/1095 ,  G11B27/105 ,  G11B27/28 ,  G11B27/34 ,  H04N5/77 ,  H04N9/806

摘要： A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

摘要翻译： 使用数码相机和麦克风捕获会议的白板内容和音频信号的系统。 该系统可以改装任何现有的白板。 它通过分析捕获的快照的顺序来计算白板上笔划的时间戳。 它也会在每次擦除之前自动产生代表白板上所有写入内容的一组关键帧。 白板内容作为视觉索引，有效地浏览音频会议。 该系统不仅可以捕获白板内容，还可以帮助用户有效，安全地查看和管理所捕获的会议内容。

公开(公告)号：US20050180656A1

公开(公告)日：2005-08-18

申请号：US11106311

申请日：2005-04-14

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： H04N5/262 ,  G06K9/00 ,  G06T3/00 ,  G06T5/00 ,  H04N7/18 ,  G06K9/36 ,  G06K9/32

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07630571B2

公开(公告)日：2009-12-08

申请号：US11227046

申请日：2005-09-15

申请人： Ross G. Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

发明人： Ross G. Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06K9/40 ,  G06K9/48

CPC分类号： G06T5/006 ,  G06T7/68 ,  G06T7/80 ,  G06T2200/32

摘要： A panoramic camera is configured to automatically determine parameters of a table upon which the camera is situated as well as positional information of the camera relative to the table. In an initialization stage, table edges are detected to create an edge map. A Hough transformation-like symmetry voting operation is performed to clean up the edge map and to determine camera offset, camera orientation and camera tilt. The table is then fit to a table model to determine table parameters. In an operational stage, table edges are detected to create an edge map and the table model is fit to the edge map. The output can then be used for further panoramic image processing such as head size normalization, zooming, compensation for camera movement, etc.

摘要翻译： 全景相机被配置为自动确定相机所在的表的参数以及相机相对于表的位置信息。 在初始化阶段，检测表边缘以创建边缘图。 执行霍夫变换对称投票操作来清理边缘图并确定相机偏移，相机方向和相机倾斜度。 然后将表适合于表模型以确定表参数。 在操作阶段，检测表边缘以创建边缘图，并且表模型适合边缘图。 然后可以将输出用于进一步的全景图像处理，例如头部尺寸归一化，变焦，相机移动补偿等。

公开(公告)号：US09055607B2

公开(公告)日：2015-06-09

申请号：US12323570

申请日：2008-11-26

申请人： Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

发明人： Michael J. Sinclair ,  Yuan Kong ,  Zhengyou Zhang ,  Behrooz Chitsaz ,  David W. Williams ,  Silviu-Petru Cucerzan ,  Zicheng Liu

IPC分类号： H04M1/00 ,  H04W88/06 ,  H04M1/725 ,  H04W8/24 ,  H04W92/02 ,  H04W92/10

CPC分类号： H04W88/06 ,  H04M1/72572 ,  H04M2250/12 ,  H04M2250/58 ,  H04W8/245 ,  H04W92/02 ,  H04W92/10

摘要： Multi-modal, multi-lingual devices can be employed to consolidate numerous items including, but not limited to, keys, remote controls, image capture devices, audio recorders, cellular telephone functionalities, location/direction detectors, health monitors, calendars, gaming devices, smart home inputs, pens, optical pointing devices or the like. For example, a corner of a cellular telephone can be used as an electronic pen. Moreover, the device can be used to snap multiple pictures stitching them together to create a panoramic image. A device can automate ignition of an automobile, initiate appliances, etc. based upon relative distance. The device can provide for near to eye capabilities for enhanced image viewing. Multiple cameras/sensors can be provided on a single device to provide for stereoscopic capabilities. The device can also provide assistance to blind, privacy, etc. by consolidating services.

摘要翻译： 可以使用多模式，多语言设备来整合许多项目，包括但不限于键，遥控器，图像捕获设备，音频记录器，蜂窝电话功能，位置/方向检测器，健康监视器，日历，游戏设备 智能家庭输入，笔，光学指向装置等。 例如，蜂窝电话的角落可以用作电子笔。 此外，该设备可以用于将多个图片拼接在一起以创建全景图像。 设备可以基于相对距离自动点火汽车，起动电器等。 该设备可以提供近眼睛的功能，以增强图像观看效果。 可以在单个设备上提供多个摄像机/传感器以提供立体能力。 该设备还可以通过整合服务来提供盲人，隐私等方面的帮助。