公开(公告)号：US20080170717A1

公开(公告)日：2008-07-17

申请号：US11623643

申请日：2007-01-16

申请人： Zicheng Liu ,  Zhengyou Zhang ,  Li-wei He ,  Philip A. Chou ,  Minghua Chen

发明人： Zicheng Liu ,  Zhengyou Zhang ,  Li-wei He ,  Philip A. Chou ,  Minghua Chen

IPC分类号： H04R3/00

CPC分类号： G01S11/14 ,  G01S5/30 ,  H04M3/56 ,  H04N7/141 ,  H04N7/15 ,  H04R3/005 ,  H04R2420/07

摘要： An energy based technique to estimate the positions of people speaking from an ad hoc network of microphones. The present technique does not require accurate synchronization of the microphones. In addition, a technique to normalize the gains of the microphones based on people's speech is presented, which allows aggregation of various audio channels from the ad hoc microphone network into a single stream for audio conferencing. The technique is invariant of the speaker's volumes thus making the system easy to deploy in practice.

摘要翻译： 一种基于能量的技术来估计从麦克风的自组织网络发言的人的位置。 本技术不需要麦克风的准确同步。 此外，提出了一种基于人们的语音来归一化麦克风的增益的技术，其允许将各种音频频道从专用麦克风网络聚合成用于音频会议的单个流。 该技术是扬声器音量不变的，从而使得系统在实践中容易部署。

公开(公告)号：US07342572B2

公开(公告)日：2008-03-11

申请号：US10836798

申请日：2004-04-30

申请人： Zhengyou Zhang ,  Ying Shan

发明人： Zhengyou Zhang ,  Ying Shan

IPC分类号： G09G3/04

CPC分类号： G06F3/0425

摘要： A system and method for turning a regular computer monitor screen into a touch screen using an ordinary camera. It includes an image-screen mapping procedure to correct for the non-flatness of the computer screen. It also includes a segmentation method to distinguish the foreground, for example an indicator such as a finger, from the background of a computer screen. Additionally, this system and method includes a robust technique of finding the tip point location of the indicator (such as the finger tip). The screen coordinates of the tip point are then used to control the position of the system indicator.

摘要翻译： 一种使用普通相机将普通计算机显示器屏幕转换成触摸屏的系统和方法。 它包括一个图像屏幕映射程序来校正计算机屏幕的非平坦性。 它还包括一个分割方法，从计算机屏幕的背景区分前景，例如诸如手指的指示器。 此外，该系统和方法包括找到指示器的尖端位置（例如指尖）的鲁棒技术。 然后使用尖端点的屏幕坐标来控制系统指示器的位置。

公开(公告)号：US07327899B2

公开(公告)日：2008-02-05

申请号：US11465703

申请日：2006-08-18

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07319908B2

公开(公告)日：2008-01-15

申请号：US11261108

申请日：2005-10-28

申请人： Michael J. Sinclair ,  David W. Williams ,  Zhengyou Zhang ,  Zicheng Liu

发明人： Michael J. Sinclair ,  David W. Williams ,  Zhengyou Zhang ,  Zicheng Liu

IPC分类号： G05B11/01 ,  G05D3/12

CPC分类号： G06F1/3203 ,  G06F1/263 ,  G06F1/3231 ,  Y02D10/173

摘要： A system that facilitates managing resources (e.g., functionality, services) based at least in part upon an established context. More particularly, a context determination component can be employed to establish a context by processing sensor inputs or learning/inferring a user action/preference. Once the context is established via context determination component, a power/mode management component can be employed to activate and/or mask resources in accordance with the established context. The power and mode management of the device can extend life of a power source (e.g., battery) and mask functionality in accordance with a user and/or device state.

摘要翻译： 一种有助于至少部分地基于建立的上下文来管理资源（例如，功能，服务）的系统。 更具体地，可以采用上下文确定组件来通过处理传感器输入或学习/推断用户动作/偏好来建立上下文。 一旦通过上下文确定组件建立了上下文，则可以使用功率/模式管理组件来根据建立的上下文激活和/或掩蔽资源。 设备的功率和模式管理可以根据用户和/或设备状态延长电源（例如电池）的寿命和屏蔽功能。

公开(公告)号：US07260257B2

公开(公告)日：2007-08-21

申请号：US10178443

申请日：2002-06-19

申请人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

发明人： Zhengyou Zhang ,  Ross Cutler ,  Zicheng Liu ,  Anoop Gupta ,  Li-wei He

IPC分类号： C06K9/00

CPC分类号： G06F17/30843 ,  G06Q10/1095 ,  G11B27/105 ,  G11B27/28 ,  G11B27/34 ,  H04N5/77 ,  H04N9/806

摘要： A system that captures both whiteboard content and audio signals of a meeting using a digital camera and a microphone. The system can be retrofit to any existing whiteboard. It computes the time stamps of pen strokes on the whiteboard by analyzing the sequence of captured snapshots. It also automatically produces a set of key frames representing all the written content on the whiteboard before each erasure. The whiteboard content serves as a visual index to efficiently browse the audio meeting. The system not only captures the whiteboard content, but also helps the users to view and manage the captured meeting content efficiently and securely.

摘要翻译： 使用数码相机和麦克风捕获会议的白板内容和音频信号的系统。 该系统可以改装任何现有的白板。 它通过分析捕获的快照的顺序来计算白板上笔划的时间戳。 它也会在每次擦除之前自动产生代表白板上所有写入内容的一组关键帧。 白板内容作为视觉索引，有效地浏览音频会议。 该系统不仅可以捕获白板内容，还可以帮助用户有效，安全地查看和管理所捕获的会议内容。

公开(公告)号：US07200281B2

公开(公告)日：2007-04-03

申请号：US11108545

申请日：2005-04-18

申请人： Zhengyou Zhang ,  Zicheng Liu ,  Ying Shan

发明人： Zhengyou Zhang ,  Zicheng Liu ,  Ying Shan

IPC分类号： G06K9/36 ,  G09G5/00

CPC分类号： G06T15/04 ,  G06T11/001

摘要： A system and method, called Image-Based Surface Detail Transfer, to transfer geometric details from one surface of an object in an image to another with simple 2D image operations. The basic observation is that, without knowing its 3D geometry, geometric details (local deformations) can be extracted from a single image of an object in a way independent of its surface reflectance, and furthermore, these geometric details can be transferred to modify the appearance of other objects directly in images. Examples are shown including surface detail transfer between real objects, as well as between real and synthesized objects.

摘要翻译： 一种称为基于图像的表面细节传输的系统和方法，通过简单的2D图像操作将图像中的对象的一个​​表面的几何细节传输到另一个。 基本的观察是，在不知道其3D几何形状的情况下，可以以独立于其表面反射率的方式从对象的单个图像中提取几何细节（局部变形），此外，这些几何细节可以被转移以修改外观 的其他对象直接在图像。 示例的实例包括真实对象之间的表面细节传递，以及真实对象和合成对象之间的表面细节传递。

公开(公告)号：US20070058879A1

公开(公告)日：2007-03-15

申请号：US11227046

申请日：2005-09-15

申请人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

发明人： Ross Cutler ,  Ya Chang ,  Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06K9/40 ,  G06K9/36

CPC分类号： G06T5/006 ,  G06T7/68 ,  G06T7/80 ,  G06T2200/32

摘要： A panoramic camera is configured to automatically determine parameters of a table upon which the camera is situated as well as positional information of the camera relative to the table. In an initialization stage, table edges are detected to create an edge map. A Hough transformation-like symmetry voting operation is performed to clean up the edge map and to determine camera offset, camera orientation and camera tilt. The table is then fit to a table model to determine table parameters. In an operational stage, table edges are detected to create an edge map and the table model is fit to the edge map. The output can then be used for further panoramic image processing such as head size normalization, zooming, compensation for camera movement, etc.

摘要翻译： 全景相机被配置为自动确定相机所在的表的参数以及相机相对于表的位置信息。 在初始化阶段，检测表边缘以创建边缘图。 执行霍夫变换对称投票操作来清理边缘图并确定相机偏移，相机方向和相机倾斜度。 然后将表适合于表模型以确定表参数。 在操作阶段，检测表边缘以创建边缘图，并且表模型适合边缘图。 然后可以将输出用于进一步的全景图像处理，例如头部尺寸归一化，变焦，相机移动补偿等。

公开(公告)号：US07184609B2

公开(公告)日：2007-02-27

申请号：US11106311

申请日：2005-04-14

申请人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Ross Cutler ,  Michael Cohen ,  Zhengyou Zhang

IPC分类号： G06K9/36 ,  G09G5/00 ,  H04N7/00

CPC分类号： G06T3/0062 ,  G06K9/00228 ,  G06T3/4038 ,  G06T5/006 ,  G06T7/30

摘要： A real-time approximately 360 degree image correction system and a method for alleviating distortion and perception problems in images captured by omni-directional cameras. In general, the real-time panoramic image correction method generates a warp table from pixel coordinates of a panoramic image and applies the warp table to the panoramic image to create a corrected panoramic image. The corrections are performed using a parametric class of warping functions that include Spatially Varying Uniform (SVU) scaling functions. The SVU scaling functions and scaling factors are used to perform vertical scaling and horizontal scaling on the panoramic image pixel coordinates. A horizontal distortion correction is performed using the SVU scaling functions at at least two different scaling factors. This processing generates a warp table that can be applied to the panoramic image to yield the corrected panoramic image. In one embodiment the warp table is concatenated with a stitching table used to create the panoramic image.

摘要翻译： 一种实时大约360度的图像校正系统和一种减轻全方位摄像机拍摄图像失真和感知问题的方法。 通常，实时全景图像校正方法从全景图像的像素坐标生成扭曲表，并将经线表应用于全景图像，以创建校正的全景图像。 校正使用包括空间变化均匀（SVU）缩放函数的参数化的翘曲函数类来执行。 SVU缩放函数和缩放因子用于对全景图像像素坐标执行垂直缩放和水平缩放。 使用SVU缩放函数以至少两个不同的缩放因子执行水平失真校正。 该处理产生可应用于全景图像以产生经校正的全景图像的经向表。 在一个实施例中，经线台与用于创建全景图像的缝合台连接。

公开(公告)号：US07164790B2

公开(公告)日：2007-01-16

申请号：US11082600

申请日：2005-03-17

申请人： Zhengyou Zhang ,  Ying Shan

发明人： Zhengyou Zhang ,  Ying Shan

IPC分类号： G06K9/00

CPC分类号： G06K9/32 ,  G06K9/00201 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081

摘要： A method and a system for progressive stereo matching of digital images representing a scene. In general, the present invention uses a progressive iterative technique that includes a disparity gradient limit principle and a least commitment strategy. Generally unambiguous pixel matches are found by beginning with a few reliable pixel matches and finding progressively more unambiguous pixel matches. Unambiguous pixel matches are used to define the search ranges for each pixel to guide matching in the current iteration. Unambiguous pixel matches then are found using a novel correlation technique and based on a correlation score associated with a pixel match. The search range is capable of being rotated, and is part of a novel correlation technique that provides a more robust estimate of pixel match reliability. Potential pixel matches found in the search ranges are tested for ambiguity and unambiguous matches are selected and added to the reliable pixel matches.

摘要翻译： 用于表示场景的数字图像的渐进立体匹配的方法和系统。 通常，本发明使用包括视差梯度限制原理和最小承诺策略的渐进迭代技术。 通常从几个可靠的像素匹配开始，并逐渐发现更明确的像素匹配，可以找到明确的像素匹配。 明确的像素匹配用于定义每个像素的搜索范围，以指导当前迭代中的匹配。 然后使用新颖的相关技术并基于与像素匹配相关联的相关得分来找到明确的像素匹配。 搜索范围能够旋转，并且是提供对像素匹配可靠性的更鲁棒的估计的新颖相关技术的一部分。 对搜索范围中发现的潜在像素匹配进行模糊度测试，并选择明确的匹配并将其添加到可靠的像素匹配中。

公开(公告)号：US07149329B2

公开(公告)日：2006-12-12

申请号：US10968553

申请日：2004-10-19

申请人： Zicheng Liu ,  Zhengyou Zhang ,  Michael F. Cohen ,  Charles E. Jacobs

发明人： Zicheng Liu ,  Zhengyou Zhang ,  Michael F. Cohen ,  Charles E. Jacobs

IPC分类号： G06K9/00

CPC分类号： G06T13/40 ,  G06K9/00201 ,  G06K9/00248 ,  G06K9/00268 ,  G06K9/00281 ,  G06T7/251 ,  G06T7/55 ,  G06T7/579 ,  G06T7/74 ,  G06T9/001 ,  G06T15/205 ,  G06T17/00 ,  G06T17/10 ,  G06T17/20 ,  G06T2200/08 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/30201 ,  H04N19/162 ,  H04N19/503

摘要： Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.