公开(公告)号：US07171056B2

公开(公告)日：2007-01-30

申请号：US10372488

申请日：2003-02-22

申请人： Zhengyou Zhang ,  Li-wei He

发明人： Zhengyou Zhang ,  Li-wei He

IPC分类号： G06K9/36 ,  G06K9/40

CPC分类号： H04N1/6027 ,  G06K9/32 ,  G06K9/42 ,  G06K2209/01 ,  G06T5/006 ,  G06T7/12 ,  G06T2207/10016 ,  G06T2207/20061 ,  H04N1/387 ,  H04N1/4072

摘要： A system and method of converting the content of a regular whiteboard into an electronic document. This system and method provides an effective, economical and easy to use way to convert whiteboard content as an enhanced and easily editable electronic document though the use of a still or video camera. It uses a series of image processing steps to clip borders, rectify the whiteboard image and correct colors.

摘要翻译： 将普通白板的内容转换为电子文档的系统和方法。 该系统和方法提供了一种有效，经济且易于使用的方式，通过使用静态或摄像机，将白板内容转换为增强型和易于编辑的电子文档。 它使用一系列图像处理步骤来剪切边框，纠正白板图像和正确的颜色。

公开(公告)号：US20060293887A1

公开(公告)日：2006-12-28

申请号：US11168770

申请日：2005-06-28

申请人： Zhengyou Zhang ,  Zicheng Liu ,  Alejandro Acero ,  Amarnag Subramanya ,  James Droppo

发明人： Zhengyou Zhang ,  Zicheng Liu ,  Alejandro Acero ,  Amarnag Subramanya ,  James Droppo

IPC分类号： G10L15/20

CPC分类号： G10L21/0208 ,  G10L2021/02165

摘要： A method and apparatus determine a likelihood of a speech state based on an alternative sensor signal and an air conduction microphone signal. The likelihood of the speech state is used, together with the alternative sensor signal and the air conduction microphone signal, to estimate a clean speech value for a clean speech signal.

摘要翻译： 方法和装置基于替代传感器信号和空气传导麦克风信号确定语音状态的可能性。 使用语音状态的可能性以及替代的传感器信号和导气麦克风信号来估计干净的语音信号的清晰的语音值。

公开(公告)号：US20060132869A1

公开(公告)日：2006-06-22

申请号：US11275457

申请日：2006-01-05

申请人： Zhengyou Zhang

发明人： Zhengyou Zhang

IPC分类号： H04N1/46

CPC分类号： H04N17/002

摘要： Calibration for a camera is achieved by receiving images of a calibration object whose geometry is one-dimension in space. The received images show the calibration object in several distinct positions. Calibration for the camera is then calculated based on the received images of the calibration object.

摘要翻译： 相机的校准是通过接收几何为空间一维的校准对象的图像来实现的。 接收到的图像显示校准对象在几个不同的位置。 然后基于接收到的校准对象的图像来计算相机的校准。

公开(公告)号：US07020305B2

公开(公告)日：2006-03-28

申请号：US09731481

申请日：2000-12-06

申请人： Zicheng Liu ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00248 ,  G06T7/251 ,  G06T7/70 ,  G06T2207/10016 ,  G06T2207/30201

摘要： The system provides improved procedures to estimate head motion between two images of a face. Locations of a number of distinct facial features are identified in two images. The identified locations can correspond to the eye comers, mouth corners and nose tip. The locations are converted into as a set of physical face parameters based on the symmetry of the identified distinct facial features. The set of physical parameters reduces the number of unknowns as compared to the number of equations used to determine the unknowns. An initial head motion estimate is determined by: (a) estimating each of the set of physical parameters, (b) estimating a first head pose transform corresponding to the first image, and (c) estimating a second head pose transform corresponding to the second image. The head motion estimate can be incorporated into a feature matching algorithm to refine the head motion estimation and the physical facial parameters. In one implementation, an inequality constraint is placed on a particular physical parameter—such as a nose tip, such that the parameter is constrained within a predetermined minimum and maximum value. The inequality constraint is converted to an equality constraint by using a penalty function. Then, the inequality constraint is used during the initial head motion estimation to add additional robustness to the motion estimation.

公开(公告)号：US20050201634A1

公开(公告)日：2005-09-15

申请号：US10796880

申请日：2004-03-09

申请人： Po Yuan ,  Zhengyou Zhang

发明人： Po Yuan ,  Zhengyou Zhang

IPC分类号： G06K9/40

CPC分类号： H04N1/6027 ,  H04N1/4072

摘要： A system and process for improving the appearance of improperly colored and/or improperly exposed images is presented. This involves the use of two novel techniques—namely an automatic color correction technique and an automatic exposure correction technique. The automatic color correction technique takes information from within an image to determine true color characteristics, and improves the color in improperly colored pixels. The automatic exposure correction technique measures the average intensity of all of the pixels and adjusts the entire image pixel by pixel to compensate for over or under exposure. These techniques are stand alone in that each can be applied to an image exclusive of the other, or they can both be applied in any order desired.

摘要翻译： 提出了一种用于改善不正确着色和/或曝光不正确的图像外观的系统和过程。 这涉及使用两种新颖的技术 - 即自动色彩校正技术和自动曝光校正技术。 自动色彩校正技术从图像中获取信息以确定真实的颜色特性，并改善不正确的彩色像素中的颜色。 自动曝光校正技术测量所有像素的平均强度，并逐像素地调整整个图像以补偿曝光或曝光过度。 这些技术是独立的，因为每个可以应用于不同于另一个的图像，或者它们都可以以任何所需的顺序应用。

公开(公告)号：US20050190962A1

公开(公告)日：2005-09-01

申请号：US11110296

申请日：2005-04-20

申请人： Zicheng Liu ,  Zhengyou Zhang ,  Michael Cohen ,  Charles Jacobs

发明人： Zicheng Liu ,  Zhengyou Zhang ,  Michael Cohen ,  Charles Jacobs

IPC分类号： G06K9/00 ,  G06T13/40 ,  G06T15/20 ,  G06T17/00 ,  G06T17/10 ,  H04N7/26 ,  H04N7/36

CPC分类号： G06T13/40 ,  G06K9/00201 ,  G06K9/00248 ,  G06K9/00268 ,  G06K9/00281 ,  G06T7/251 ,  G06T7/55 ,  G06T7/579 ,  G06T7/74 ,  G06T9/001 ,  G06T15/205 ,  G06T17/00 ,  G06T17/10 ,  G06T17/20 ,  G06T2200/08 ,  G06T2207/10012 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/30201 ,  H04N19/162 ,  H04N19/503

摘要： Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.

公开(公告)号：US06931150B2

公开(公告)日：2005-08-16

申请号：US10462947

申请日：2003-06-16

申请人： Zhengyou Zhang ,  Ying Shan

发明人： Zhengyou Zhang ,  Ying Shan

IPC分类号： G06K9/00 ,  G06T7/00 ,  H04N13/00

CPC分类号： G06K9/32 ,  G06K9/00201 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081

摘要： A method and a system for progressive stereo matching of digital images representing a scene. In general, the present invention uses a progressive iterative technique that includes a disparity gradient limit principle and a least commitment strategy. The progressive iterative technique finds generally unambiguous pixel matches by beginning with a few reliable pixel matches and finding progressively more unambiguous pixel matches. Unambiguous pixel matches found in the previous iteration are used to define the search ranges for each pixel to guide matching in the current iteration. Unambiguous pixel matches in the current iteration then are found using a novel correlation technique and based on a correlation score associated with a pixel match. The search range is capable of being rotated, and is part of a novel correlation technique of the present invention that provides a more robust estimate of pixel match reliability. Potential pixel matches found in the search ranges are tested for ambiguity and any unambiguous matches are selected and added to the set of reliable pixel matches. The ambiguity testing includes determining a correlation score for the pixel match and classifying the match based on the correlation score. The present invention also includes a system for progressive image matching that incorporates the method of the present invention.

摘要翻译： 用于表示场景的数字图像的渐进立体匹配的方法和系统。 通常，本发明使用包括视差梯度限制原理和最小承诺策略的渐进迭代技术。 渐进式迭代技术通过从几个可靠的像素匹配开始并逐渐找到更明确的像素匹配来发现一般的明确的像素匹配。 在前一次迭代中找到的明确像素匹配用于定义每个像素的搜索范围，以指导当前迭代中的匹配。 然后使用新颖的相关技术并且基于与像素匹配相关联的相关得分来找到当前迭代中的明确像素匹配。 搜索范围能够旋转，并且是本发明的新颖相关技术的一部分，其提供了对像素匹配可靠性的更鲁棒的估计。 对搜索范围中发现的潜在像素匹配进行模糊度测试，并选择任何明确匹配，并将其添加到可靠像素匹配集合中。 模糊度测试包括确定像素匹配的相关分数并基于相关分数对匹配进行分类。 本发明还包括一种包含本发明方法的逐行图像匹配系统。

公开(公告)号：US20050163367A1

公开(公告)日：2005-07-28

申请号：US11082600

申请日：2005-03-17

申请人： Zhengyou Zhang ,  Ying Shan

发明人： Zhengyou Zhang ,  Ying Shan

IPC分类号： G06K9/00 ,  G06T7/00 ,  H04N13/00

CPC分类号： G06K9/32 ,  G06K9/00201 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081

摘要： A method and a system for progressive stereo matching of digital images representing a scene. In general, the present invention uses a progressive iterative technique that includes a disparity gradient limit principle and a least commitment strategy. Generally unambiguous pixel matches are found by beginning with a few reliable pixel matches and finding progressively more unambiguous pixel matches. Unambiguous pixel matches are used to define the search ranges for each pixel to guide matching in the current iteration. Unambiguous pixel matches then are found using a novel correlation technique and based on a correlation score associated with a pixel match. The search range is capable of being rotated, and is part of a novel correlation technique that provides a more robust estimate of pixel match reliability. Potential pixel matches found in the search ranges are tested for ambiguity and unambiguous matches are selected and added to the reliable pixel matches.

公开(公告)号：US20050104864A1

公开(公告)日：2005-05-19

申请号：US10804311

申请日：2004-03-19

申请人： Zhengyou Zhang ,  Liwei He

发明人： Zhengyou Zhang ,  Liwei He

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06K9/22 ,  G06Q10/00 ,  G06T5/00 ,  G06T7/20 ,  G06T7/40 ,  G09G5/00 ,  G09G5/10

CPC分类号： H04N7/15 ,  G06F3/017 ,  G06K9/222 ,  G06Q10/10 ,  G06T7/20 ,  G06T7/90

摘要： A system that captures both whiteboard content and audio signals of a meeting using a video camera and records or transmits them in real-time. The Real-Time Whiteboard Capture captures pen strokes on whiteboards in real time using an off-the-shelf video camera. Unlike many existing tools, the RTWCS does not instrument the pens or the whiteboard. It analyzes the sequence of captured video images in real time, classifies the pixels into whiteboard background, pen strokes and foreground objects (e.g., people in front of the whiteboard), and extracts newly written pen strokes. This allows the RTWCS to transmit whiteboard contents using very low bandwidth to remote meeting participants. Combined with other teleconferencing tools such as voice conference and application sharing, the RTWCS becomes a powerful tool to share ideas during online meetings.

摘要翻译： 使用摄像机捕获会议的白板内容和音频信号的系统，并实时记录或传输。 实时白板捕获使用现成的摄像机实时捕获白板上的笔划。 与许多现有工具不同，RTWCS不会对笔或白板进行仪器仪表。 它实时分析拍摄的视频图像的顺序，将像素分类为白板背景，笔画和前景对象（例如，白板前的人物），并提取新写入的笔画。 这允许RTWCS使用非常低的带宽将白板内容传输给远程会议参与者。 结合其他电话会议工具，如语音会议和应用程序共享，RTWCS成为在线会议期间分享想法的强大工具。

公开(公告)号：US20050074145A1

公开(公告)日：2005-04-07

申请号：US11000603

申请日：2004-12-01

申请人： Zicheng Liu ,  Zhengyou Zhang

发明人： Zicheng Liu ,  Zhengyou Zhang

IPC分类号： G06T7/00 ,  G06T7/20 ,  G06T13/00 ,  G06T15/70 ,  G06K9/00

CPC分类号： G06K9/00248 ,  G06T7/251 ,  G06T7/70 ,  G06T2207/10016 ,  G06T2207/30201

摘要： Systems and methods to estimate head motion between two images of a face are described. In one aspect, locations of a plurality of distinct facial features in the two images are identified. The locations correspond to a number of unknowns that are determined upon estimation of head motion. The number of unknowns are determined by a number of equations. The identified locations are converted into a set of physical face parameters based on the symmetry of the distinct facial features. The set of physical face parameters reduce the number of unknowns as compared to the number of equations used to determine the unknowns. An inequality constraint is added to a particular face parameter of the physical face parameters, such that the particular face parameter is constrained within a predetermined minimum and maximum value. The inequality constraint is converted to an equality constraint using a penalty function. Head motion is estimated from identified points in the two images. The identified points are based on the set of physical face parameters.

摘要翻译： 描述用于估计面部的两个图像之间的头部运动的系统和方法。 在一个方面，识别两个图像中的多个不同的面部特征的位置。 这些位置对应于在估计头部运动时确定的许多未知数。 未知数的数量由多个等式确定。 基于不同的面部特征的对称性，将识别的位置转换成一组物理面部参数。 与用于确定未知数的等式的数量相比，物理面参数的集合减少未知数的数量。 将不等式约束添加到物理面部参数的特定面部参数，使得特定面部参数被限制在预定的最小值和最大值内。 不等式约束使用惩罚函数转换为等式约束。 从两个图像中的识别点估计头部运动。 识别的点是基于物理面参数的集合。