公开(公告)号：US20110102538A1

公开(公告)日：2011-05-05

申请号：US12608195

申请日：2009-10-29

申请人： Kar-Han Tan

发明人： Kar-Han Tan

IPC分类号： H04N7/15

CPC分类号： H04N7/144 ,  H04N21/4223 ,  H04N21/4788

摘要： Various embodiments of the present invention are directed to video-conferencing systems configured and operated to create eye contact between video conference participants. In one embodiment, video conferencing system includes a display, a video camera positioned to capture a video image of a first video conference participant through the display, and a projector positioned to project a video image of a second video conference participant onto the display screen such that the first participant can view the second participant. The display screen is positioned between the first participant and the video camera. The video camera and the projector can be operated during a video conference to establish eye contact between the first participant and the second participant by creating a line-of-sight that passes through a point of the head of the second participant's image between the video camera and the first participant.

摘要翻译： 本发明的各种实施例涉及配置和操作以在视频会议参与者之间创建眼神接触的视频会议系统。 在一个实施例中，视频会议系统包括显示器，定位成通过显示器捕获第一视频会议参与者的视频图像的摄像机，以及定位成将第二视频会议参与者的视频图像投影到显示屏幕上的投影仪， 第一个参与者可以查看第二个参与者。 显示屏位于第一参与者和摄像机之间。 视频摄像机和投影仪可以在视频会议期间操作，以通过创建通过第二参与者的图像的头部的点在摄像机之间的视线来建立第一参与者和第二参与者之间的眼神接触 和第一个参与者。

公开(公告)号：US20100245684A1

公开(公告)日：2010-09-30

申请号：US12413002

申请日：2009-03-27

申请人： Jing Xiao ,  Kar-Han Tan

发明人： Jing Xiao ,  Kar-Han Tan

IPC分类号： H04N5/74

CPC分类号： H04N9/3194 ,  H04N9/3147 ,  H04N9/3185

摘要： A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. If the resolution a camera is lower than that of a projector within said projection system, then the transformation matrix will have holes where image data corresponding to a projector pixel will have been lost. In this, case, new image are generated to fill-in the holes.

摘要翻译： 投影系统使用变换矩阵以这样的方式变换投影图像p，以便补偿投影表面上的表面不规则性。 转换矩阵利用将投影仪与相机相关联的光传输的属性。 如果相机的分辨率低于所述投影系统内的投影仪的分辨率，则变换矩阵将具有与投影仪像素对应的图像数据将丢失的孔。 在这种情况下，生成新图像以填充孔。

公开(公告)号：US20100245591A1

公开(公告)日：2010-09-30

申请号：US12412244

申请日：2009-03-26

申请人： Kar-Han Tan ,  Jing Xiao

发明人： Kar-Han Tan ,  Jing Xiao

IPC分类号： H04N17/00

CPC分类号： H04N17/045 ,  H04N9/3185 ,  H04N9/3191 ,  H04N9/3194

摘要： A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface 5irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

摘要翻译： 投影系统使用变换矩阵以这样的方式变换投影图像p，以便补偿投影表面上的表面5的不规则性。 转换矩阵利用将投影仪与相机相关联的光传输的属性。 通过首先将处理模块表示为多个单独的矩阵操作来减少用户提供的图像修改处理模块的显示管道。 然后将所有的矩阵运算与变换矩阵组合，即乘以转换矩阵以创建修改的变换矩阵。 然后使用所创建的变换矩阵来代替原始变换矩阵，以同时实现图像变换和由图像修改处理模块定义的任何前后图像处理。

公开(公告)号：US07794090B2

公开(公告)日：2010-09-14

申请号：US11613129

申请日：2006-12-19

申请人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

发明人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

IPC分类号： G03B21/14

CPC分类号： G03B21/26 ,  H04N9/3185 ,  H04N9/3194 ,  H04N17/002

摘要： Application of dual photography is simplified by reducing the number of captured images needed to generate a light transport matrix T of (p×q) projection pixel array from (p×q) images to (p+q) images. Manipulation of the light transport matrix is also simplified by replacing the use of a matrix T with an index associating each projection pixel to only non-zero light transport values. By eliminating the use of zero-valued light transport coefficients, the memory and processing requirements for implementing dual photography are greatly reduced. This dual photography technique is applied to the calibration of projector-camera systems. A second method for calibrating projector-camera systems uses a known projection test pattern and a calibrated camera to associate projected markers on a real image to a captured image. Since the real location of the projected markers are determined by the camera, and the relative location of the markers on the test pattern is also known, the projector may be calibrated using homography techniques.

摘要翻译： 通过减少从（p×q）图像到（p + q）图像生成（p×q）投影像素阵列的光传输矩阵T所需的捕获图像的数量来简化双重照相的应用。 光传输矩阵的操纵也通过将每个投影像素仅与非零光传输值相关联的索引替换为矩阵T的使用来简化。 通过消除零值光传输系数的使用，实现双摄影的存储器和处理要求大大降低。 这种双摄影技术被应用于投影仪相机系统的校准。 用于校准投影仪相机系统的第二种方法使用已知的投影测试图案和校准的相机来将投影的标记物与真实图像相关联以捕捉图像。 由于投影标记的真实位置由相机确定，并且标记在测试图案上的相对位置也是已知的，所以可以使用单色技术来校准投影仪。

公开(公告)号：US20100141651A1

公开(公告)日：2010-06-10

申请号：US12331084

申请日：2008-12-09

申请人： Kar-Han Tan

发明人： Kar-Han Tan

IPC分类号： G06T17/00

CPC分类号： G06T7/579 ,  G06T2207/10016

摘要： Disclosed are embodiments of systems and methods for synthesizing a detailed depth map from a video image. In embodiments, the motion vectors decoded from a video stream may be classified into groups by the application of K-Model clustering techniques based on an affine model. In embodiments, a coarse depth map of the image pixels may be generated using the image segmented according to the motion vector clusters. In embodiments, high resolution gradient maps of the image may be generated using the coarse depth map as well as edge information from the image. In embodiments, a surface reconstruction algorithm, such as the Frankot-Chellappa algorithm, may be applied to the high resolution gradient maps to synthesize a detailed depth map of the image. A detailed depth map of an image may be used to render a three-dimensional surface, for example.

摘要翻译： 公开了用于从视频图像合成详细深度图的系统和方法的实施例。 在实施例中，通过基于仿射模型的K模型聚类技术的应用，可以将从视频流解码的运动矢量分类成组。 在实施例中，可以使用根据运动矢量簇分割的图像来生成图像像素的粗略深度图。 在实施例中，可以使用粗略深度图以及来自图像的边缘信息来生成图像的高分辨率梯度图。 在实施例中，诸如Frankot-Chellappa算法的表面重建算法可以应用于高分辨率梯度图，以合成图像的详细深度图。 例如，可以使用图像的详细深度图来渲染三维表面。

公开(公告)号：US20100020167A1

公开(公告)日：2010-01-28

申请号：US12179324

申请日：2008-07-24

申请人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

发明人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

IPC分类号： H04N7/18

CPC分类号： H05K3/4679 ,  G06T7/33 ,  G06T2207/30141 ,  H05K3/125 ,  H05K3/4664

摘要： Embodiments of the present invention enable image capture, alignment, and registration. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, an image capture system comprising a camera and a two-dimensional surface supporting an image may be calibrated based on configuration parameters of an image to be captured and of a simulated reference bitmap based on the image. In embodiments, the position of the image to be captured on the two-dimensional surface is determined based on calibration parameters. In embodiments, a sequence of images may be captured of sections of an image that cannot be captured in a single scan. A scan path across the image may be determined that is based in part on calibration parameters. In embodiments, consistency of quality of captured images is maintained by validating selected characteristics of each image as it is being captured and by validating the alignment of each captured image with a corresponding simulated reference bitmap.

摘要翻译： 本发明的实施例使得能够进行图像捕获，对准和配准。 本发明的某些应用是在用于检查印刷电路板（“PCB”）衬底的系统的各种实施例中的用途。 在实施例中，可以基于要捕获的图像的配置参数和基于图像的模拟参考位图来校准包括相机和支持图像的二维表面的图像拍摄系统。 在实施例中，基于校准参数确定待捕获在二维表面上的图像的位置。 在实施例中，可以捕获不能在单次扫描中捕获的图像的部分的图像序列。 可以确定跨越图像的扫描路径部分地基于校准参数。 在实施例中，通过在每个图像被捕获时选择的特征进行验证并且通过使用相应的模拟参考位图来验证每个捕获的图像的对准来维持所捕获图像的质量的一致性。

公开(公告)号：US20090086081A1

公开(公告)日：2009-04-02

申请号：US12329099

申请日：2008-12-05

申请人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

发明人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

IPC分类号： H04N5/222 ,  G06K9/46

CPC分类号： G03B21/26 ,  G01B11/25 ,  G01B11/2509 ,  G06T7/80 ,  G06T2207/10024 ,  H04N9/3182 ,  H04N9/3185 ,  H04N9/3194 ,  H04N17/002

摘要： Disclosed are embodiments of systems and methods for identifying features using color information in an image. The image may be formed from one or more display images comprising color information and features or feature components. Because color information may be used to identify features, more than one feature or feature component may be displayed in a display image. Because a plurality of features may be identified in a calibration image, an image system, such as a projector-camera system, can reduce the number of display images needed to calibrate the system.

摘要翻译： 公开了用于使用图像中的颜色信息来识别特征的系统和方法的实施例。 图像可以由包括颜色信息和特征或特征组件的一个或多个显示图像形成。 由于可以使用颜色信息来识别特征，所以可以在显示图像中显示多于一个的特征或特征成分。 由于可以在校准图像中识别多个特征，诸如投影仪 - 照相机系统的图像系统可以减少校准系统所需的显示图像的数量。

公开(公告)号：US20080174516A1

公开(公告)日：2008-07-24

申请号：US11963657

申请日：2007-12-21

申请人： Jing Xiao ,  Kar-Han Tan

发明人： Jing Xiao ,  Kar-Han Tan

IPC分类号： G09G5/00

CPC分类号： H04N9/3194 ,  H04N9/3147 ,  H04N9/3185

摘要： Two projected images from two projector-camera systems, each defined by characteristics c1=T1p1 and c2=T2p2, respectively, are used to create mosaic composite of a desired image c. Formulas p1=T1−1 (c−T2p2) and p2=T2−1(c−T1p1) are iteratively repeated with p2 initially set to zero until p1 converges to a first mosaic image and p2 converges to a second mosaic image.

摘要翻译： 来自两个投影仪 - 照相机系统的两个投影图像，每个由特征c 1＆lt; 1＆lt; 1＆lt; 1＆gt;和＆lt; 分别用于产生期望图像c的马赛克复合物。 式（1）其中R 1和R 2各自独立地为氢或低级烷基， 反复地，p <2> = 2 1（cT 1

1） 重复p＆lt; 2＆gt;初始设置为零直到p <1>收敛到第一马赛克图像并且p <2>收敛到第二马赛克图像。

公开(公告)号：US20080018792A1

公开(公告)日：2008-01-24

申请号：US11458598

申请日：2006-07-19

申请人： Kiran Bhat ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

发明人： Kiran Bhat ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

IPC分类号： H04N9/74

CPC分类号： G06T13/40 ,  G06T2213/12 ,  H04N5/275

摘要： A surround visual field framework or system and methods are presented. In an embodiment, a surround visual field system comprises a control signal extractor that obtains a control signal that is related to the input stream. The control signal is provided to a coupling rule that links the control signal to an effect on an element of a surround visual field. The effect is applied to the element of the surround visual field thereby creating a surround visual field that has a characteristic or characteristics which relate to an input audio/visual stream presentation. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding the input stream being displayed. In embodiments, the surround visual field may be a rendering of a three-dimensional environment. In embodiments, one or more otherwise idle display areas may be used to display a surround visual field.

摘要翻译： 提出了环绕视野框架或系统和方法。 在一个实施例中，环绕视场系统包括获取与输入流相关的控制信号的控制信号提取器。 控制信号被提供给将控制信号链接到对环绕视场的元件的影响的耦合规则。 该效果被应用于环绕视野的元素，从而创建具有与输入音频/视频流呈现相关的特征或特征的环绕视野。 在一个实施例中，环绕视野被显示在部分地围绕或围绕正在显示的输入流的区域中。 在实施例中，环绕视野可以是三维环境的渲染。 在实施例中，可以使用一个或多个否则空闲的显示区域来显示环绕视野。

公开(公告)号：US20070126864A1

公开(公告)日：2007-06-07

申请号：US11390907

申请日：2006-03-28

申请人： Kiran Bhat ,  Kar-Han Tan ,  Anoop Bhattacharjya

发明人： Kiran Bhat ,  Kar-Han Tan ,  Anoop Bhattacharjya

IPC分类号： H04N13/04

CPC分类号： H04N5/144 ,  H04N5/44591 ,  H04N9/3179 ,  H04N9/74 ,  H04N21/4122 ,  H04N21/4131 ,  H04N21/42202 ,  H04N21/42222 ,  H04N21/4318 ,  H04N21/44008 ,  H04N21/44218

摘要： A surround visual field that has a characteristic or characteristics which relate to an audio/visual presentation is described. In one embodiment, the surround visual field is displayed in an area partially surrounding or surrounding the video content being displayed. This surround visual field may be comprised of a plurality of elements that further enhance the effect of the content being displayed. For example, one embodiment of the invention provides for elements within the surround visual field to move in relation to motion within the video content being displayed. Other characteristics of the video content may also be supplemented by the surround visual field or the surround visual field may be authored, at least in part, to correspond to the content itself. In embodiments, the surround visual field may be a rendering of a three-dimensional environment. In embodiments, one or more otherwise idle display areas may be used to display a surround visual field.

摘要翻译： 描述具有与音频/视频呈现相关的特征或特征的环绕视野。 在一个实施例中，环绕视野被显示在部分地围绕或围绕正在显示的视频内容的区域中。 该环绕视野可以由进一步增强被显示的内容的效果的多个元素组成。 例如，本发明的一个实施例提供了环绕视野内的元件，以相对于所显示的视频内容内的运动而移动。 视频内容的其他特征还可以由环绕视野补充，或至少部分地创作环绕视野以对应于内容本身。 在实施例中，环绕视野可以是三维环境的渲染。 在实施例中，可以使用一个或多个否则空闲的显示区域来显示环绕视野。