公开(公告)号：US08269836B2

公开(公告)日：2012-09-18

申请号：US12179324

申请日：2008-07-24

申请人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

发明人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

IPC分类号： G06K9/62 ,  H04N3/02 ,  G06K9/00

CPC分类号： H05K3/4679 ,  G06T7/33 ,  G06T2207/30141 ,  H05K3/125 ,  H05K3/4664

摘要： Embodiments of the present invention enable image capture, alignment, and registration. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, an image capture system comprising a camera and a two-dimensional surface supporting an image may be calibrated based on configuration parameters of an image to be captured and of a simulated reference bitmap based on the image. In embodiments, the position of the image to be captured on the two-dimensional surface is determined based on calibration parameters. In embodiments, a sequence of images may be captured of sections of an image that cannot be captured in a single scan. A scan path across the image may be determined that is based in part on calibration parameters. In embodiments, consistency of quality of captured images is maintained by validating selected characteristics of each image as it is being captured and by validating the alignment of each captured image with a corresponding simulated reference bitmap.

摘要翻译： 本发明的实施例使得能够进行图像捕获，对准和配准。 本发明的某些应用是在用于检查印刷电路板（“PCB”）衬底的系统的各种实施例中的用途。 在实施例中，可以基于要捕获的图像的配置参数和基于图像的模拟参考位图来校准包括相机和支持图像的二维表面的图像拍摄系统。 在实施例中，基于校准参数确定待捕获在二维表面上的图像的位置。 在实施例中，可以捕获不能在单次扫描中捕获的图像的部分的图像序列。 可以确定跨越图像的扫描路径部分地基于校准参数。 在实施例中，通过在每个图像被捕获时选择的特征进行验证并且通过使用相应的模拟参考位图来验证每个捕获的图像的对准来维持所捕获图像的质量的一致性。

公开(公告)号：US20100020167A1

公开(公告)日：2010-01-28

申请号：US12179324

申请日：2008-07-24

申请人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

发明人： Ali Zandifar ,  Kar-Han Tan ,  Jing Xiao

IPC分类号： H04N7/18

CPC分类号： H05K3/4679 ,  G06T7/33 ,  G06T2207/30141 ,  H05K3/125 ,  H05K3/4664

摘要： Embodiments of the present invention enable image capture, alignment, and registration. Certain applications of the present invention are its use in various embodiments of a system for inspection of a printed circuit board (“PCB”) substrate. In embodiments, an image capture system comprising a camera and a two-dimensional surface supporting an image may be calibrated based on configuration parameters of an image to be captured and of a simulated reference bitmap based on the image. In embodiments, the position of the image to be captured on the two-dimensional surface is determined based on calibration parameters. In embodiments, a sequence of images may be captured of sections of an image that cannot be captured in a single scan. A scan path across the image may be determined that is based in part on calibration parameters. In embodiments, consistency of quality of captured images is maintained by validating selected characteristics of each image as it is being captured and by validating the alignment of each captured image with a corresponding simulated reference bitmap.

摘要翻译： 本发明的实施例使得能够进行图像捕获，对准和配准。 本发明的某些应用是在用于检查印刷电路板（“PCB”）衬底的系统的各种实施例中的用途。 在实施例中，可以基于要捕获的图像的配置参数和基于图像的模拟参考位图来校准包括相机和支持图像的二维表面的图像拍摄系统。 在实施例中，基于校准参数确定待捕获在二维表面上的图像的位置。 在实施例中，可以捕获不能在单次扫描中捕获的图像的部分的图像序列。 可以确定跨越图像的扫描路径部分地基于校准参数。 在实施例中，通过在每个图像被捕获时选择的特征进行验证并且通过使用相应的模拟参考位图来验证每个捕获的图像的对准来维持所捕获图像的质量的一致性。

公开(公告)号：US08042954B2

公开(公告)日：2011-10-25

申请号：US11963657

申请日：2007-12-21

申请人： Kar-Han Tan ,  Jing Xiao

发明人： Kar-Han Tan ,  Jing Xiao

IPC分类号： G03B21/14

CPC分类号： H04N9/3194 ,  H04N9/3147 ,  H04N9/3185

摘要： Two projected images from two projector-camera systems, each defined by characteristics c1=T1p1 and c2=T2p2, respectively, are used to create mosaic composite of a desired image c. Formulas p1=T1−1(c−T2p2) and p2=T2−1(c−T1p1) are iteratively repeated with p2 initially set to zero until p1 converges to a first mosaic image and p2 converges to a second mosaic image.

摘要翻译： 来自两个投影仪相机系统的两个投影图像分别由特征c1 = T1p1和c2 = T2p2定义，用于创建所需图像c的马赛克复合。 迭代地重复公式p1 = T1-1（c-T2p2）和p2 = T2-1（c-T1p1），p2初始设置为零，直到p1收敛到第一马赛克图像，并且p2收敛到第二马赛克图像。

公开(公告)号：US07901093B2

公开(公告)日：2011-03-08

申请号：US11623016

申请日：2007-01-12

申请人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

发明人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

IPC分类号： G03B21/14

CPC分类号： G03B21/26 ,  H04N9/3185 ,  H04N9/3194 ,  H04N17/002

摘要： An image created by a first projector is recreated using a second projector by relating the two projectors to a common point of view, preferably as viewed from a camera. A first transport matrix T1 is captured to relate the first projector to the camera. A second transport matrix T2 is then capture to relate the second projector to the camera. To have a first image p1, as projected by the first projector, reproduced by the second projector, the second projector projects a distorted image defined as (T2−1)(T1)p1. The inverse of T2, as used in this equation is an estimation defined by first creating an intermediate matrix {hacek over (T)} of equal size as T2. If a column in T2 is denoted as Tr and a corresponding column in {hacek over (T)} is denoted as {hacek over (T)}r, then the construction and population of {hacek over (T)} is defined as {hacek over (T)}r=Tr/(∥Tr∥)2, and the inverse of T2 is estimated as the transpose of {hacek over (T)}.

摘要翻译： 使用第二投影仪重新创建由第一投影仪创建的图像，该两个投影仪优选地从照相机观察到将两个投影仪相关联到共同的观点。 捕获第一传输矩阵T1以将第一投影仪与照相机相关联。 然后捕获第二传输矩阵T2以将第二投影仪与相机相关联。 为了具有由第二投影仪再现的由第一投影仪投影的第一图像p1，第二投影仪投影定义为（T2-1）（T1）p1的失真图像。 如在该等式中使用的T2的倒数是通过首先创建等于T2的中间矩阵{hacek over（T）}定义的估计。 如果T2中的列被表示为Tr，并且{hacek over（T）}中的相应列被表示为{hacek over（T）} r，则{hacek over（T）}的构造和总体被定义为{ （T）} r = Tr /（∥Tr‖）2，并且T2的倒数被估计为{hacek over（T）}的转置。

公开(公告)号：US20100150406A1

公开(公告)日：2010-06-17

申请号：US12333623

申请日：2008-12-12

申请人： Jing Xiao ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

发明人： Jing Xiao ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

IPC分类号： G06K9/00 ,  G06K9/36

CPC分类号： G06K9/00261 ,  G06T11/00 ,  H04N7/147

摘要： Disclosed are systems and methods for masking at least a portion of one image with another image. Aspects of the present invention facilitate the placing of a virtual mask onto an item in an image even if that items moves in subsequent images, such as between different image frames in a video.

摘要翻译： 公开了用于用另一图像掩蔽一个图像的至少一部分的系统和方法。 即使该项目在诸如视频中的不同图像帧之间的后续图像中移动，本发明的方面有助于将虚拟掩模放置在图像中的项目上。

公开(公告)号：US08197070B2

公开(公告)日：2012-06-12

申请号：US12329099

申请日：2008-12-05

申请人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

发明人： Kar-Han Tan ,  Jing Xiao ,  Anoop K. Bhattacharjya

IPC分类号： G03B21/00

CPC分类号： G03B21/26 ,  G01B11/25 ,  G01B11/2509 ,  G06T7/80 ,  G06T2207/10024 ,  H04N9/3182 ,  H04N9/3185 ,  H04N9/3194 ,  H04N17/002

摘要： Disclosed are embodiments of systems and methods for identifying features using color information in an image. The image may be formed from one or more display images comprising color information and features or feature components. Because color information may be used to identify features, more than one feature or feature component may be displayed in a display image. Because a plurality of features may be identified in a calibration image, an image system, such as a projector-camera system, can reduce the number of display images needed to calibrate the system.

摘要翻译： 公开了用于使用图像中的颜色信息来识别特征的系统和方法的实施例。 图像可以由包括颜色信息和特征或特征组件的一个或多个显示图像形成。 由于可以使用颜色信息来识别特征，所以可以在显示图像中显示多于一个的特征或特征成分。 由于可以在校准图像中识别多个特征，诸如投影仪 - 照相机系统的图像系统可以减少校准系统所需的显示图像的数量。

公开(公告)号：US20080174704A1

公开(公告)日：2008-07-24

申请号：US11963638

申请日：2007-12-21

申请人： Kar-Han Tan ,  Jing Xiao

发明人： Kar-Han Tan ,  Jing Xiao

IPC分类号： H04N3/23

CPC分类号： H04N9/3194 ,  H04N9/3147 ,  H04N9/3185

摘要： Light distortion due to light noise or light scattering object in the path of a light beam from a projector to a camera's image sensor in projector-camera systems are mitigated, or eliminated, by a simple modification to a light transport matrix T. For each row in light transport matrix T, matrix entries along a common row are compared, and all but the highest valued entry in the row are zeroed out, i.e. nullified. It is preferred that an array and record notation be used in order to reduce the size of the light transport matrix T, and its modified version to two arrays.

摘要翻译： 通过对光传输矩阵T的简单修改，减轻或消除了投影仪 - 照相机系统中的投影仪到照相机的图像传感器的光束路径中的光噪声或光散射物体的光失真。对于每行 在光传输矩阵T中，比较沿着公共行的矩阵条目，并且除了行中的最高值条目之外的所有值都被清零，否则为零。 为了将光传输矩阵T的尺寸及其修改版本减小到两个阵列，优选使用阵列和记录符号。

公开(公告)号：US08194097B2

公开(公告)日：2012-06-05

申请号：US12333623

申请日：2008-12-12

申请人： Jing Xiao ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

发明人： Jing Xiao ,  Kar-Han Tan ,  Anoop K. Bhattacharjya

IPC分类号： G09G5/00 ,  G06T15/00 ,  G06K9/00

CPC分类号： G06K9/00261 ,  G06T11/00 ,  H04N7/147

摘要： Disclosed are systems and methods for masking at least a portion of one image with another image. Aspects of the present invention facilitate the placing of a virtual mask onto an item in an image even if that items moves in subsequent images, such as between different image frames in a video.

摘要翻译： 公开了用于用另一图像掩蔽一个图像的至少一部分的系统和方法。 即使该项目在诸如视频中的不同图像帧之间的后续图像中移动，本发明的方面有助于将虚拟掩模放置在图像中的项目上。

公开(公告)号：US07901095B2

公开(公告)日：2011-03-08

申请号：US12413002

申请日：2009-03-27

申请人： Jing Xiao ,  Kar-Han Tan

发明人： Jing Xiao ,  Kar-Han Tan

IPC分类号： H04N5/74 ,  G03B21/14

CPC分类号： H04N9/3194 ,  H04N9/3147 ,  H04N9/3185

摘要： A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. If the resolution a camera is lower than that of a projector within said projection system, then the transformation matrix will have holes where image data corresponding to a projector pixel will have been lost. In this, case, new image are generated to fill-in the holes.

摘要翻译： 投影系统使用变换矩阵以这样的方式变换投影图像p，以便补偿投影表面上的表面不规则性。 转换矩阵利用将投影仪与相机相关联的光传输的属性。 如果相机的分辨率低于所述投影系统内的投影仪的分辨率，则变换矩阵将具有与投影仪像素对应的图像数据将丢失的孔。 在这种情况下，生成新图像以填充孔。

公开(公告)号：US08106949B2

公开(公告)日：2012-01-31

申请号：US12412244

申请日：2009-03-26

申请人： Kar-Han Tan ,  Jing Xiao

发明人： Kar-Han Tan ,  Jing Xiao

IPC分类号： H04N17/00 ,  H04N9/31

CPC分类号： H04N17/045 ,  H04N9/3185 ,  H04N9/3191 ,  H04N9/3194

摘要： A projection system uses a transformation matrix to transform a projection image p in such a manner so as to compensate for surface irregularities on a projection surface. The transformation matrix makes use of properties of light transport relating a projector to a camera. A display pipeline of user-supplied image modification processing modules are reduced by first representing the processing modules as multiple, individual matrix operations. All the matrix operations are then combined with, i.e., multiplied to, the transformation matrix to create a modified transformation matrix. The created transformation matrix is then used in place of the original transformation matrix to simultaneously achieve both image transformation and any pre and post image processing defined by the image modification processing modules.

摘要翻译： 投影系统使用变换矩阵以这样的方式变换投影图像p，以便补偿投影表面上的表面不规则性。 转换矩阵利用将投影仪与相机相关联的光传输的属性。 通过首先将处理模块表示为多个单独的矩阵操作来减少用户提供的图像修改处理模块的显示管道。 然后将所有的矩阵运算与变换矩阵组合，即乘以转换矩阵以创建修改的变换矩阵。 然后使用所创建的变换矩阵来代替原始变换矩阵，以同时实现图像变换和由图像修改处理模块定义的任何前后图像处理。