公开(公告)号：US20090112487A1

公开(公告)日：2009-04-30

申请号：US12258398

申请日：2008-10-25

申请人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Fuqiang Zhou ,  Qingbo Li ,  Zhen Liu ,  Qianzhe Liu

发明人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Fuqiang Zhou ,  Qingbo Li ,  Zhen Liu ,  Qianzhe Liu

IPC分类号： G01B11/00

CPC分类号： G01B11/2513 ,  B61K9/08 ,  G01B11/2522

摘要： The invention discloses a vehicle dynamic measurement device for comprehensive parameters of rail wear, which comprises a vision sensor, a computer and a milometer. A high-speed image acquisition card and a measurement module are installed in the computer. The vision sensor comprises imaging system for rail cross-section and a raster projector which can project more than one light plane perpendicular to the measured rail. The measurement module is used for calculating vertical wear, horizontal wear, the amplitude and wavelength of corrugation wear. The invention also discloses a vehicle dynamic measurement method for comprehensive parameters of rail wear. The invention can increase the sampling rate of image sensing and acquisition hardware equipment with no need of improving the performance of it, thereby satisfy high-speed on-line dynamic measurement requirements for corrugation wear, and the amplitude and wavelength of corrugation wear can be calculated more precisely.

摘要翻译： 本发明公开了一种用于轨道磨损综合参数的车辆动态测量装置，其包括视觉传感器，计算机和千米。 计算机中安装有高速图像采集卡和测量模块。 视觉传感器包括用于轨道横截面的成像系统和光栅投影仪，该投影仪可以投影多个垂直于测量轨道的光平面。 测量模块用于计算垂直磨损，水平磨损，波纹磨损的振幅和波长。 本发明还公开了一种用于铁路磨损综合参数的车辆动态测量方法。 本发明可以增加图像感测和采集硬件设备的采样率，不需要提高其性能，从而满足波纹磨损的高速在线动态测量要求，并且可以计算波纹磨损的幅度和波长 更确切地说。

公开(公告)号：US08078025B2

公开(公告)日：2011-12-13

申请号：US12258398

申请日：2008-10-25

申请人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Fuqiang Zhou ,  Qingbo Li ,  Zhen Liu ,  Qianzhe Liu

发明人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Fuqiang Zhou ,  Qingbo Li ,  Zhen Liu ,  Qianzhe Liu

IPC分类号： G06K9/00 ,  G01C11/12

CPC分类号： G01B11/2513 ,  B61K9/08 ,  G01B11/2522

摘要： The invention discloses a vehicle dynamic measurement device for comprehensive parameters of rail wear, which comprises a vision sensor, a computer and a milometer. A high-speed image acquisition card and a measurement module are installed in the computer. The vision sensor comprises imaging system for rail cross-section and a raster projector which can project more than one light plane perpendicular to the measured rail. The measurement module is used for calculating vertical wear, horizontal wear, the amplitude and wavelength of corrugation wear. The invention also discloses a vehicle dynamic measurement method for comprehensive parameters of rail wear. The invention can increase the sampling rate of image sensing and acquisition hardware equipment with no need of improving the performance of it, thereby satisfy high-speed on-line dynamic measurement requirements for corrugation wear, and the amplitude and wavelength of corrugation wear can be calculated more precisely.

摘要翻译： 本发明公开了一种用于轨道磨损综合参数的车辆动态测量装置，其包括视觉传感器，计算机和千米。 计算机中安装有高速图像采集卡和测量模块。 视觉传感器包括用于轨道横截面的成像系统和光栅投影仪，该投影仪可以投影多个垂直于测量轨道的光平面。 测量模块用于计算垂直磨损，水平磨损，波纹磨损的振幅和波长。 本发明还公开了一种用于铁路磨损综合参数的车辆动态测量方法。 本发明可以增加图像感测和采集硬件设备的采样率，不需要提高其性能，从而满足波纹磨损的高速在线动态测量要求，并且可以计算波纹磨损的幅度和波长 更确切地说。

公开(公告)号：US08019147B2

公开(公告)日：2011-09-13

申请号：US12025741

申请日：2008-02-04

申请人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Qianzhe Liu

发明人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Qianzhe Liu

IPC分类号： G06K9/00

CPC分类号： G06K9/209 ,  G06K2209/40 ,  G06T7/593 ,  G06T7/85 ,  G06T2207/10012

摘要： The present disclosure is directed to a three-dimensional data registration method for vision measurement in flow style based on a double-sided target. An embodiment of the disclosed method that comprises A. Setting up two digital cameras which can observe the entire measured object; B. Calibrating intrinsic parameters and a transformation between the two digital camera coordinate frames; C. A double-sided target being placed near the measured area of the measured object, the two digital cameras and a vision sensor taking images of at least three non-collinear feature points of the double-sided target; D. Removing the target, measuring the measured area by using the vision sensor; E. Respectively computing the three dimensional coordinates of the feature points in the global coordinate frame and in the vision sensor coordinate frame; F. Estimating the transformation from the vision sensor coordinate frame to the global coordinate frame through the three dimensional coordinates of the three or more non-collinear feature points obtained at step E, then transforming the three dimensional data of the measured area to the global coordinate frame; and G. Repeating step C, D, E, F, then completing three dimensional data registration for all measured areas. The present disclosure improves three dimensional data registration precision and efficiency.

摘要翻译： 本公开涉及一种用于基于双面目标的流动式视觉测量的三维数据登记方法。 所公开的方法的实施例包括A.设置可以观察整个测量对象的两个数码相机; B.校准固有参数和两个数码相机坐标系之间的变换; C.一个双面目标放置在测量对象的测量区域附近，两个数字照相机和视觉传感器拍摄双面目标的至少三个非共线特征点的图像。 D.去除目标，使用视觉传感器测量测量面积; E.分别计算全局坐标系和视觉传感器坐标系中特征点的三维坐标; F.通过在步骤E获得的三个或多个非共线特征点的三维坐标来估计从视觉传感器坐标系到全局坐标系的变换，然后将测量区域的三维数据变换为全局坐标 帧; 和G.重复步骤C，D，E，F，然后完成所有测量区域的三维数据登记。 本公开改进了三维数据配准精度和效率。

公开(公告)号：US20080298673A1

公开(公告)日：2008-12-04

申请号：US12025741

申请日：2008-02-04

申请人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Qianzhe Liu

发明人： Guangjun Zhang ,  Junhua Sun ,  Zhenzhong Wei ,  Qianzhe Liu

IPC分类号： G06K9/00

CPC分类号： G06K9/209 ,  G06K2209/40 ,  G06T7/593 ,  G06T7/85 ,  G06T2207/10012

摘要： The present disclosure is directed to a three-dimensional data registration method for vision measurement in flow style based on a double-sided target. An embodiment of the disclosed method that comprises A. Setting up two digital cameras which can observe the entire measured object; B. Calibrating intrinsic parameters and a transformation between the two digital camera coordinate frames; C. A double-sided target being placed near the measured area of the measured object, the two digital cameras and a vision sensor taking images of at least three non-collinear feature points of the double-sided target; D. Removing the target, measuring the measured area by using the vision sensor; E. Respectively computing the three dimensional coordinates of the feature points in the global coordinate frame and in the vision sensor coordinate frame; F. Estimating the transformation from the vision sensor coordinate frame to the global coordinate frame through the three dimensional coordinates of the three or more non-collinear feature points obtained at step E, then transforming the three dimensional data of the measured area to the global coordinate frame; and G. Repeating step C, D, E, F, then completing three dimensional data registration for all measured areas. The present disclosure improves three dimensional data registration precision and efficiency.

摘要翻译： 本公开涉及一种用于基于双面目标的流动式视觉测量的三维数据登记方法。 所公开的方法的实施例包括A.设置可以观察整个测量对象的两个数码相机; B.校准固有参数和两个数码相机坐标系之间的变换; C.一个双面目标放置在测量对象的测量区域附近，两个数字照相机和视觉传感器拍摄双面目标的至少三个非共线特征点的图像。 D.去除目标，使用视觉传感器测量测量面积; E.分别计算全局坐标系和视觉传感器坐标系中特征点的三维坐标; F.通过在步骤E获得的三个或多个非共线特征点的三维坐标来估计从视觉传感器坐标系到全局坐标系的变换，然后将测量区域的三维数据变换为全局坐标 帧; 和G.重复步骤C，D，E，F，然后完成所有测量区域的三维数据登记。 本公开改进了三维数据配准精度和效率。

公开(公告)号：US08964027B2

公开(公告)日：2015-02-24

申请号：US13393555

申请日：2011-08-09

申请人： Guangjun Zhang ,  Zhen Liu ,  Zhenzhong Wei ,  Junhua Sun ,  Meng Xie

发明人： Guangjun Zhang ,  Zhen Liu ,  Zhenzhong Wei ,  Junhua Sun ,  Meng Xie

IPC分类号： H04N7/18 ,  G01C25/00 ,  G06T7/00

CPC分类号： G01C25/00 ,  G06T7/85 ,  G06T2207/10012 ,  G06T2207/30208

摘要： The present disclosure provides a global calibration method based on a rigid bar for a multi-sensor vision measurement system, comprising: step 1, executing the following procedure for at least nine times: placing, in front of two vision sensors to be calibrated, a rigid bar fasten with two targets respectively corresponding to the vision sensors; capturing images of the respective targets by their corresponding vision sensors; extracting coordinates of feature points of the respective targets in their corresponding images; and computing 3D coordinates of each feature points of the respective targets under their corresponding vision sensor coordinate frames; and Step 2, computing the transformation matrix between the two vision sensors, with the constraint of the fixed position relationship between the two targets. The present disclosure also provides a global calibration apparatus based on a rigid bar for a multi-sensor vision measurement system. Putting the present disclosure to use can increase the accuracy of the global calibration, and also be suitable for the calibration of the multi-sensor vision system in the extremely large working space, which enlarges the application range of the present disclosure.

摘要翻译： 本公开提供了一种基于用于多传感器视觉测量系统的刚性杆的全局校准方法，包括：步骤1，执行以下程序至少九次：将待校准的两个视觉传感器前面放置一个 刚性杆用两个目标分别对应于视觉传感器; 通过其相应的视觉传感器捕获各个目标的图像; 提取其对应图像中各个目标的特征点的坐标; 并计算其对应的视觉传感器坐标系下各个目标的每个特征点的3D坐标; 和步骤2，计算两个视觉传感器之间的变换矩阵，与两个目标之间的固定位置关系的约束。 本公开还提供了一种基于用于多传感器视觉测量系统的刚性杆的全局校准装置。 使用本公开可以提高全局校准的精度，并且还适合于在极大的工作空间中校准多传感器视觉系统，这扩大了本发明的应用范围。

公开(公告)号：US20120162414A1

公开(公告)日：2012-06-28

申请号：US13393555

申请日：2011-08-09

申请人： Guangjun Zhang ,  Zhen Liu ,  Zhenzhong Wei ,  Junhua Sun ,  Meng Xie

发明人： Guangjun Zhang ,  Zhen Liu ,  Zhenzhong Wei ,  Junhua Sun ,  Meng Xie

IPC分类号： H04N7/18

CPC分类号： G01C25/00 ,  G06T7/85 ,  G06T2207/10012 ,  G06T2207/30208

摘要： The present disclosure provides a global calibration method based on a rigid bar for a multi-sensor vision measurement system, comprising: step 1, executing the following procedure for at least nine times: placing, in front of two vision sensors to be calibrated, a rigid bar fasten with two targets respectively corresponding to the vision sensors; capturing images of the respective targets by their corresponding vision sensors; extracting coordinates of feature points of the respective targets in their corresponding images; and computing 3D coordinates of each feature points of the respective targets under their corresponding vision sensor coordinate frames; and Step 2, computing the transformation matrix between the two vision sensors, with the constraint of the fixed position relationship between the two targets. The present disclosure also provides a global calibration apparatus based on a rigid bar for a multi-sensor vision measurement system. Putting the present disclosure to use can increase the accuracy of the global calibration, and also be suitable for the calibration of the multi-sensor vision system in the extremely large working space, which enlarges the application range of the present disclosure.

摘要翻译： 本公开提供了一种基于用于多传感器视觉测量系统的刚性杆的全局校准方法，包括：步骤1，执行以下程序至少九次：将待校准的两个视觉传感器前面放置一个 刚性杆用两个目标分别对应于视觉传感器; 通过其相应的视觉传感器捕获各个目标的图像; 提取其对应图像中各个目标的特征点的坐标; 并计算其对应的视觉传感器坐标系下各个目标的每个特征点的3D坐标; 和步骤2，计算两个视觉传感器之间的变换矩阵，与两个目标之间的固定位置关系的约束。 本公开还提供了一种基于用于多传感器视觉测量系统的刚性杆的全局校准装置。 使用本公开可以提高全局校准的精度，并且还适合于在极大的工作空间中校准多传感器视觉系统，这扩大了本发明的应用范围。

公开(公告)号：US07773797B2

公开(公告)日：2010-08-10

申请号：US11276117

申请日：2006-02-15

申请人： Guangjun Zhang ,  Dazhi Chen ,  Ying Wang ,  Fuqiang Zhou ,  Zhenzhong Wei

发明人： Guangjun Zhang ,  Dazhi Chen ,  Ying Wang ,  Fuqiang Zhou ,  Zhenzhong Wei

IPC分类号： G06K9/00 ,  H04N15/00

CPC分类号： G01B11/2513 ,  B64C33/02 ,  G01B11/167 ,  G01B11/2545

摘要： The present invention relates to a high-performance computer vision system and method for measuring the wings deformation of insects with high flapping-frequency, large stroke-amplitude and excellent mobility during free-flight. A geometrical optic unit composed of a polyhedral reflector with four reflection-planes and four planar reflectors is used to image one high-speed CMOS camera to four virtual cameras, combined with double laser-sheet sources, multiple virtual stereo and structured-light sensors are available to observe the free-flight of insect at different viewpoints simultaneously. In addition, an optoelectronic guiding equipment is included to lead the free-flight of insect and trigger the camera to capture the image sequences of insect-flight automatically. The deformation of insect-wings can be reconstructed by the spatial coordinates of wing-edges and the distorted light-lines projected on the surface of wings.

摘要翻译： 本发明涉及一种高性能计算机视觉系统和方法，用于测量自由飞行期间具有高扑动频率，大冲程振幅和极好移动性的昆虫的翅膀变形。 使用由具有四个反射面的多面体反射器和四个平面反射器组成的几何光学单元将一个高速CMOS相机成像到四个虚拟相机，结合双激光片源，多个虚拟立体声和结构光传感器 可以同时观察不同观点的昆虫自由飞行。 另外还包括一个光电引导设备，以引导昆虫的自由飞行，并触发相机自动捕获昆虫飞行的图像序列。 昆虫翅膀的变形可以通过翼缘的空间坐标和投射在翅膀表面上的变形的光线来重建。

公开(公告)号：US20090059011A1

公开(公告)日：2009-03-05

申请号：US12022681

申请日：2008-01-30

申请人： Junhua Sun ,  Guangjun Zhang ,  Zhenzhong Wei

发明人： Junhua Sun ,  Guangjun Zhang ,  Zhenzhong Wei

IPC分类号： H04N17/00

CPC分类号： G01B11/2504

摘要： This disclosure provides a calibration method for structure parameters of a structured-light vision sensor, which includes setting up the coordinate frames of a camera, image plane and target for calibration. The calculation of coordinates in the camera coordinate frame of stripes, projected by structured-light, on the planar target and a structured-light equation fitting according to the coordinates in the camera coordinate frame of the stripes on the planar target, by moving the planar target arbitrarily multiple times. The calibration method of the structured-light vision sensor provided by the disclosure is easy to operate and no auxiliary apparatus is needed, which can not only promote the efficiency of the calibration of structured-light, but also extend the application scope of calibration of structured-light.

摘要翻译： 本公开提供了一种用于结构光视觉传感器的结构参数的校准方法，其包括设置相机，图像平面和用于校准的目标的坐标系。 通过平面目标上的结构光投影的条纹的相机坐标系中的坐标的计算和通过平面目标上的条纹的相机坐标系中的坐标拟合的结构光方程， 目标任意多次。 本发明提供的结构光视觉传感器的校准方法易于操作，不需要辅助设备，这不仅可以提高结构光的校准效率，而且可以扩展结构光校准的应用范围 -光。

公开(公告)号：US08180101B2

公开(公告)日：2012-05-15

申请号：US12022681

申请日：2008-01-30

申请人： Junhua Sun ,  Guangjun Zhang ,  Zhenzhong Wei

发明人： Junhua Sun ,  Guangjun Zhang ,  Zhenzhong Wei

IPC分类号： G06K9/00 ,  H04N17/00

CPC分类号： G01B11/2504

摘要： This disclosure provides a calibration method for structure parameters of a structured-light vision sensor, which includes setting up the coordinate frames of a camera, image plane and target for calibration. The calculation of coordinates in the camera coordinate frame of stripes, projected by structured-light, on the planar target and a structured-light equation fitting according to the coordinates in the camera coordinate frame of the stripes on the planar target, by moving the planar target arbitrarily multiple times. The calibration method of the structured-light vision sensor provided by the disclosure is easy to operate and no auxiliary apparatus is needed, which can not only promote the efficiency of the calibration of structured-light, but also extend the application scope of calibration of structured-light.

摘要翻译： 本公开提供了一种用于结构光视觉传感器的结构参数的校准方法，其包括设置相机，图像平面和用于校准的目标的坐标系。 通过平面目标上的结构光投影的条纹的相机坐标系中的坐标的计算和通过平面目标上的条纹的相机坐标系中的坐标拟合的结构光方程， 目标任意多次。 本发明提供的结构光视觉传感器的校准方法易于操作，不需要辅助设备，这不仅可以提高结构光的校准效率，而且可以扩展结构光校准的应用范围 -光。

公开(公告)号：US07768527B2

公开(公告)日：2010-08-03

申请号：US11561696

申请日：2006-11-20

申请人： Guangjun Zhang ,  Suqi Li ,  Zhenzhong Wei ,  Zhen Liu

发明人： Guangjun Zhang ,  Suqi Li ,  Zhenzhong Wei ,  Zhen Liu

IPC分类号： G09G5/00 ,  G03B21/26

CPC分类号： G01B11/2504 ,  G06T7/85 ,  G06T19/006 ,  G06T2207/10012

摘要： The disclosure relates to a hardware-in-the-loop simulation system and method for computer vision. An embodiment of the disclosed system comprises a software simulation and a hardware simulation. The software simulation includes a virtual scene and an observed object that are generated by virtual reality software. The virtual scene images are obtained at different viewpoints. The hardware simulation includes the virtual scene images being projected onto a screen by a projector, wherein the projected scene images are shot by a camera, and where in the direction of the camera is controlled by a pan-tilt.

摘要翻译： 本公开涉及一种用于计算机视觉的硬件在环仿真系统和方法。 所公开的系统的实施例包括软件仿真和硬件仿真。 软件模拟包括由虚拟现实软件生成的虚拟场景和观察对象。 以不同的观点获得虚拟场景图像。 硬件模拟包括通过投影仪投影到屏幕上的虚拟场景图像，其中投影的场景图像被照相机拍摄，并且通过摇摄来控制相机的方向。