Multi-view image registration with application to mosaicing and lens distortion correction
    4.
    发明授权
    Multi-view image registration with application to mosaicing and lens distortion correction 失效
    多视图图像配准应用于镶嵌和镜头失真校正

    公开(公告)号:US06173087B2

    公开(公告)日:2001-01-09

    申请号:US08966776

    申请日:1997-11-10

    IPC分类号: G06K936

    摘要: An embodiment of the invention is a system and process for true multi-image alignment that does not rely on the measurements of a reference image being distortion free. For instance, lens distortion is a common imaging phenomenon. When lens distortion is present, none of the images can be assumed to be ideal. In an embodiment of the invention, all the images are modeled as intensity measurements represented in their respective coordinate systems, each of which is related to a reference coordinate system through an interior camera transformation and an exterior view transformation. Motion parameters determined in accordance with an embodiment of the invention dictate the position of the input frames within the reference frame. A reference coordinate system is used, but not a reference image. Motion parameters are computed to warp all input images to a virtual image mosaic in the reference coordinate system of the reference frame. Each pixel in the virtual image mosaic may be predicted by intensities at corresponding pixel positions from more than one image. The error measure, which is the sum of the variances of predicted pixel intensities at each pixel location summed over the virtual image mosaic, is minimized. The embodiment of the invention advantageously maximally uses information present in all images.

    摘要翻译: 本发明的实施例是用于真正的多图像对准的系统和过程,其不依赖于无失真的参考图像的测量。 例如,镜头失真是常见的成像现象。 当存在透镜失真时,不能假定图像是理想的。 在本发明的一个实施例中,所有图像被建模为在它们各自的坐标系中表示的强度测量值,每个坐标系统通过内部照相机变换和外部视图变换与参考坐标系相关。 根据本发明的实施例确定的运动参数指示输入框在参考框架内的位置。 使用参考坐标系,而不是参考图像。 计算运动参数以将所有输入图像扭曲成参考框架的参考坐标系中的虚拟图像马赛克。 可以通过来自多于一个图像的相应像素位置处的强度来预测虚拟图像镶嵌中的每个像素。 误差测量值是在虚拟图像镶嵌中相加的每个像素位置处的预测像素强度的方差之和。 本发明的实施例有利地最大限度地利用存在于所有图像中的信息。

    Moving target detection in the presence of parallax
    7.
    发明授权
    Moving target detection in the presence of parallax 有权
    在存在视差的情况下移动目标检测

    公开(公告)号:US08340349B2

    公开(公告)日:2012-12-25

    申请号:US11763559

    申请日:2007-06-15

    IPC分类号: G06K9/00

    摘要: A method for detecting a moving target is disclosed that receives a plurality of images from at least one camera; receives a measurement of scale from one of a measurement device and a second camera; calculates the pose of the at least one camera over time based on the plurality of images and the measurement of scale; selects a reference image and an inspection image from the plurality of images of the at least one camera; and detects a moving target from the reference image and the inspection image based on the orientation of corresponding portions in the reference image and the inspection image relative to a location of an epipolar direction common to the reference image and the inspection image; and displays any detected moving target on a display. The measurement of scale can derived from a second camera or, for example, a wheel odometer. The method can also detect moving targets by combining the above epipolar method with a method based on changes in depth between the inspection image and the reference image and based on changes in flow between the inspection image and the reference image.

    摘要翻译: 公开了一种用于检测移动目标的方法,其从至少一个相机接收多个图像; 从测量装置和第二相机中的一个接收刻度的测量; 基于多个图像和尺度的测量来计算随时间的至少一个相机的姿态; 从所述至少一个照相机的多个图像中选择参考图像和检查图像; 并且基于所述参考图像和所述检查图像中的对应部分相对于所述参考图像和所述检查图像共同的核极方向的位置的取向,从所述参考图像和所述检查图像中检测移动目标; 并在显示器上显示任何检测到的移动目标。 刻度的测量可以从第二相机或例如车轮里程表得到。 该方法还可以通过将上述对极方法与基于检查图像和参考图像之间的深度变化的方法并基于检查图像与参考图像之间的流动变化组合来检测移动目标。

    System and Method for Providing Mobile Range Sensing
    8.
    发明申请
    System and Method for Providing Mobile Range Sensing 有权
    提供移动范围感知的系统和方法

    公开(公告)号:US20080247602A1

    公开(公告)日:2008-10-09

    申请号:US11860650

    申请日:2007-09-25

    IPC分类号: G06K9/00

    摘要: The present invention provides an improved system and method for estimating range of the objects in the images from various distances. The method comprises receiving a set of images of the scene having multiple objects from at least one camera in motion. Due to the motion of the camera, each of the images are obtained at different camera locations Then an object visible in multiple images is selected. Data related to approximate camera positions and orientations and the images of the visible object are used to estimate the location of the object relative to a reference coordinate system. Based on the computed data, a projected location of the visible object is computed and the orientation angle of the camera for each image is refined. Additionally, pairs of cameras with various locations can then be chosen to obtain dense stereo for regions of the image at various ranges. The process is further structured so that as new images arrive, they are incorporated into the pose adjustment so that the dense stereo results can. be updated.

    摘要翻译: 本发明提供了一种用于估计来自各种距离的图像中的对象的范围的改进的系统和方法。 该方法包括从运动中的至少一个摄像机接收具有多个对象的场景的一组图像。 由于相机的运动,在不同的相机位置获得每个图像然后选择在多个图像中可见的对象。 与近似相机位置和方向有关的数据以及可见对象的图像用于估计对象相对于参考坐标系的位置。 基于计算的数据,计算可见对象的投影位置,并且改善每个图像的相机的取向角度。 此外,可以选择具有各种位置的成对的相机以获得在各种范围内的图像区域的致密立体声。 该过程被进一步构造,使得当新图像到达时,它们被并入姿态调整中,使得密集立体结果可以。 被更新。

    Method and apparatus for qualitative spatiotemporal data processing
    9.
    发明授权
    Method and apparatus for qualitative spatiotemporal data processing 失效
    定性时空数据处理的方法和装置

    公开(公告)号:US06535620B2

    公开(公告)日:2003-03-18

    申请号:US09803774

    申请日:2001-03-12

    IPC分类号: G06K900

    CPC分类号: G06K9/00335 G06T7/262

    摘要: The present invention is embodied in a method for representing and analyzing spatiotemporal data in order to make qualitative yet semantically meaningful distinctions among various regions of the data at an early processing stage. In one embodiment of the invention, successive frames of image data are analyzed to classify spatiotemporal regions as being stationary, exhibiting coherent motion, exhibiting incoherent motion, exhibiting scintillation and so lacking in structure as to not support further inference. The exemplary method includes filtering the image data in a spatiotemporal plane to identify regions that exhibit various spatiotemporal characteristics. The output data provided by these filters is then used to classify the data.

    摘要翻译: 本发明体现在一种用于表示和分析时空数据的方法,以便在早期处理阶段在数据的各个区域之间进行定性但语义上的有意义的区别。 在本发明的一个实施例中,分析连续的图像数据帧以将时空区域分类为静止的,表现出相干运动,表现出非相干运动,呈现闪烁,因此缺乏结构,从而不支持进一步的推断。 示例性方法包括在时空平面中对图像数据进行过滤,以识别表现出各种时空特征的区域。 然后使用这些过滤器提供的输出数据对数据进行分类。

    System and method for providing mobile range sensing
    10.
    发明授权
    System and method for providing mobile range sensing 有权
    提供移动距离感测的系统和方法

    公开(公告)号:US08428344B2

    公开(公告)日:2013-04-23

    申请号:US13242533

    申请日:2011-09-23

    IPC分类号: G06K9/00

    摘要: The present invention provides an improved method for estimating range of objects in images from various distances comprising receiving a set of images of the scene having multiple objects from at least one camera in motion. Due to the motion of the camera, each of the images are obtained at different camera locations. Then an object visible in multiple images is selected. Data related to approximate camera positions and orientations and the images of the visible object are used to estimate the location of the object relative to a reference coordinate system. Based on the computed data, a projected location of the visible object is computed and the orientation angle of the camera for each image is refined. Additionally, pairs of cameras with various locations can obtain dense stereo for regions of the image at various ranges.

    摘要翻译: 本发明提供一种用于估计来自各种距离的图像中的对象的范围的改进方法,包括从运动中的至少一个照相机接收具有多个对象的场景的一组图像。 由于相机的运动,每个图像都是在不同的相机位置获得的。 然后选择多个图像中可见的对象。 与近似相机位置和方向有关的数据以及可见对象的图像用于估计对象相对于参考坐标系的位置。 基于计算的数据,计算可见对象的投影位置,并且改善每个图像的相机的取向角度。 此外,具有各种位置的成对的相机可以在各种范围内为图像的区域获得致密的立体声。