METHOD FOR GENERATION OF A 3D MODEL BASED ON STRUCTURE FROM MOTION AND PHOTOMETRIC STEREO OF 2D SPARSE IMAGES

    公开(公告)号:EP3382645A2

    公开(公告)日:2018-10-03

    申请号:EP18163990.7

    申请日:2018-03-26

    申请人: 3Dflow srl

    IPC分类号: G06T7/586

    摘要: Method for generating a 3D model of an object of interest (1, 404), which method comprises the following steps:
    Structure from Motion processing of a plurality of sparse images acquired by one or more acquisition devices (2, 402) for generating a sparse 3D point cloud and a plurality of internal and external parameters of the acquisition devices (2, 402) obtained by processing said images,
    obtaining, from the sparse 3D point cloud and from the internal and external parameters of the acquisition devices, by multiview stereo processing, a dense 3D point cloud for said generation of the 3D model.
    The method provides the reconstruction of the surface of said object of interest (1, 404) by the following steps:
    a) illuminating the object of interest (1, 404) from different directions (501);
    b) acquiring the plurality of images from a single point of view (502), each image corresponding to a different lighting direction;
    c) automatically recognizing the lighting direction for each acquired image;
    d) calculating the vector field of the surface normals;
    e) calculating the albedo of the observed surface;
    f) reconstructing the orientation of the surface.

    3D RECONSTRUCTION FROM PHOTOMETRIC STEREO WITH SHADOWS
    3.
    发明授权
    3D RECONSTRUCTION FROM PHOTOMETRIC STEREO WITH SHADOWS 有权
    带阴影的光度立体三维重建

    公开(公告)号:EP3047456B1

    公开(公告)日:2018-03-21

    申请号:EP14792892.3

    申请日:2014-09-10

    IPC分类号: G06T7/586

    摘要: A method of processing a set of images of a scene is disclosed. The set is represented by a plurality of picture-elements defining an image plane, and the images are characterized by different light intensity spatial distributions but the same viewpoint relative to the scene. The method comprises: for each of at least some picture-elements, independently selecting a direction parallel to the image plane, constructing a weighted vector field based on the selected direction, and calculating a height of a surface in the scene perpendicular to the image plane based on the constructed weighted vector field. The method further comprises reconstructing a three-dimensional spatial representation of the surface based on the heights; and transmitting the spatial representation to a computer readable medium.

    Method, system and computer program product for producing a raised relief map from images of an object
    6.
    发明公开
    Method, system and computer program product for producing a raised relief map from images of an object 审中-公开
    Verfahren,System and Computerprogrammprodukt zur Erzeugung einererhöhtenReliefkarte aus Bildern eines Objekts

    公开(公告)号:EP2806399A1

    公开(公告)日:2014-11-26

    申请号:EP13305672.1

    申请日:2013-05-23

    IPC分类号: G06T7/00

    CPC分类号: G06T7/586

    摘要: A method for obtaining a model of an object surface from a plurality of images of said object, wherein the object is illuminated with one or more illumination sources, the method comprising:
    - obtaining a set of images each comprising an array of pixels and representing similar views of an object, wherein the similar views are obtained under different illumination conditions;
    - defining a model function that expresses the known pixel intensity values of the images in terms of the following unknown model components:
    - a first model component (A) representing the albedo of the object;
    - a second model component (L) representing an intensity of illumination;
    - a third model component (V) representing an illumination direction and being different for each image;
    - a fourth model component (N) representing surface normal directions of the object surface at each pixel position and being the same for all images;
    - performing one or more sequences of minimization operations to minimize a difference function between the pixel values obtained from the set of images and pixel values calculated using said model function, each minimization operation being performed by allowing one of said model components (A, L, V, N) to vary while the others remain unchanged;
    - outputting the fourth model component (N) as said model of the object surface.

    摘要翻译: 一种用于从所述对象的多个图像获得对象表面的模型的方法,其中所述对象被一个或多个照明源照亮,所述方法包括: - 获得一组图像,每个图像包括像素阵列并且表示相似 在不同的照明条件下获得相似的视图; - 根据以下未知模型组件定义表示图像的已知像素强度值的模型函数: - 表示对象的反照率的第一模型组件(A) - 表示照明强度的第二模型组件(L); - 表示每个图像的照明方向并且不同的第三模型分量(V) - 表示在每个像素位置处的对象表面的表面法线方向的第四模型分量(N),并且对于所有图像是相同的; - 执行一个或多个最小化操作序列以最小化从所述图像集合获得的像素值和使用所述模型函数计算的像素值之间的差分函数,通过允许所述模型分量(A,L, V,N)变化,而其他保持不变; - 输出第四模型分量(N)作为对象表面的所述模型。

    SHAPE AND PHOTOMETRIC INVARIANTS RECOVERY FROM POLARISATION IMAGES
    8.
    发明公开
    SHAPE AND PHOTOMETRIC INVARIANTS RECOVERY FROM POLARISATION IMAGES 审中-公开
    美国无线电公司无线电公司澳大利亚投资有限公司(WIUSERHERSTELLUNG VON FORMEN UND FOTOMETRISCHEN INVARIANZEN AUS POLARISATIONSBILDERN

    公开(公告)号:EP2561482A1

    公开(公告)日:2013-02-27

    申请号:EP11771405.5

    申请日:2011-04-20

    IPC分类号: G06T7/00 G06T17/30

    摘要: The disclosure concerns processing of electronic images, such as hyperspectral, or multispectral images. In particular, but is not limited to, a method, software and computer for estimating shape information or a photometric invariant of a location of image of a scene. The image data (300) indexed by wavelength λ and polarisation filter angle ϑ. For each wavelength λ index, a polarisation angle φ is estimated from the image data (300) by the processor (810). The processor (810) then also estimates the shape information (such as azimuth a, zenith Θ, or surface normal) or photometric invariants (such as refractive index) based on the estimated polarisation angle φ for each wavelength index λ. Greater accuracies can be achieved in the estimated shape information and/or photometric invariants by using wavelength-indexed data. Further, surface information or photometric invariant can be estimated based upon polarisation in a single-view hyperspectral or multi-spectral imagery. Further, by relying on the polarisation angle for the estimation, the method is insensitive to changes in illumination power and direction.

    摘要翻译: 本公开涉及电子图像的处理,例如高光谱或多光谱图像。 特别地,但不限于,用于估计场景图像位置的形状信息或光度不变性的方法,软件和计算机。 由波长λ和偏振滤波器角度等指标的图像数据(300)。 对于每个波长λ指数,偏振角&phgr 由处理器(810)从图像数据(300)估计出来。 然后,处理器(810)还基于估计的偏振角&phgr来估计形状信息(诸如方位角α,诸如天顶角或表面法线)或光度不变量(例如折射率) 对于每个波长指数λ。 通过使用波长索引数据,可以在估计的形状信息和/或光度不变量中实现更高的准确度。 此外,可以基于单视图超光谱或多光谱图像中的极化来估计表面信息或光度不变量。 此外,通过依靠偏振角进行估计,该方法对照明功率和方向的变化不敏感。

    METHOD FOR MEASURING/RECOGNIZING A SHAPE
    9.
    发明授权
    METHOD FOR MEASURING/RECOGNIZING A SHAPE 有权
    VERFAHREN ZUR MESSUNG / ERKENNUNG EINER FORM

    公开(公告)号:EP2032938B1

    公开(公告)日:2012-01-11

    申请号:EP07730554.8

    申请日:2007-04-05

    申请人: SAY Group Oy

    发明人: Seppälä, Kari

    IPC分类号: G06T7/00 G01B11/30 G01N15/02

    摘要: The invention relates to a method for measuring/recognizing a shape, using at least two electromagnetic oscillations (1, 2) aimed at the measurement subject from two different directions, and means (3) for taking an image of the illuminated subject (4) in a digital form. The image matrix of the image in a digital form is read pixel by pixel and the illuminated strength values of the same pixel from different directions are compared with each other, and the height of the pixel is created from the information obtained as a result of the comparison. The value of the read pixel is always added to the value of the following pixel.

    摘要翻译: 用于测量/识别形状的方法使用从两个不同方向瞄准测量对象的至少两个电磁振荡。 提供了一种用于以数字形式拍摄照明对象的图像的装置。 以数字形式的图像的图像矩阵逐像素地读取,并且将来自不同方向的相同像素的照射强度值彼此进行比较。 每个像素的两个波长的强度值的差值被加到读取方向上前一像素的相应差值。