A THREE-DIMENSIONAL MEASUREMENT METHOD BASED ON END-TO-END DEEP LEARNING FOR SPECKLE PROJECTION

    公开(公告)号:US20240020866A1

    公开(公告)日:2024-01-18

    申请号:US18025815

    申请日:2021-08-18

    Abstract: The invention discloses a three-dimensional (3D) measurement method based on end-to-end deep learning for speckle projection. First, the speckle pattern was projected by the projector and collected simultaneously by the stereo camera. The speckle images after stereo rectification are fed into the stereo matching network. A feature extraction sub-network based on shared weights processes the speckle images to obtain a series of low-resolution 3D feature tensors, The feature tensor is fed into the saliency object detection sub-network to detect foreground information in the speckle images, producing a full-resolution valid mask map. A 4D matching cost volume is generated using the feature tensor of both views based on the candidate disparity range, filtered by a series of 3D convolutional layers to achieve cost aggregation, so that the initial disparity map is obtained by disparity regression. The final disparity map is obtained by combining the mask map and the initial disparity map to achieve a single-frame, robust, and absolute 3D shape measurement. The invention achieves a single-frame, robust, and absolute 3D shape measurement by projecting a single speckle pattern.

    Programmable annular led illumination-based high efficiency quantitative phase microscopy imaging method

    公开(公告)号:US11555992B2

    公开(公告)日:2023-01-17

    申请号:US16633037

    申请日:2018-02-26

    Abstract: The invention discloses a programmable annular LED illumination-based high efficiency quantitative phase microscopy imaging method, the proposed method comprising the following steps: the derivation of system optical transfer function in a partially coherent illumination imaging system; the derivation of phase transfer function with the weak object approximation under the illumination of tilted axially symmetric coherent point illumination source; the extension of illumination from an axially symmetric coherence point source to a discrete annular point source, and the optical transfer function can be treated as an incoherent superposition of each pair of tilted axially symmetric coherent point sources. The acquisition of raw intensity dataset; the implementation of deconvolution for quantitative phase reconstruction. The invention derives the system phase transfer function under the tilted axially symmetric point light source in the case of partially coherent illumination, and promotes the optical phase transfer function of the discrete annular point light source. The programmability characteristic of LED array enables the annular illumination aperture to be flexibly adjustable, being applicable to different microscopic objects with different numerical apertures, and improving the compatibility and flexibility of the system.

    Super-rapid three-dimensional topography measurement method and system based on improved fourier transform contour technique

    公开(公告)号:US11029144B2

    公开(公告)日:2021-06-08

    申请号:US16496815

    申请日:2018-02-26

    Abstract: A super-rapid three-dimensional measurement method and system based on an improved Fourier transform contour technique is disclosed. The method comprises: firstly calibrating a measurement system to obtain calibration parameters, then cyclically projecting 2n patterns into a measured scene using a projector, wherein n patterns are binary sinusoidal fringes with different high frequency, and the other n patterns are all-white images with the values of 1, and projecting the all-white images between every two binary high-frequency sinusoidal fringes, and synchronously acquiring images using a camera; and then performing phase unwrapping on wrapped phases to obtain initial absolute phases, and correcting the initial absolute phases, and finally reconstructing a three-dimensional topography of the measured scene by exploiting the corrected absolute phases and the calibration parameters to obtain 3D spatial coordinates of the measured scene in a world coordinate system, thereby accomplishing three-dimensional topography measurement of an object. In this way, the precision of three-dimensional topography measurement is ensured, and the speed of three-dimensional topography measurement is improved.

    Quantitative phase imaging method based on differential phase contrast with optimal lighting pattern design

    公开(公告)号:US11487096B2

    公开(公告)日:2022-11-01

    申请号:US17294322

    申请日:2019-07-05

    Abstract: The patent discloses a differential phase contrast (DPC) quantitative phase microscopy method based on the optimal illumination pattern design. Firstly, the optimal illumination pattern corresponding to the isotropic phase transfer function of DPC quantitative phase imaging is derived, which is determined as a semi-annular illumination pattern with the illumination numerical aperture NAill equal to the numerical aperture NAobj of the objective lens. The illumination intensity distribution varies with the cosine of the illumination angle, and it can be expressed as S(θ)=cos(θ). This patent effectively compensates for the frequency loss of phase transfer, not only the high-frequency responses of PTF are enhanced, but also the transfer responses of low-frequency phase information is significantly improved. As a result, the optimal illumination scheme ensures the correctness and achieves high resolution phase reconstruction, while the number of illuminations is reduced to a minimum of two, which greatly increases the imaging speed, allowing for real-time dynamic, high-correctness, high-resolution phase imaging results.

Patent Agency Ranking