-
公开(公告)号：US11906286B2
公开(公告)日：2024-02-20
申请号：US17280464
申请日：2019-07-05
Applicant: Nanjing University of Science and Technology
Inventor： Qian Chen , Chao Zuo , Shijie Feng , Yuzhen Zhang , Guohua Gu
Abstract: The invention discloses a deep learning-based temporal phase unwrapping method for fringe projection profilometry. First, four sets of three-step phase-shifting fringe patterns with different frequencies (including 1, 8, 32, and 64) are projected to the tested objects. The three-step phase-shifting fringe images acquired by the camera are processed to obtain the wrapped phase map using a three-step phase-shifting algorithm. Then, a multi-frequency temporal phase unwrapping (MF-TPU) algorithm is used to unwrap the wrapped phase map to obtain a fringe order map of the high-frequency phase with 64 periods. A residual convolutional neural network is built, and its input data are set to be the wrapped phase maps with frequencies of 1 and 64, and the output data are set to be the fringe order map of the high-frequency phase with 64 periods. Finally, the training dataset and the validation dataset are built to train and validate the network. The network makes predictions on the test dataset to output the fringe order map of the high-frequency phase with 64 periods. The invention exploits a deep learning method to unwrap a wrapped phase map with a frequency of 64 using a wrapped phase map with a frequency of 1 and obtain an absolute phase map with fewer phase errors and higher accuracy.
-
公开(公告)号：US20230359010A1
公开(公告)日：2023-11-09
申请号：US18026276
申请日：2021-08-18
Applicant: Nanjing University of Science and Technology
Inventor： Qian Chen , Chao Zuo , Jiasong Sun , Shijie Feng , Yuzhen Zhang , Guohua Gu
CPC classification number: G02B21/14 , G02B21/0008 , G02B21/0032 , G02B21/008
Abstract: The invention discloses a miniaturized, low-cost, multi-contrast label-free microscopic imaging system. The imaging system is based on an inverted microscopic structure, a highly integrated optical system is designed by adopting a micro lens having a fixed focal length, and a complex optical system of a traditional microscope system is replaced, such that the whole microscope is highly integrated. The system uses a programmable LED array as an illumination light source the LED array is controlled by a computer to display different illumination modes, six imaging functions of a bright field, a dark field a rainbow dark field, Rheinberg optical dyeing, differential phase contrast, and quantitative phase imaging are achieved; and diversified unmarked imaging methods are provided for biological applications. The invention provides a matching control system, which can realize system hardware control and algorithm execution and display, comprises functions such as illumination control, camera parameter adjustment quantitative phase reconstruction recovery, two-dimensional/three-dimensional result display, and quantitative profile analysis, and can realize diversified information obtaining and analysis of unmarked samples.
-
3.发明授权公开(公告)号：US11781966B2
公开(公告)日：2023-10-10
申请号：US17289605
申请日：2019-07-05
Applicant: Nanjing University of Science and Technology
Inventor： Chao Zuo , Qian Chen , Jiaji Li , Jiasong Sun , Yao Fan , Shijie Feng , Yuzhen Zhang
IPC: G01N15/14
CPC classification number: G01N15/1434 , G01N15/1468 , G01N2015/145 , G01N2015/1445
Abstract: The present invention discloses a three-dimensional diffraction tomography microscopy imaging method based on LED array coded illumination. Firstly, acquiring the raw intensity images, three sets of intensity image stacks are acquired at different out-of-focus positions by moving the stage or using electrically tunable lens. And then, after acquiring the intensity image stacks of the object to be measured at different out-of-focus positions, the three-dimensional phase transfer function of the microscopy imaging system with arbitrary shape illumination is derived. Further, the three-dimensional phase transfer function of the microscopic system under circular and annular illumination with different coherence coefficients is obtained as well, and the three-dimensional quantitative refractive index is reconstructed by inverse Fourier transform of the three-dimensional scattering potential function. The scattering potential function is converted into the refractive index distribution. Thus, the quantitative three-dimensional refractive index distribution of the test object is obtained. The invention realizes high-resolution and high signal-to-noise ratio 3D diffraction tomography microscopic imaging of cells, tiny biological tissues and other samples.
-
公开(公告)号：US11650406B2
公开(公告)日：2023-05-16
申请号：US17294019
申请日：2019-07-05
Applicant: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
Inventor： Chao Zuo , Qian Chen , Jiasong Sun , Yuzhen Zhang , Guohua Gu
CPC classification number: G02B21/367 , G02B27/126 , H04N5/2256
Abstract: A microscopic imaging method of phase contrast (PC) and differential interference contrast (DIC) based on the transport of intensity equation (TIE) includes capturing three intensity images along the optical axis; solving the TIE by deconvolution to obtain the quantitative phase; obtaining the intensity image under the DIC imaging mode according to the DIC imaging principle; and obtaining the corresponding phase image of PC imaging mode according to the PC imaging principle. The method can endow the bright-field microscope with the ability to realize PC and DIC imaging without complex modification of the traditional bright-field microscope. In addition, it has the same imaging performance as the phase contrast microscope and differential interference contrast microscope, which are expensive, complex-structure, and has strict environmental conditions.
-
5.发明申请公开(公告)号：US20210372916A1
公开(公告)日：2021-12-02
申请号：US17289605
申请日：2019-07-05
Applicant: Nanjing University of Science and Technology
Inventor： Chao Zuo , Qian Chen , Jiaji Li , Jiasong Sun , Yao Fan , Shijie Feng , Yuzhen Zhang
IPC: G01N15/14
Abstract: The present invention discloses a three-dimensional diffraction tomography microscopy imaging method based on LED array coded illumination. Firstly, acquiring the raw intensity images, three sets of intensity image stacks are acquired at different out-of-focus positions by moving the stage or using electrically tunable lens. And then, after acquiring the intensity image stacks of the object to be measured at different out-of-focus positions, the three-dimensional phase transfer function of the microscopy imaging system with arbitrary shape illumination is derived. Further, the three-dimensional phase transfer function of the microscopic system under circular and annular illumination with different coherence coefficients is obtained as well, and the three-dimensional quantitative refractive index is reconstructed by inverse Fourier transform of the three-dimensional scattering potential function. The scattering potential function is converted into the refractive index distribution. Thus, the quantitative three-dimensional refractive index distribution of the test object is obtained. The invention realizes high-resolution and high signal-to-noise ratio 3D diffraction tomography microscopic imaging of cells, tiny biological tissues and other samples.
-
Patent Agency Ranking
公开(公告)号：US11156821B2
公开(公告)日：2021-10-26
申请号：US16496676
申请日：2018-02-26
Applicant: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
Inventor： Qian Chen , Chao Zuo , Jiasong Sun , Shijie Feng , Yuzhen Zhang , Guohua Gu
Abstract: A high-illumination numerical aperture-based large field-of-view high-resolution microimaging device, and a method for iterative reconstruction, the device comprising an LED array (1), a stage (2), a condenser (3), a microscopic objective (5), a tube lens (6), and a camera (7), the LED array (1) being arranged on the forward focal plane of the condenser (3). Light emitted by the i-th lit LED unit (8) of the LED array (1) passes through the condenser (3) and converges to become parallel light illuminating a specimen (4) to be examined, which is placed on the stage (2); part of the diffracted light passing through the specimen (4) is collected by the microscopic objective (5), converged by the tube lens (6), and reaches the imaging plane of the camera (7), forming an intensity image recorded by the camera (1). The present device and method ensure controllable programming of the illumination direction, while also ensuring an illumination-numerical-aperture up to 1.20 and thus achieving a reconstruction resolution up to 0.15 μm.
-
公开(公告)号：US11893719B2
公开(公告)日：2024-02-06
申请号：US17766088
申请日：2020-08-18
Applicant: NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY
Inventor： Qian Chen , Yao Fan , Chao Zuo , Jiasong Sun , Xiangpeng Pan , Shijie Feng , Yuzhen Zhang , Guohua Gu , Jiaji Li , Jialin Zhang
CPC classification number: G06T5/50 , G02B21/367
Abstract: A single-shot differential phase contrast quantitative phase imaging method based on color multiplexing illumination. A color multiplexing illumination solution is used to realize single-shot differential phase contrast quantitative phase imaging. In the single-shot color multiplexing illumination solution, three illumination wavelengths of red, green, and blue are used to simultaneously illuminate a sample, and the information of the sample in multiple directions is converted into intensity information on different channels of a color image. By performing channel separation on this color image, the information about the sample at different spatial frequencies can be obtained. Such a color multiplexing illumination solution requires only one acquired image, thus enhancing the transfer response of the phase transfer function of single-shot differential phase contrast imaging in the entire frequency range, and achieving real-time dynamic quantitative phase imaging with a high contrast, a high resolution, and a high stability. In addition, an alternate illumination strategy is provided, so that a completely isotropic imaging resolution at the limit acquisition speed of the camera can be achieved.
-
公开(公告)号：US11808564B2
公开(公告)日：2023-11-07
申请号：US17631542
申请日：2020-08-07
Applicant: Nanjing University of Science and Technology
Inventor： Chao Zuo , Wei Yin , Qian Chen , Shijie Feng , Jiasong Sun , Tianyang Tao , Yan Hu , Liang Zhang , Jiaming Qian
IPC: G01B11/25
CPC classification number: G01B11/2504 , G01B11/2513 , G01B11/2527
Abstract: A calibration method for fringe projection systems based on plane mirrors. Firstly, two mirrors are placed behind the tested object. Through the reflection of mirrors, the camera can image the measured object from the front and other two perspectives, so as to obtain 360-degree two-dimensional information of the measured object. The projector projects three sets of phase-shifting fringe patterns with frequencies of 1, 8, and 64. The camera captures the fringe image to obtain an absolute phase map with a frequency of 64 by using the phase-shifting method and the temporal phase unwrapping algorithm. By using the calibration parameters between the projector and the camera, the absolute phase map can be converted into three-dimensional information of the measured object. Then, the mirror calibration is realized by capturing a set of 3D feature point pairs, so that the 3D information from different perspectives is transformed into a unified world coordinate system. The calibration method does not need to artificially fix the feature pattern on plane mirrors, only needs to capture a set of 3D feature point pairs by the camera to directly realize the mirror calibration that it avoids the loss of measurement accuracy and realizes high-precision panoramic three-dimensional measurement.
-
公开(公告)号：US20220221270A1
公开(公告)日：2022-07-14
申请号：US17631542
申请日：2020-08-07
Applicant: Nanjing University of Science and Technology
Inventor： Chao Zuo , Wei Yin , Qian Chen , Shijie Feng , Jiasong Sun , Tianyang Tao , Yan Hu , Liang Zhang , Jiaming Qian
IPC: G01B11/25
Abstract: A calibration method for fringe projection systems based on plane mirrors. Firstly, two mirrors are placed behind the tested object. Through the reflection of mirrors, the camera can image the measured object from the front and other two perspectives, so as to obtain 360-degree two-dimensional information of the measured object. The projector projects three sets of phase-shifting fringe patterns with frequencies of 1, 8, and 64. The camera captures the fringe image to obtain an absolute phase map with a frequency of 64 by using the phase-shifting method and the temporal phase unwrapping algorithm. By using the calibration parameters between the projector and the camera, the absolute phase map can be converted into three-dimensional information of the measured object. Then, the mirror calibration is realized by capturing a set of 3D feature point pairs, so that the 3D information from different perspectives is transformed into a unified world coordinate system. The calibration method does not need to artificially fix the feature pattern on plane mirrors, only needs to capture a set of 3D feature point pairs by the camera to directly realize the mirror calibration that it avoids the loss of measurement accuracy and realizes high-precision panoramic three-dimensional measurement.
-
公开(公告)号：US10911672B2
公开(公告)日：2021-02-02
申请号：US16496845
申请日：2018-02-26
Applicant: Nanjing University of Science and Technology
Inventor： Qian Chen , Chao Zuo , Shijie Feng , Jiasong Sun , Yuzhen Zhang , Guohua Gu
IPC: H04N13/246 , H04N5/232 , H04N13/239 , G01B11/25
Abstract: A highly efficient three-dimensional image acquisition method based on multi-mode composite encoding and epipolar constraint, respectively using a fast imaging mode or a high-precision imaging mode, wherein in the fast imaging mode, two phase maps having different frequencies are obtained by four stripe gratings, and a high-frequency absolute phase is obtained by means of the epipolar constraint and a left-right consistency check, and the three-dimensional image is obtained by means of a mapping relationship between the phase and three-dimensional coordinates; and in the high precision imaging mode, two phases having different frequencies are obtained by means of N+2 stripe gratings, a low-frequency absolute phase is obtained by the epipolar constraint, and the unwrapping of a high-frequency phase is assisted by means of the low-frequency absolute phase, so as to obtain the high-frequency absolute phase, and finally, the three-dimensional image is obtained by the mapping relationship between the phase and the three-dimensional coordinates. In this way, the imaging efficiency is ensured, and the imaging precision is improved.
-
-
-
-
-
-
-
-
-
Search Results
16
records
(took 0.023 seconds)
