公开(公告)号：US12210167B2

公开(公告)日：2025-01-28

申请号：US18636195

申请日：2024-04-15

Applicant: Purdue Research Foundation

Inventor： Fan Xu ,  Fang Huang ,  Donghan Ma

IPC: G06K9/00 ,  G01N21/64 ,  G02B21/36 ,  G02B26/08 ,  G02B27/00 ,  G02B27/58

Abstract: A method of in situ point spread function (PSF) retrieval is disclosed which includes encoding 3D location of molecules into PSFs, receiving molecule-generated images containing PSFs, segmenting the images into sub-PSF, initializing template PSFs from a pupil function, determining a statistical measure of a predetermined function between the sub- and template PSFs, associating each of the sub-PSFs with a template PSF, aligning and averaging the sub-PSF, applying a phase retrieval algorithm to the averaged sub-PSFs to update the pupil function, regenerating the template PSFs, repeating until a difference between a new and a prior generation pupil function is below a predetermined threshold, generating in situ PSFs from the last pupil function, and applying a maximum likelihood estimation algorithm based on the in situ PSFs and the sub-PSF to thereby generate lateral and axial locations of molecules.

公开(公告)号：US20240402488A1

公开(公告)日：2024-12-05

申请号：US18678100

申请日：2024-05-30

Applicant: Purdue Research Foundation

Inventor： Fang Huang ,  Peiyi Zhang

IPC: G02B27/00 ,  G01N21/64 ,  G02B21/16 ,  G02B21/36 ,  G02B26/08 ,  G06T5/20 ,  G06T5/60 ,  G06T5/80 ,  G06T7/00 ,  G06T7/11

Abstract: The invention generally relates to systems and method for deep learning driven adaptive optics for single molecule localization microscopy. In certain aspects, the invention provides a system comprising: an imaging apparatus configured for conducting single-molecule localization microscopy (SMLM), wherein the imaging apparatus comprises a deformable mirror and a dynamic filter; and a processor operably associated with the imaging apparatus. In certain embodiments, the processor is configured to: monitor individual emission patterns produced via the imaging apparatus from a plurality of different single molecules in a sample; infer shared wavefront distortion for each of the individual emission patterns; provide the shared wavefront distortion for each of the individual emission patterns through the dynamic filter; and operate the deformable mirror to compensate for sample induced aberrations.

公开(公告)号：US11074674B2

公开(公告)日：2021-07-27

申请号：US16480258

申请日：2018-01-29

Applicant: Purdue Research Foundation

Inventor： Fang Huang ,  Sheng Liu

IPC: G06T5/00 ,  G06T5/10 ,  G06T5/20

Abstract: A system for reducing noise in a camera image is disclosed. The system includes one or more processors, and a camera operatively coupled to the processor, the processors are configured to reduce noise of camera images, the processors are configured to receive input image data from the camera representing pixel data from a plurality of pixels, segment the input image data to a plurality of segments and for each segment establish an initial segment image, pre-correct pixel data by modifying the pixel data to account for voltage offset and gain of each pixel based on a predetermined map of gain and offset, and obtain an estimate of an output image by minimizing a cost function and output and stitch the estimated image to other estimated and outputted image segments, and output a noise reduced image including the stitched estimated images.

公开(公告)号：US11960102B2

公开(公告)日：2024-04-16

申请号：US17628140

申请日：2020-08-06

Applicant: Purdue Research Foundation

Inventor： Fan Xu ,  Fang Huang ,  Donghan Ma

IPC: G06K9/00 ,  G01N21/64 ,  G02B21/36 ,  G02B26/08 ,  G02B27/00 ,  G02B27/58

CPC classification number: G02B27/58 ,  G01N21/6458 ,  G02B21/367 ,  G02B26/0825 ,  G02B27/0068 ,  G06T2207/10056

Abstract: A method of in situ point spread function (PSF) retrieval is disclosed which includes encoding 3D location of molecules into PSFs, receiving molecule-generated images containing PSFs, segmenting the images into sub-PSFs, initializing template PSFs from a pupil function, determining a maximum normalized cross correlation (NCC) coefficient (NCCmax) between the sub- and template PSFs, associating each of the sub-PSFs with a template PSF based on the NCCmax and storing the sub-PSFs in associated bins, aligning and averaging the binned sub-PSFs, applying a phase retrieval algorithm to the averaged sub-PSFs to update the pupil function, regenerating the template PSFs, repeating until a difference between a new and a prior generation pupil function is below a predetermined threshold, generating in situ PSFs from the last pupil function, and applying a maximum likelihood estimation algorithm based on the in situ PSFs and the sub-PSFs to thereby generate lateral and axial locations of molecules.

公开(公告)号：US20240272449A1

公开(公告)日：2024-08-15

申请号：US18636195

申请日：2024-04-15

Applicant: Purdue Research Foundation

Inventor： Fan Xu ,  Fang Huang ,  Donghan Ma

IPC: G02B27/58 ,  G01N21/64 ,  G02B21/36 ,  G02B26/08 ,  G02B27/00

CPC classification number: G02B27/58 ,  G01N21/6458 ,  G02B21/367 ,  G02B26/0825 ,  G02B27/0068 ,  G06T2207/10056

Abstract: A method of in situ point spread function (PSF) retrieval is disclosed which includes encoding 3D location of molecules into PSFs, receiving molecule-generated images containing PSFs, segmenting the images into sub-PSF, initializing template PSFs from a pupil function, determining a statistical measure of a predetermined function between the sub- and template PSFs, associating each of the sub-PSFs with a template PSF, aligning and averaging the sub-PSF, applying a phase retrieval algorithm to the averaged sub-PSFs to update the pupil function, regenerating the template PSFs, repeating until a difference between a new and a prior generation pupil function is below a predetermined threshold, generating in situ PSFs from the last pupil function, and applying a maximum likelihood estimation algorithm based on the in situ PSFs and the sub-PSF to thereby generate lateral and axial locations of molecules.

公开(公告)号：US12002185B2

公开(公告)日：2024-06-04

申请号：US17309027

申请日：2019-06-10

Applicant: Purdue Research Foundation

Inventor： Peiyi Zhang ,  Fang Huang ,  Sheng Liu

IPC: G06T3/40 ,  G01J3/28 ,  G01J3/443 ,  G01N21/64 ,  G06N3/08 ,  G06T3/4046

CPC classification number: G06T3/4046 ,  G01J3/2823 ,  G01J3/443 ,  G01N21/6428 ,  G01N21/6458 ,  G06N3/08

Abstract: A fluorescent single molecule emitter simultaneously transmits its identity, location, and cellular context through its emission patterns. A deep neural network (DNN) performs multiplexed single-molecule analysis to enable retrieving such information with high accuracy. The DNN can extract three-dimensional molecule location, orientation, and wavefront distortion with precision approaching the theoretical limit of information content of the image which will allow multiplexed measurements through the emission patterns of a single molecule.

公开(公告)号：US20240062334A1

公开(公告)日：2024-02-22

申请号：US18493899

申请日：2023-10-25

Applicant: Purdue Research Foundation

Inventor： Peiyi Zhang ,  Fang Huang ,  Sheng Liu

IPC: G06T3/40 ,  G01J3/28 ,  G01J3/443 ,  G01N21/64 ,  G06N3/08

CPC classification number: G06T3/4046 ,  G01J3/2823 ,  G01J3/443 ,  G01N21/6428 ,  G01N21/6458 ,  G06N3/08

Abstract: A fluorescent single molecule emitter simultaneously transmits its identity, location, and cellular context through its emission patterns. A deep neural network (DNN) performs multiplexed single-molecule analysis to enable retrieving such information with high accuracy. The DNN can extract three-dimensional molecule location, orientation, and wavefront distortion with precision approaching the theoretical limit of information content of the image which will allow multiplexed measurements through the emission patterns of a single molecule.

公开(公告)号：US20220283443A1

公开(公告)日：2022-09-08

申请号：US17628140

申请日：2020-08-06

Applicant: Purdue Research Foundation

Inventor： Fan Xu ,  Fang Huang ,  Donghan Ma

IPC: G02B27/58 ,  G01N21/64 ,  G02B21/36 ,  G02B26/08 ,  G02B27/00

Abstract: A method of in situ point spread function (PSF) retrieval is disclosed which includes encoding 3D location of molecules into PSFs, receiving molecule-generated images containing PSFs, segmenting the images into sub-PSFs, initializing template PSFs from a pupil function, determining a maximum normalized cross correlation (NCC) coefficient (NCCmax) between the sub- and template PSFs, associating each of the sub-PSFs with a template PSF based on the NCCmax and storing the sub-PSFs in associated bins, aligning and averaging the binned sub-PSFs, applying a phase retrieval algorithm to the averaged sub-PSFs to update the pupil function, regenerating the template PSFs, repeating until a difference between a new and a prior generation pupil function is below a predetermined threshold, generating in situ PSFs from the last pupil function, and applying a maximum likelihood estimation algorithm based on the in situ PSFs and the sub-PSFs to thereby generate lateral and axial locations of molecules.

公开(公告)号：US20190385280A1

公开(公告)日：2019-12-19

申请号：US16480258

申请日：2018-01-29

Applicant: Purdue Research Foundation

Inventor： Fang Huang ,  Sheng Liu

IPC: G06T5/00 ,  G06T5/10 ,  G06T5/20

Abstract: A system for reducing noise in a camera image is disclosed. The system includes one or more processors, and a camera operatively coupled to the processor, the processors are configured to reduce noise of camera images, the processors are configured to receive input image data from the camera representing pixel data from a plurality of pixels, segment the input image data to a plurality of segments and for each segment establish an initial segment image, pre-correct pixel data by modifying the pixel data to account for voltage offset and gain of each pixel based on a predetermined map of gain and offset, and obtain an estimate of an output image by minimizing a cost function and output and stitch the estimated image to other estimated and outputted image segments, and output a noise reduced image including the stitched estimated images.