公开(公告)号：US12228589B2

公开(公告)日：2025-02-18

申请号：US16928487

申请日：2020-07-14

Applicant: KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Wolfgang Heidrich ,  Jinhui Xiong ,  Xiong Dun ,  Ramzi Idoughi ,  Sigurdur Tryggvi Thoroddsen ,  Andres A. Aguirre-Pablo ,  Abdulrahman B. Aljedaani ,  Erqiang Li

IPC: G01F3/36 ,  G01P5/00 ,  G01P5/20 ,  G01P5/26 ,  G01S11/12 ,  G01S17/58 ,  G06T11/00

Abstract: Imaging of complex, non-stationary three dimensional (3D) flow velocities is achieved by encoding depth into color. A flow volume 22 is illuminated with a continuum 40 of light planes 42 whereby each depth corresponds to a respective light plane 14 having a specific wavelength of light. A diffractive component 46 in the camera 24 optics, which records the trajectories of illuminated particles 20 within the flow volume 22, ensures that all light planes 42 are in focus simultaneously. The setup permits a user to track 3D trajectories of particles 20 within the flow volume 22 by combining two dimensional (2D) spatial and one dimensional (1D) color information. For reconstruction, an image formation model for recovering stationary 3D particle positions is provided. 3D velocity estimation is achieved with a variant of a 3D optical flow approach that accounts for both physical constraints as well as the color (rainbow) image formation model.

公开(公告)号：US11073427B2

公开(公告)日：2021-07-27

申请号：US16346773

申请日：2017-10-26

Applicant: King Abdullah University of Science and Technology

Inventor： Congli Wang ,  Xiong Dun ,  Qiang Fu ,  Wolfgang Heidrich

IPC: G01J9/02 ,  G03F7/00 ,  G01J9/00

Abstract: A wavefront sensor includes a mask and a sensor utilized to capture a diffraction pattern generated by light incident to the mask. A reference image is captured in response to a plane wavefront incident on the mask, and another measurement image is captured in response to a distorted wavefront incident on the mask. The distorted wavefront is reconstructed based on differences between the reference image and the measurement image.

公开(公告)号：US11874178B2

公开(公告)日：2024-01-16

申请号：US17354257

申请日：2021-06-22

Applicant: King Abdullah University of Science and Technology

Inventor： Congli Wang ,  Xiong Dun ,  Qiang Fu ,  Wolfgang Heidrich

IPC: G01J9/02 ,  G03F7/00 ,  G01J9/00

CPC classification number: G01J9/02 ,  G01J9/00 ,  G01J9/0215 ,  G03F7/001 ,  G01J2009/002

Abstract: A wavefront sensor includes a mask and a sensor utilized to capture a diffraction pattern generated by light incident to the mask. A reference image is captured in response to a plane wavefront incident on the mask, and another measurement image is captured in response to a distorted wavefront incident on the mask. The distorted wavefront is reconstructed based on differences between the reference image and the measurement image.

公开(公告)号：US10782311B2

公开(公告)日：2020-09-22

申请号：US15498317

申请日：2017-04-26

Applicant: KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Wolfgang Heidrich ,  Jinhui Xiong ,  Xiong Dun ,  Ramzi Idoughi ,  Sigurdur Tryggvi Thoroddsen ,  Andres A. Aguirre-Pablo ,  Abdulrahman B. Aljedaani ,  Erqiang Li

IPC: G01P3/36 ,  G01P5/26 ,  G01S11/12 ,  G01S17/58 ,  G01P5/20 ,  G01P5/00 ,  G06T11/00

Abstract: Imaging of complex, non-stationary three dimensional (3D) flow velocities is achieved by encoding depth into color. A flow volume 22 is illuminated with a continuum 40 of light planes 42 whereby each depth corresponds to a respective light plane 14 having a specific wavelength of light. A diffractive component 46 in the camera 24 optics, which records the trajectories of illuminated particles 20 within the flow volume 22, ensures that all light planes 42 are in focus simultaneously. The setup permits a user to track 3D trajectories of particles 20 within the flow volume 22 by combining two dimensional (2D) spatial and one dimensional (1D) color information. For reconstruction, an image formation model for recovering stationary 3D particle positions is provided. 3D velocity estimation is achieved with a variant of a 3D optical flow approach that accounts for both physical constraints as well as the color (rainbow) image formation model.

公开(公告)号：US11657523B2

公开(公告)日：2023-05-23

申请号：US17915536

申请日：2022-03-17

Applicant: THE TRUSTEES OF PRINCETON UNIVERSITY ,  KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Ilya Chugunov ,  Seung-Hwan Baek ,  Qiang Fu ,  Wolfgang Heidrich ,  Felix Heide

IPC: G06K9/00 ,  G06T7/50 ,  G01S17/894 ,  G01S7/4912 ,  G01S7/481

CPC classification number: G06T7/50 ,  G01S7/4816 ,  G01S7/4912 ,  G01S17/894 ,  G06T2207/10028

Abstract: The microlens amplitude masks for flying pixel removal in time-of-flight imaging includes systems, devices, methods, and instructions for image depth determination, including receiving an image, adding noise to the image, determining a set of correlation images, each correlation image having a varying phase offset, for each pixel of the image, generating a masked pixel by applying a mask array, and for each masked pixel, determining the depth of the masked pixel to generate a depth map for the image on a per pixel basis.

公开(公告)号：US20230118593A1

公开(公告)日：2023-04-20

申请号：US17915536

申请日：2022-03-17

Applicant: THE TRUSTEES OF PRINCETON UNIVERSITY ,  KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Ilya Chugunov ,  Seung-Hwan Baek ,  Qiang` Fu ,  Wolfgang Heidrich ,  Felix Heide

IPC: G06T7/50 ,  G01S17/894 ,  G01S7/481 ,  G01S7/4912

Abstract: The microlens amplitude masks for flying pixel removal in time-of-flight imaging includes systems, devices, methods, and instructions for image depth determination, including receiving an image, adding noise to the image, determining a set of correlation images, each correlation image having a varying phase offset, for each pixel of the image, generating a masked pixel by applying a mask array, and for each masked pixel, determining the depth of the masked pixel to generate a depth map for the image on a per pixel basis.

公开(公告)号：US11557042B2

公开(公告)日：2023-01-17

申请号：US17058168

申请日：2019-04-09

Applicant: KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Sigurdur Tryggvi Thoroddsen ,  Andres A. Aguirre-Pablo ,  Wolfgang Heidrich ,  Jinhui Xiong ,  Abdulrahman B. Aljedaani ,  Ramzi Idoughi

IPC: G06T7/246 ,  G06T7/521 ,  G06T7/73 ,  G01S7/48 ,  G01S17/42 ,  G01S17/58 ,  H04N5/20 ,  H04N5/225

Abstract: A method for tracking moving particles in a fluid. The method includes illuminating the moving particles with an illumination sequence of patterns generated by a light projector; measuring with a single camera light intensities reflected by the moving particles; calculating, based on the measured light intensity, digital coordinates (x′, y′, z′) of the moving particles; determining a mapping function f that maps the digital coordinates (x′, y′, z′) of the moving particles to physical coordinates (x, y, z) of the moving particles; and calculating the physical coordinates (x, y, z) of the moving particles based on the mapping function f. The illumination sequence of patterns is generated with a single wavelength, and light emitted by the projector is perpendicular to light received by the single camera.

公开(公告)号：US11002856B2

公开(公告)日：2021-05-11

申请号：US15739854

申请日：2016-08-05

Applicant: KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY ,  UNIVERSITY OF BRITISH COLUMBIA ,  STANFORD UNIVERSITY ,  BONN UNIVERSITY

Inventor： Wolfgang Heidrich ,  Felix Heide ,  Gordon Wetzstein ,  Matthias Hullin

IPC: G01S17/89 ,  G01S17/58 ,  G01S17/34 ,  G01S7/4911

Abstract: Systems and methods for imaging object velocity are provided. In an embodiment, at least one Time-of-Flight camera is used to capture a signal representative of an object in motion over an exposure time. Illumination and modulation frequency of the captured motion are coded within the exposure time. A change of illumination frequency is mapped to measured pixel intensities of the captured motion within the exposure time, and information about a Doppler shift in the illumination frequency is extracted to obtain a measurement of instantaneous per pixel velocity of the object in motion. The radial velocity information of the object in motion can be simultaneously captured for each pixel captured within the exposure time. In one or more aspects, the illumination frequency can be coded orthogonal to the modulation frequency of the captured motion. The change of illumination frequency can correspond to radial object velocity.

公开(公告)号：US20180246137A1

公开(公告)日：2018-08-30

申请号：US15498317

申请日：2017-04-26

Applicant: KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY

Inventor： Wolfgang Heidrich ,  Jinhui Xiong ,  Xiong Dun ,  Ramzi Idoughi ,  Sigurdur Tryggvi Thoroddsen ,  Andres A. Aguirre-Pablo ,  Abdulrahman B. Aljedaani ,  Erqiang Li

IPC: G01P5/26 ,  G01S11/12 ,  G01S17/58

Abstract: Imaging of complex, non-stationary three dimensional (3D) flow velocities is achieved by encoding depth into color. A flow volume 22 is illuminated with a continuum 40 of light planes 42 whereby each depth corresponds to a respective light plane 14 having a specific wavelength of light. A diffractive component 46 in the camera 24 optics, which records the trajectories of illuminated particles 20 within the flow volume 22, ensures that all light planes 42 are in focus simultaneously. The setup permits a user to track 3D trajectories of particles 20 within the flow volume 22 by combining two dimensional (2D) spatial and one dimensional (1D) color information. For reconstruction, an image formation model for recovering stationary 3D particle positions is provided. 3D velocity estimation is achieved with a variant of a 3D optical flow approach that accounts for both physical constraints as well as the color (rainbow) image formation model.