公开(公告)号：US09797716B2

公开(公告)日：2017-10-24

申请号：US14594017

申请日：2015-01-09

申请人： Lingfei Meng ,  Liyang Lu ,  Kathrin Berkner ,  Ivana Tosic

发明人： Lingfei Meng ,  Liyang Lu ,  Kathrin Berkner ,  Ivana Tosic

IPC分类号： H04N7/18 ,  G01B11/25 ,  G06T7/60 ,  H04N5/225 ,  H04N13/02 ,  G01B11/30 ,  G01B11/24 ,  G06T7/557

CPC分类号： G01B11/25 ,  G01B11/24 ,  G01B11/303 ,  G06T7/557 ,  G06T7/60 ,  H04N5/2256 ,  H04N13/232

摘要： A plenoptic camera captures a plenoptic image of an object illuminated by a point source (preferably, collimated illumination). The plenoptic image is a sampling of the four-dimensional light field reflected from the object. The plenoptic image is made up of superpixels, each of which is made up of subpixels. Each superpixel captures light from a certain region of the object (i.e., a range of x,y spatial locations) and the subpixels within a superpixel capture light propagating within a certain range of directions (i.e., a range of u,v spatial directions). Accordingly, optical properties estimation, surface normal reconstruction, depth estimation, and three-dimensional rendering can be provided by processing only a single plenoptic image. In one approach, the plenoptic image is used to estimate the bidirectional reflectance distribution function (BRDF) of the object surface.

公开(公告)号：US20170084034A1

公开(公告)日：2017-03-23

申请号：US15365671

申请日：2016-11-30

申请人： Lingfei Meng ,  Liyang Lu ,  Noah Bedard ,  Kathrin Berkner

发明人： Lingfei Meng ,  Liyang Lu ,  Noah Bedard ,  Kathrin Berkner

IPC分类号： G06T7/00 ,  H04N17/00

CPC分类号： H04N17/002 ,  G06T7/80 ,  G06T2207/10052

摘要： A collimated object is adjustable to produce collimated light propagating along different propagation directions. The plenoptic imaging system under calibration captures plenoptic images of the object adjusted to different propagation directions. The captured plenoptic images includes superpixels, each of which includes subpixels. Each subpixel captures light from a corresponding light field viewing direction. Based on the captured plenoptic images, a calibration module calculates which propagation directions map to which subpixels. The mapping defines the light field viewing directions for the subpixels. This can be used to improve processing of plenoptic images captured by the plenoptic imaging system.

公开(公告)号：US20160135682A1

公开(公告)日：2016-05-19

申请号：US14542064

申请日：2014-11-14

申请人： Noah Bedard ,  Lingfei Meng ,  Vipin Namboodiri ,  Krishna Prasad Agara Venkatesha Rao ,  Kathrin Berkner

发明人： Noah Bedard ,  Lingfei Meng ,  Vipin Namboodiri ,  Krishna Prasad Agara Venkatesha Rao ,  Kathrin Berkner

IPC分类号： A61B3/12 ,  A61B3/14

CPC分类号： A61B3/12 ,  A61B3/14

摘要： A multimode fundus camera enables three-dimensional and/or spectral/polarization imaging of the interior of the eye to assist in improved diagnosis.

摘要翻译： 多模眼底照相机能够实现眼睛内部的三维和/或光谱/偏振成像，以帮助改善诊断。

公开(公告)号：US20150116526A1

公开(公告)日：2015-04-30

申请号：US14069242

申请日：2013-10-31

申请人： Lingfei Meng ,  Kathrin Berkner

发明人： Lingfei Meng ,  Kathrin Berkner

IPC分类号： H04N5/232 ,  H04N9/097

CPC分类号： H04N5/23232 ,  G06T3/4053 ,  G06T5/50 ,  G06T2207/10052 ,  H04N5/2254 ,  H04N5/2258 ,  H04N9/045 ,  H04N9/097 ,  H04N13/282

摘要： Color plenoptic images captured by a spectrally-coded plenoptic imaging system are combined with higher resolution higher resolution images captured by a conventional imaging system, resulting in color images with higher resolution than those captured by the plenoptic imaging system alone.

摘要翻译： 由光谱编码的全光成像系统拍摄的彩色全息图像与由常规成像系统捕获的更高分辨率的更高分辨率图像组合，导致比仅由全光成像系统捕获的彩色图像更高的分辨率的彩色图像。

公开(公告)号：US09888229B2

公开(公告)日：2018-02-06

申请号：US14312586

申请日：2014-06-23

申请人： Lingfei Meng ,  Kathrin Berkner

发明人： Lingfei Meng ,  Kathrin Berkner

IPC分类号： H04N13/02 ,  G06T7/557

CPC分类号： H04N13/282 ,  G06T7/557 ,  G06T2207/10052 ,  H04N13/232

摘要： This invention presents an approach to first estimate a depth/disparity map using spectrally coded plenoptic camera, and then based on the disparity map the parallax between different spectral channels is rectified. Based on our new technique, we can reconstruct not only multispectral images but also a depth/disparity map. Moreover, the quality of reconstructed spectral images is significantly improved using our parallax rectification.

公开(公告)号：US20150373316A1

公开(公告)日：2015-12-24

申请号：US14312586

申请日：2014-06-23

申请人： Lingfei Meng ,  Kathrin Berkner

发明人： Lingfei Meng ,  Kathrin Berkner

IPC分类号： H04N13/02 ,  G06T7/00

CPC分类号： H04N13/282 ,  G06T7/557 ,  G06T2207/10052 ,  H04N13/232

摘要： This invention presents an approach to first estimate a depth/disparity map using spectrally coded plenoptic camera, and then based on the disparity map the parallax between different spectral channels is rectified. Based on our new technique, we can reconstruct not only multispectral images but also a depth/disparity map. Moreover, the quality of reconstructed spectral images is significantly improved using our parallax rectification.

摘要翻译： 本发明提出了一种使用频谱编码的全光相机首先估计深度/视差图的方法，然后基于视差图来校正不同频谱信道之间的视差。 基于我们的新技术，我们不仅可以重建多光谱图像，还可以重建深度/视差图。 此外，使用我们的视差整流，重建的光谱图像的质量得到显着提高。

公开(公告)号：US09030580B2

公开(公告)日：2015-05-12

申请号：US14040653

申请日：2013-09-28

申请人： Lingfei Meng ,  Kathrin Berkner ,  Ivana Tosic

发明人： Lingfei Meng ,  Kathrin Berkner ,  Ivana Tosic

IPC分类号： H04N9/083 ,  H04N17/02 ,  H04N5/225 ,  G06K9/00 ,  H04N9/09 ,  H04N5/235

CPC分类号： H04N9/045 ,  H04N5/2254

摘要： A method for designing a color filter module used in a plenoptic XYZ imaging system. In one approach, the color filter module is spatially partitioned into filter cells, and the spatial partition is designed by considering data captured at the sensor in light of variations in ΔE.

摘要翻译： 一种设计用于全光XYZ成像系统的滤色片模块的方法。 在一种方法中，滤色器模块在空间上划分成过滤器单元，并且通过考虑根据＆D; E的变化在传感器处捕获的数据来设计空间分区。

公开(公告)号：US20140316238A1

公开(公告)日：2014-10-23

申请号：US14318578

申请日：2014-06-28

申请人： Kathrin Berkner ,  Lingfei Meng ,  Ivana Tosic ,  Nikhil Balram

发明人： Kathrin Berkner ,  Lingfei Meng ,  Ivana Tosic ,  Nikhil Balram

IPC分类号： A61B5/00

CPC分类号： A61B1/227 ,  A61B1/00009 ,  A61B1/00186 ,  A61B1/042 ,  A61B1/055 ,  A61B5/0075 ,  G02B23/243 ,  G02B23/2484

摘要： A plenoptic otoscope captures images used in making a medical diagnosis. For example, the plenoptic data can be processed to produce enhanced imagery of the ear interior, and this enhanced imagery can be used in making a medical diagnosis.

摘要翻译： 全息耳镜捕获用于进行医学诊断的图像。 例如，可以处理全息数据以产生耳朵内部的增强图像，并且该增强的图像可以用于进行医学诊断。

公开(公告)号：US10327627B2

公开(公告)日：2019-06-25

申请号：US14318578

申请日：2014-06-28

申请人： Kathrin Berkner ,  Lingfei Meng ,  Ivana Tosic ,  Nikhil Balram

发明人： Kathrin Berkner ,  Lingfei Meng ,  Ivana Tosic ,  Nikhil Balram

IPC分类号： A61B1/227 ,  A61B1/00 ,  A61B1/04 ,  A61B1/055 ,  G02B23/24 ,  A61B5/00

摘要： A plenoptic otoscope captures images used in making a medical diagnosis. For example, the plenoptic data can be processed to produce enhanced imagery of the ear interior, and this enhanced imagery can be used in making a medical diagnosis.

公开(公告)号：US09918077B2

公开(公告)日：2018-03-13

申请号：US15365671

申请日：2016-11-30

申请人： Lingfei Meng ,  Liyang Lu ,  Noah Bedard ,  Kathrin Berkner

发明人： Lingfei Meng ,  Liyang Lu ,  Noah Bedard ,  Kathrin Berkner

IPC分类号： H04N17/00 ,  G06T7/80

CPC分类号： H04N17/002 ,  G06T7/80 ,  G06T2207/10052

摘要： A collimated object is adjustable to produce collimated light propagating along different propagation directions. The plenoptic imaging system under calibration captures plenoptic images of the object adjusted to different propagation directions. The captured plenoptic images includes superpixels, each of which includes subpixels. Each subpixel captures light from a corresponding light field viewing direction. Based on the captured plenoptic images, a calibration module calculates which propagation directions map to which subpixels. The mapping defines the light field viewing directions for the subpixels. This can be used to improve processing of plenoptic images captured by the plenoptic imaging system.