公开(公告)号：US09451177B2

公开(公告)日：2016-09-20

申请号：US14304507

申请日：2014-06-13

申请人： Ramesh Raskar ,  Christopher Barsi

发明人： Ramesh Raskar ,  Christopher Barsi

IPC分类号： G01J1/42 ,  H04N5/243 ,  H04N5/235 ,  H04N5/30 ,  H01J31/50 ,  G01J11/00

CPC分类号： H04N5/243 ,  G01J11/00 ,  H01J31/50 ,  H04N5/2354 ,  H04N5/30

摘要： In exemplary implementations of this invention, a camera can capture multiple millions of frames per second, such that each frame is 2D image, rather than a streak. A light source in the camera emits ultrashort pulses of light to illuminate a scene. Scattered light from the scene returns to the camera. This incoming light strikes a photocathode, which emits electrons, which are detected by a set of phosphor blocks, which emit light, which is detected by a light sensor. Voltage is applied to plates to create an electric field that deflects the electrons. The voltage varies in a temporal “stepladder” pattern, deflecting the electrons by different amounts, such that the electrons hit different phosphor blocks at different times during the sequence. Each phosphor block (together with the light sensor) captures a separate frame in the sequence. A mask may be used to increase resolution.

摘要翻译： 在本发明的示例性实现中，相机可以每秒捕获数百万帧，使得每个帧是2D图像，而不是条纹。 相机中的光源会发出超短脉冲的光线照亮场景。 来自场景的散射光返回到相机。 该入射光照射发射电子的光电阴极，该光电子由一组由光传感器检测到的发光的磷光体块检测。 将电压施加到板上以产生使电子偏转的电场。 电压在时间“梯形图”模式中变化，使电子偏转不同的量，使得电子在序列期间的不同时间击中不同的荧光体块。 每个荧光体块（与光传感器一起）在序列中捕获单独的帧。 可以使用掩模来提高分辨率。

公开(公告)号：US09148649B2

公开(公告)日：2015-09-29

申请号：US13646703

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： H04N13/02 ,  G01S17/89 ,  G01S7/48 ,  G01S7/484 ,  G01S7/487

CPC分类号： H04N13/254 ,  G01S7/4808 ,  G01S7/484 ,  G01S7/487 ,  G01S17/89 ,  H04N13/20

摘要： In exemplary implementations of this invention, a 3D range camera “looks around a corner” to image a hidden object, using light that has bounced (reflected) off of a diffuse reflector. The camera can recover the 3D structure of the hidden object.

摘要翻译： 在本发明的示例性实施方案中，使用已经从漫反射器反弹（反射）的光，3D范围相机“环绕角落”来对隐藏物体成像。 相机可以恢复隐藏对象的3D结构。

公开(公告)号：US09106841B2

公开(公告)日：2015-08-11

申请号：US14304566

申请日：2014-06-13

申请人： Ramesh Raskar ,  Christopher Barsi

发明人： Ramesh Raskar ,  Christopher Barsi

IPC分类号： H04N5/222 ,  H04N5/243 ,  H04N5/235 ,  H04N5/30 ,  H01J31/50 ,  G01J11/00

CPC分类号： H04N5/243 ,  G01J11/00 ,  H01J31/50 ,  H04N5/2354 ,  H04N5/30

摘要： In exemplary implementations of this invention, a light source illuminates a scene and a light sensor captures data about light that scatters from the scene. The light source emits multiple modulation frequencies, either in a temporal sequence or as a superposition of modulation frequencies. Reference signals that differ in phase are applied to respective subregions of each respective pixel. The number of subregions per pixel, and the number of reference signals per pixel, is preferably greater than four. One or more processors calculate a full cross-correlation function for each respective pixel, by fitting light intensity measurements to a curve, the light intensity measurements being taken, respectively, by respective subregions of the respective pixel. The light sensor comprises M subregions. A lenslet is placed over each subregion, so that each subregion images the entire scene. At least one temporal sequence of frames is taken, one frame per subregion.

摘要翻译： 在本发明的示例性实施方案中，光源照亮场景，光传感器捕获关于从场景散射的光的数据。 光源以时间序列或调制频率的叠加发射多个调制频率。 不同相位的参考信号被施加到每个相应像素的相应子区域。 每像素的子区域的数量和每像素的参考信号的数量优选大于4。 一个或多个处理器通过将光强度测量结合到曲线上，分别由相应像素的相应子区域分别进行光强测量，来计算每个相应像素的完全互相关函数。 光传感器包括M个子区域。 每个子区域都放置一个小透镜，以便每个子区域对整个场景进行成像。 采取帧的至少一个时间序列，每个子区域一个帧。

公开(公告)号：US09081262B2

公开(公告)日：2015-07-14

申请号：US13646719

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/00 ,  H04N5/225

CPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/005 ,  H04N5/225 ,  H04N5/2251

摘要： In exemplary implementations of this invention, a set of two scanning mirrors scans the one dimensional field of view of a streak camera across a scene. The mirrors are continuously moving while the camera takes streak images. Alternately, the mirrors may only between image captures. An illumination source or other captured event is synchronized with the camera so that for every streak image the scene looks different. The scanning assures that different parts of the scene are captured.

摘要翻译： 在本发明的示例性实施方案中，一组两个扫描反射镜在场景上扫描条纹相机的一维视场。 镜头连续移动，而相机拍摄条纹图像。 或者，镜子只能在图像捕捉之间。 照明源或其他捕获的事件与相机同步，使得对于每个条纹图像，场景看起来不同。 扫描确保捕获场景的不同部分。

公开(公告)号：US08749619B2

公开(公告)日：2014-06-10

申请号：US12893863

申请日：2010-09-29

申请人： Ahmed Kirmani ,  Ramesh Raskar ,  James Davis

发明人： Ahmed Kirmani ,  Ramesh Raskar ,  James Davis

IPC分类号： H04N15/00 ,  G01S7/481 ,  G01S7/486 ,  G01S17/89 ,  H04N3/02 ,  H04N5/225

CPC分类号： G01S7/481 ,  G01S7/4865 ,  G01S17/89 ,  H04N3/02 ,  H04N5/2256

摘要： In illustrative implementations of this invention, multi-path analysis of transient illumination is used to reconstruct scene geometry, even of objects that are occluded from the camera. An ultrafast camera system is used. It comprises a photo-sensor (e.g., accurate in the picosecond range), a pulsed illumination source (e.g. a femtosecond laser) and a processor. The camera emits a very brief light pulse that strikes a surface and bounces. Depending on the path taken, part of the light may return to the camera after one, two, three or more bounces. The photo-sensor captures the returning light bounces in a three-dimensional time image I(x,y,t) for each pixel. The camera takes different angular samples from the same viewpoint, recording a five-dimensional STIR (Space Time Impulse Response). A processor analyzes onset information in the STIR to estimate pairwise distances between patches in the scene, and then employs isometric embedding to estimate patch coordinates.

摘要翻译： 在本发明的说明性实现中，瞬时照明的多路径分析被用于重建场景几何图形，甚至是从相机遮挡的对象。 使用超高速摄像系统。 它包括光传感器（例如，在皮秒范围内精确的），脉冲照明源（例如飞秒激光）和处理器。 相机发出非常短暂的光脉冲，撞击表面并弹跳。 根据所采取的路径，部分光线可能在一次，两次，三次或更多次弹跳后返回相机。 光传感器捕获每个像素的三维时间图像I（x，y，t）中的返回光反弹。 相机从相同的角度拍摄不同的角度样本，记录五维STIR（空间时间脉冲响应）。 处理器分析STIR中的发作信息以估计场景中的斑块之间的成对距离，然后使用等距嵌入来估计贴片坐标。

公开(公告)号：US08593643B2

公开(公告)日：2013-11-26

申请号：US12700654

申请日：2010-02-04

申请人： Jaewon Kim ,  Ramesh Raskar

发明人： Jaewon Kim ,  Ramesh Raskar

IPC分类号： G01B11/24 ,  G01N21/00 ,  G06K9/00

CPC分类号： G01B11/26 ,  G01J3/50 ,  G06F17/10 ,  H04N7/18

摘要： In an exemplary implementation of this invention, light from a scattering scene passes through a spatial light attenuation pattern and strikes a sensor plane of a camera. Based on said camera's measurements of the received light, a processing unit calculates angular samples of the received light. Light that strikes the sensor plane at certain angles comprises both scattered and directly transmitted components; whereas light that strikes at other angles comprises solely scattered light. A processing unit calculates a polynomial model for the intensity of scattered-only light that falls at the latter angles, and further estimates the direct-only component of the light that falls at the former angles. Further, a processing unit may use the estimated direct component to calculate a reconstructed 3D shape, such as a 3D shape of a finger vein pattern, using an algebraic reconstruction technique.

摘要翻译： 在本发明的示例性实施方式中，来自散射场景的光通过空间光衰减图案并撞击照相机的传感器平面。 基于所述相机对所接收的光的测量，处理单元计算所接收的光的角度样本。 以某一角度撞击传感器平面的光包括散射和直接传输的部件; 而以其他角度撞击的光仅包括散射光。 处理单元计算以后角度落下的散射光强度的多项式模型，并且进一步估计以前一角度落下的光的直接分量。 此外，处理单元可以使用估计的直接分量来使用代数重建技术来计算重建的3D形状，例如手指静脉图案的3D形状。

公开(公告)号：US20130100339A1

公开(公告)日：2013-04-25

申请号：US13646719

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： G03B17/17

CPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/005 ,  H04N5/225 ,  H04N5/2251

摘要： In exemplary implementations of this invention, a set of two scanning mirrors scans the one dimensional field of view of a streak camera across a scene. The mirrors are continuously moving while the camera takes streak images. Alternately, the mirrors may only between image captures. An illumination source or other captured event is synchronized with the camera so that for every streak image the scene looks different. The scanning assures that different parts of the scene are captured.

公开(公告)号：US20130100250A1

公开(公告)日：2013-04-25

申请号：US13646703

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： H04N13/02

CPC分类号： H04N13/254 ,  G01S7/4808 ,  G01S7/484 ,  G01S7/487 ,  G01S17/89 ,  H04N13/20

摘要： In exemplary implementations of this invention, a 3D range camera “looks around a corner” to image a hidden object, using light that has bounced (reflected) off of a diffuse reflector. The camera can recover the 3D structure of the hidden object.

摘要翻译： 在本发明的示例性实施方案中，使用已经从漫反射器反弹（反射）的光，3D范围相机“环绕角落”来对隐藏物体成像。 相机可以恢复隐藏对象的3D结构。

公开(公告)号：US20120206694A1

公开(公告)日：2012-08-16

申请号：US13396556

申请日：2012-02-14

申请人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

发明人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

IPC分类号： A61B3/02

CPC分类号： A61B3/112 ,  A61B3/022

摘要： In exemplary implementations of this invention, cataracts in the human eye are assessed and mapped by measuring the perceptual impact of forward scattering on the foveal region. The same method can be used to measure scattering/blocking media inside lenses of a camera. Close-range anisotropic displays create collimated beams of light to scan through sub-apertures, scattering light as it strikes a cataract. User feedback is accepted and analyzed, to generate maps for opacity, attenuation, contrast and sub-aperture point-spread functions (PSFs). Optionally, the PSF data is used to reconstruct the individual's cataract-affected view.

摘要翻译： 在本发明的示例性实施方式中，通过测量前向散射对中心凹区域的感知影响来评估和映射人眼中的白内障。 相同的方法可以用于测量相机透镜内的散射/阻挡介质。 近距离各向异性显示器产生准直光束，以扫描子孔径，使其在发生白内障时散射光线。 用户反馈被接受和分析，以生成不透明度，衰减，对比度和子孔径点扩散函数（PSF）的图。 可选地，PSF数据用于重建个体的受白内障影响的视图。

公开(公告)号：US20110316968A1

公开(公告)日：2011-12-29

申请号：US12825608

申请日：2010-06-29

申请人： Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

发明人： Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

IPC分类号： H04N7/00

CPC分类号： G06T5/50 ,  G06T2200/21 ,  G06T2207/10052 ,  H04N5/23238

摘要： A single camera acquires an input image of a scene as observed in an array of spheres, wherein pixels in the input image corresponding to each sphere form a sphere image. A set of virtual cameras are defined for each sphere on a line joining a center of the sphere and a center of projection of the camera, wherein each virtual camera has a different virtual viewpoint and an associated cone of rays, appearing as a circle of pixels on its virtual image plane. A projective texture mapping of each sphere image is applied to all of the virtual cameras on the virtual image plane to produce a virtual camera image comprising circle of pixels. Each virtual camera image for each sphere is then projected to a refocusing geometry using a refocus viewpoint to produce a wide-angle lightfield view, which are averaged to produce a refocused wide-angle image.

摘要翻译： 单个相机获取在球体阵列中观察到的场景的输入图像，其中与每个球体对应的输入图像中的像素形成球面图像。 在连接球体中心的线和摄像机的投影中心的线上为每个球体定义一组虚拟照相机，其中每个虚拟照相机具有不同的虚拟视点和相关联的光线锥，呈现为像素圆 在其虚拟图像平面上。 每个球体图像的投影纹理映射被应用于虚拟图像平面上的所有虚拟相机，以产生包括像素圆的虚拟相机图像。 然后使用重聚焦点将每个球体的每个虚拟照相机图像投影到重聚焦几何，以产生广角光场视图，其被平均以产生重新聚焦的广角图像。