公开(公告)号：US09106841B2

公开(公告)日：2015-08-11

申请号：US14304566

申请日：2014-06-13

申请人： Ramesh Raskar ,  Christopher Barsi

发明人： Ramesh Raskar ,  Christopher Barsi

IPC分类号： H04N5/222 ,  H04N5/243 ,  H04N5/235 ,  H04N5/30 ,  H01J31/50 ,  G01J11/00

CPC分类号： H04N5/243 ,  G01J11/00 ,  H01J31/50 ,  H04N5/2354 ,  H04N5/30

摘要： In exemplary implementations of this invention, a light source illuminates a scene and a light sensor captures data about light that scatters from the scene. The light source emits multiple modulation frequencies, either in a temporal sequence or as a superposition of modulation frequencies. Reference signals that differ in phase are applied to respective subregions of each respective pixel. The number of subregions per pixel, and the number of reference signals per pixel, is preferably greater than four. One or more processors calculate a full cross-correlation function for each respective pixel, by fitting light intensity measurements to a curve, the light intensity measurements being taken, respectively, by respective subregions of the respective pixel. The light sensor comprises M subregions. A lenslet is placed over each subregion, so that each subregion images the entire scene. At least one temporal sequence of frames is taken, one frame per subregion.

摘要翻译： 在本发明的示例性实施方案中，光源照亮场景，光传感器捕获关于从场景散射的光的数据。 光源以时间序列或调制频率的叠加发射多个调制频率。 不同相位的参考信号被施加到每个相应像素的相应子区域。 每像素的子区域的数量和每像素的参考信号的数量优选大于4。 一个或多个处理器通过将光强度测量结合到曲线上，分别由相应像素的相应子区域分别进行光强测量，来计算每个相应像素的完全互相关函数。 光传感器包括M个子区域。 每个子区域都放置一个小透镜，以便每个子区域对整个场景进行成像。 采取帧的至少一个时间序列，每个子区域一个帧。

公开(公告)号：US09081262B2

公开(公告)日：2015-07-14

申请号：US13646719

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/00 ,  H04N5/225

CPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/005 ,  H04N5/225 ,  H04N5/2251

摘要： In exemplary implementations of this invention, a set of two scanning mirrors scans the one dimensional field of view of a streak camera across a scene. The mirrors are continuously moving while the camera takes streak images. Alternately, the mirrors may only between image captures. An illumination source or other captured event is synchronized with the camera so that for every streak image the scene looks different. The scanning assures that different parts of the scene are captured.

摘要翻译： 在本发明的示例性实施方案中，一组两个扫描反射镜在场景上扫描条纹相机的一维视场。 镜头连续移动，而相机拍摄条纹图像。 或者，镜子只能在图像捕捉之间。 照明源或其他捕获的事件与相机同步，使得对于每个条纹图像，场景看起来不同。 扫描确保捕获场景的不同部分。

公开(公告)号：US08749619B2

公开(公告)日：2014-06-10

申请号：US12893863

申请日：2010-09-29

申请人： Ahmed Kirmani ,  Ramesh Raskar ,  James Davis

发明人： Ahmed Kirmani ,  Ramesh Raskar ,  James Davis

IPC分类号： H04N15/00 ,  G01S7/481 ,  G01S7/486 ,  G01S17/89 ,  H04N3/02 ,  H04N5/225

CPC分类号： G01S7/481 ,  G01S7/4865 ,  G01S17/89 ,  H04N3/02 ,  H04N5/2256

摘要： In illustrative implementations of this invention, multi-path analysis of transient illumination is used to reconstruct scene geometry, even of objects that are occluded from the camera. An ultrafast camera system is used. It comprises a photo-sensor (e.g., accurate in the picosecond range), a pulsed illumination source (e.g. a femtosecond laser) and a processor. The camera emits a very brief light pulse that strikes a surface and bounces. Depending on the path taken, part of the light may return to the camera after one, two, three or more bounces. The photo-sensor captures the returning light bounces in a three-dimensional time image I(x,y,t) for each pixel. The camera takes different angular samples from the same viewpoint, recording a five-dimensional STIR (Space Time Impulse Response). A processor analyzes onset information in the STIR to estimate pairwise distances between patches in the scene, and then employs isometric embedding to estimate patch coordinates.

摘要翻译： 在本发明的说明性实现中，瞬时照明的多路径分析被用于重建场景几何图形，甚至是从相机遮挡的对象。 使用超高速摄像系统。 它包括光传感器（例如，在皮秒范围内精确的），脉冲照明源（例如飞秒激光）和处理器。 相机发出非常短暂的光脉冲，撞击表面并弹跳。 根据所采取的路径，部分光线可能在一次，两次，三次或更多次弹跳后返回相机。 光传感器捕获每个像素的三维时间图像I（x，y，t）中的返回光反弹。 相机从相同的角度拍摄不同的角度样本，记录五维STIR（空间时间脉冲响应）。 处理器分析STIR中的发作信息以估计场景中的斑块之间的成对距离，然后使用等距嵌入来估计贴片坐标。

公开(公告)号：US20140063077A1

公开(公告)日：2014-03-06

申请号：US13736769

申请日：2013-01-08

申请人： Gordon Wetzstein ,  Douglas Lanman ,  Matthew Hirsch ,  Ramesh Raskar

发明人： Gordon Wetzstein ,  Douglas Lanman ,  Matthew Hirsch ,  Ramesh Raskar

IPC分类号： G09G3/34

CPC分类号： G09G3/3406 ,  G09G3/003 ,  G09G3/36 ,  G09G2300/023 ,  G09G2310/0235 ,  G09G2340/00 ,  H04N13/305 ,  H04N13/307 ,  H04N13/31 ,  H04N13/351 ,  H04N13/354 ,  H04N13/366

摘要： In exemplary implementations of this invention, an automultiscopic display device includes (1) one or more spatially addressable, light attenuating layers, and (2) a controller which is configured to perform calculations to control the device. In these calculations, tensors provide sparse, memory-efficient representations of a light field. The calculations include using weighted nonnegative tensor factorization (NTF) to solve an optimization problem. The NTF calculations can be sufficiently efficient to achieve interactive refresh rates. Either a directional backlight or a uniform backlight may be used. For example, the device may have (1) a high resolution LCD in front, and (2) a low resolution directional backlight. Or, for example, the device may have a uniform backlight and three or more LCD panels. In these examples, all of the LCDs and the directional backlight (if applicable) may be time-multiplexed.

摘要翻译： 在本发明的示例性实施方案中，自动不透明显示装置包括（1）一个或多个空间可寻址的光衰减层，以及（2）被配置为执行计算以控制该装置的控制器。 在这些计算中，张量提供光场的稀疏，记忆效能表示。 计算包括使用加权非负张力因子分解（NTF）来解决优化问题。 NTF计算可以有效地实现交互式刷新率。 可以使用定向背光或均匀背光。 例如，该装置可以具有（1）前面的高分辨率LCD，以及（2）低分辨率定向背光。 或者，例如，该设备可以具有均匀的背光和三个或更多个LCD面板。 在这些示例中，所有LCD和定向背光（如果适用）可以被时分复用。

公开(公告)号：US08654234B2

公开(公告)日：2014-02-18

申请号：US12622752

申请日：2009-11-20

申请人： Matthew Hirsch ,  Ramesh Raskar ,  Henry Holtzman ,  Douglas Lanman

发明人： Matthew Hirsch ,  Ramesh Raskar ,  Henry Holtzman ,  Douglas Lanman

IPC分类号： H04N5/222 ,  H04N5/232 ,  H04N9/083 ,  H04B10/00

CPC分类号： G06F3/0425 ,  G06F3/0325 ,  H04N5/2226

摘要： A bidirectional screen alternately switches between a display mode showing conventional graphics and a capture mode in which the LCD backlight is disabled and the LCD displays a pinhole array or a tiled-broadband code. A large-format image sensor is placed behind the liquid crystal layer. Together, the image sensor and LCD function as a mask-based light field camera, capturing an array of images equivalent to that produced by an array of cameras spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points from focus.

摘要翻译： 双向屏幕交替地在显示常规图形的显示模式和禁用LCD背光的捕获模式之间切换，并且LCD显示针孔阵列或平铺宽带码。 大幅面图像传感器放置在液晶层的后面。 一起，图像传感器和LCD作为基于掩模的光场摄像机，捕获与跨越显示表面的摄像机阵列相同的图像阵列。 恢复的多视角正交图像用于被动地估计焦点的场景点的深度。

公开(公告)号：US08593643B2

公开(公告)日：2013-11-26

申请号：US12700654

申请日：2010-02-04

申请人： Jaewon Kim ,  Ramesh Raskar

发明人： Jaewon Kim ,  Ramesh Raskar

IPC分类号： G01B11/24 ,  G01N21/00 ,  G06K9/00

CPC分类号： G01B11/26 ,  G01J3/50 ,  G06F17/10 ,  H04N7/18

摘要： In an exemplary implementation of this invention, light from a scattering scene passes through a spatial light attenuation pattern and strikes a sensor plane of a camera. Based on said camera's measurements of the received light, a processing unit calculates angular samples of the received light. Light that strikes the sensor plane at certain angles comprises both scattered and directly transmitted components; whereas light that strikes at other angles comprises solely scattered light. A processing unit calculates a polynomial model for the intensity of scattered-only light that falls at the latter angles, and further estimates the direct-only component of the light that falls at the former angles. Further, a processing unit may use the estimated direct component to calculate a reconstructed 3D shape, such as a 3D shape of a finger vein pattern, using an algebraic reconstruction technique.

摘要翻译： 在本发明的示例性实施方式中，来自散射场景的光通过空间光衰减图案并撞击照相机的传感器平面。 基于所述相机对所接收的光的测量，处理单元计算所接收的光的角度样本。 以某一角度撞击传感器平面的光包括散射和直接传输的部件; 而以其他角度撞击的光仅包括散射光。 处理单元计算以后角度落下的散射光强度的多项式模型，并且进一步估计以前一角度落下的光的直接分量。 此外，处理单元可以使用估计的直接分量来使用代数重建技术来计算重建的3D形状，例如手指静脉图案的3D形状。

公开(公告)号：US20130100339A1

公开(公告)日：2013-04-25

申请号：US13646719

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： G03B17/17

CPC分类号： G03B17/17 ,  G03B15/00 ,  G03B39/005 ,  H04N5/225 ,  H04N5/2251

摘要： In exemplary implementations of this invention, a set of two scanning mirrors scans the one dimensional field of view of a streak camera across a scene. The mirrors are continuously moving while the camera takes streak images. Alternately, the mirrors may only between image captures. An illumination source or other captured event is synchronized with the camera so that for every streak image the scene looks different. The scanning assures that different parts of the scene are captured.

公开(公告)号：US20130100250A1

公开(公告)日：2013-04-25

申请号：US13646703

申请日：2012-10-07

申请人： Ramesh Raskar ,  Andreas Velten

发明人： Ramesh Raskar ,  Andreas Velten

IPC分类号： H04N13/02

CPC分类号： H04N13/254 ,  G01S7/4808 ,  G01S7/484 ,  G01S7/487 ,  G01S17/89 ,  H04N13/20

摘要： In exemplary implementations of this invention, a 3D range camera “looks around a corner” to image a hidden object, using light that has bounced (reflected) off of a diffuse reflector. The camera can recover the 3D structure of the hidden object.

摘要翻译： 在本发明的示例性实施方案中，使用已经从漫反射器反弹（反射）的光，3D范围相机“环绕角落”来对隐藏物体成像。 相机可以恢复隐藏对象的3D结构。

公开(公告)号：US20120206694A1

公开(公告)日：2012-08-16

申请号：US13396556

申请日：2012-02-14

申请人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

发明人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

IPC分类号： A61B3/02

CPC分类号： A61B3/112 ,  A61B3/022

摘要： In exemplary implementations of this invention, cataracts in the human eye are assessed and mapped by measuring the perceptual impact of forward scattering on the foveal region. The same method can be used to measure scattering/blocking media inside lenses of a camera. Close-range anisotropic displays create collimated beams of light to scan through sub-apertures, scattering light as it strikes a cataract. User feedback is accepted and analyzed, to generate maps for opacity, attenuation, contrast and sub-aperture point-spread functions (PSFs). Optionally, the PSF data is used to reconstruct the individual's cataract-affected view.

摘要翻译： 在本发明的示例性实施方式中，通过测量前向散射对中心凹区域的感知影响来评估和映射人眼中的白内障。 相同的方法可以用于测量相机透镜内的散射/阻挡介质。 近距离各向异性显示器产生准直光束，以扫描子孔径，使其在发生白内障时散射光线。 用户反馈被接受和分析，以生成不透明度，衰减，对比度和子孔径点扩散函数（PSF）的图。 可选地，PSF数据用于重建个体的受白内障影响的视图。

公开(公告)号：US20110316968A1

公开(公告)日：2011-12-29

申请号：US12825608

申请日：2010-06-29

申请人： Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

发明人： Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

IPC分类号： H04N7/00

CPC分类号： G06T5/50 ,  G06T2200/21 ,  G06T2207/10052 ,  H04N5/23238

摘要： A single camera acquires an input image of a scene as observed in an array of spheres, wherein pixels in the input image corresponding to each sphere form a sphere image. A set of virtual cameras are defined for each sphere on a line joining a center of the sphere and a center of projection of the camera, wherein each virtual camera has a different virtual viewpoint and an associated cone of rays, appearing as a circle of pixels on its virtual image plane. A projective texture mapping of each sphere image is applied to all of the virtual cameras on the virtual image plane to produce a virtual camera image comprising circle of pixels. Each virtual camera image for each sphere is then projected to a refocusing geometry using a refocus viewpoint to produce a wide-angle lightfield view, which are averaged to produce a refocused wide-angle image.

摘要翻译： 单个相机获取在球体阵列中观察到的场景的输入图像，其中与每个球体对应的输入图像中的像素形成球面图像。 在连接球体中心的线和摄像机的投影中心的线上为每个球体定义一组虚拟照相机，其中每个虚拟照相机具有不同的虚拟视点和相关联的光线锥，呈现为像素圆 在其虚拟图像平面上。 每个球体图像的投影纹理映射被应用于虚拟图像平面上的所有虚拟相机，以产生包括像素圆的虚拟相机图像。 然后使用重聚焦点将每个球体的每个虚拟照相机图像投影到重聚焦几何，以产生广角光场视图，其被平均以产生重新聚焦的广角图像。