公开(公告)号：US20140240532A1

公开(公告)日：2014-08-28

申请号：US14192800

申请日：2014-02-27

申请人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

发明人： Kshitij Marwah ,  Gordon Wetzstein ,  Ramesh Raskar

IPC分类号： H04N5/262

CPC分类号： H04N5/2621 ,  H04N5/2254

摘要： In exemplary implementations of this invention, a light field camera uses a light field dictionary to reconstruct a 4D light field from a single photograph. The light field includes both angular and spatial information and has a spatial resolution equal to the spatial resolution of the imaging sensor. Light from a scene passes through a coded spatial light modulator (SLM) before reaching an imaging sensor. Computer processors reconstruct a light field. This reconstruction includes computing a sparse or compressible coefficient vector using a light field dictionary matrix. Each column vector of the dictionary matrix is a light field atom. These light field atoms each, respectively, comprise information about a small 4D region of a light field. Reconstruction quality may be improved by using an SLM that is as orthogonal as possible to the dictionary.

摘要翻译： 在本发明的示例性实施方案中，光场照相机使用光场辞典从单张照片重建4D光场。 光场包括角度和空间信息，并且具有等于成像传感器的空间分辨率的空间分辨率。 来自场景的光在到达成像传感器之前通过编码的空间光调制器（SLM）。 计算机处理器重建光场。 该重建包括使用光场字典矩阵来计算稀疏或可压缩的系数向量。 字典矩阵的每个列向量都是一个光场原子。 这些光场原子各自分别包括关于光场的小4D区域的信息。 可以通过使用与字典尽可能正交的SLM来改善重建质量。

公开(公告)号：US20140226128A1

公开(公告)日：2014-08-14

申请号：US14214950

申请日：2014-03-16

申请人： Matthew Everett Lawson ,  Ramesh Raskar

发明人： Matthew Everett Lawson ,  Ramesh Raskar

IPC分类号： A61B3/14 ,  A61B3/00

CPC分类号： A61B3/14 ,  A61B3/0025 ,  A61B3/0091 ,  A61B3/12 ,  G06K9/00604

摘要： In exemplary implementations, this invention comprises apparatus for retinal self-imaging. Visual stimuli help the user self-align his eye with a camera. Bi-ocular coupling induces the test eye to rotate into different positions. As the test eye rotates, a video is captured of different areas of the retina. Computational photography methods process this video into a mosaiced image of a large area of the retina. An LED is pressed against the skin near the eye, to provide indirect, diffuse illumination of the retina. The camera has a wide field of view, and can image part of the retina even when the eye is off-axis (when the eye's pupillary axis and camera's optical axis are not aligned). Alternately, the retina is illuminated directly through the pupil, and different parts of a large lens are used to image different parts of the retina. Alternately, a plenoptic camera is used for retinal imaging.

摘要翻译： 在示例性实施方式中，本发明包括用于视网膜自我成像的装置。 视觉刺激帮助用户用相机自行调整眼睛。 双眼耦合引起测试眼旋转到不同的位置。 当测试眼旋转时，捕获视网膜的不同区域的视频。 计算摄影方法将该视频处理成视网膜大面积的马赛克图像。 LED被压在眼睛附近的皮肤上，以提供视网膜的间接的漫射照明。 相机具有宽视野，即使眼睛离轴（眼睛的瞳孔轴和相机的光轴未对齐），也可以对视网膜的一部分进行成像。 或者，视网膜直接通过瞳孔照射，并且使用大透镜的不同部分来对视网膜的不同部分进行成像。 或者，全视相机用于视网膜成像。

公开(公告)号：US08746885B2

公开(公告)日：2014-06-10

申请号：US13396556

申请日：2012-02-14

申请人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

发明人： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

IPC分类号： A61B3/02 ,  A61B3/00

CPC分类号： A61B3/112 ,  A61B3/022

摘要： In exemplary implementations of this invention, cataracts in the human eye are assessed and mapped by measuring the perceptual impact of forward scattering on the foveal region. The same method can be used to measure scattering/blocking media inside lenses of a camera. Close-range anisotropic displays create collimated beams of light to scan through sub-apertures, scattering light as it strikes a cataract. User feedback is accepted and analyzed, to generate maps for opacity, attenuation, contrast and sub-aperture point-spread functions (PSFs). Optionally, the PSF data is used to reconstruct the individual's cataract-affected view.

摘要翻译： 在本发明的示例性实施方式中，通过测量前向散射对中心凹区域的感知影响来评估和映射人眼中的白内障。 相同的方法可以用于测量相机透镜内的散射/阻挡介质。 近距离各向异性显示器产生准直光束，以扫描子孔径，使其在发生白内障时散射光线。 用户反馈被接受和分析，以生成不透明度，衰减，对比度和子孔径点扩散函数（PSF）的图。 可选地，PSF数据用于重建个体的受白内障影响的视图。

公开(公告)号：US20130176704A1

公开(公告)日：2013-07-11

申请号：US13689631

申请日：2012-11-29

申请人： Douglas Lanman ,  Gordon Wetzstein ,  Matthew Hirsch ,  Wolfgang Heidrich ,  Ramesh Raskar

发明人： Douglas Lanman ,  Gordon Wetzstein ,  Matthew Hirsch ,  Wolfgang Heidrich ,  Ramesh Raskar

IPC分类号： G02B27/22 ,  F21V9/14

CPC分类号： G02B27/22 ,  F21V9/14 ,  G02B27/225 ,  G09G3/003 ,  G09G2300/023 ,  G09G2300/0447 ,  G09G2310/0235 ,  H04N13/32 ,  H04N13/324

摘要： In exemplary implementations of this invention, a flat screen device displays a 3D scene. The 3D display may be viewed by a person who is not wearing any special glasses. The flat screen device displays dynamically changing 3D imagery, with a refresh rate so fast that the device may be used for 3D movies or for interactive, 3D display. The flat screen device comprises a stack of LCD layers with two crossed polarization filters, one filter at each end of the stack. One or more processors control the voltage at each pixel of each LCD layer, in order to control the polarization state rotation induced in light at that pixel. The processor employs an algorithm that models each LCD layer as a spatially-controllable polarization rotator, rather than a conventional spatial light modulator that directly attenuates light. Color display is achieved using field sequential color illumination with monochromatic LCDs.

摘要翻译： 在本发明的示例性实现中，平面屏幕设备显示3D场景。 3D显示器可以由没有佩戴任何特殊眼镜的人员来观看。 平面屏幕设备显示动态变化的3D图像，刷新速度非常快，以至于该设备可用于3D电影或交互式3D显示。 平面屏幕装置包括具有两个交叉偏振滤光器的LCD层的堆叠，在堆叠的每个端部具有一个滤光器。 一个或多个处理器控制每个LCD层的每个像素处的电压，以便控制在该像素处的光中引起的偏振状态旋转。 处理器采用将每个LCD层建模为空间可控的偏振旋转器的算法，而不是直接衰减光的常规空间光调制器。 使用具有单色LCD的场顺序彩色照明来实现彩色显示。

公开(公告)号：US20130027668A1

公开(公告)日：2013-01-31

申请号：US13577880

申请日：2011-04-22

申请人： Vitor Pamplona ,  Manuel Menezes de Oliveira Neto ,  Ankit Mohan ,  Ramesh Raskar

发明人： Vitor Pamplona ,  Manuel Menezes de Oliveira Neto ,  Ankit Mohan ,  Ramesh Raskar

IPC分类号： A61B3/032 ,  A61B3/09

CPC分类号： A61B3/032

摘要： In exemplary implementations, this invention is a tool for subjective assessment of the visual acuity of a human eye. A microlens or pinhole array is placed over a high-resolution display. The eye is brought very near to the device. Patterns are displayed on the screen under some of the lenslets or pinholes. Using interactive software, a user causes the patterns that the eye sees to appear to be aligned. The software allows the user to move the apparent position of the patterns. This apparent motion is achieved by pre-warping the position and angle of the ray-bundles exiting the lenslet display. As the user aligns the apparent position of the patterns, the amount of pre-warping varies. The amount of pre-warping required in order for the user to see what appears to be a single, aligned pattern indicates the lens aberration of the eye.

摘要翻译： 在示例性实施方式中，本发明是用于主观评估人眼视力的工具。 微透镜或针孔阵列放置在高分辨率显示器上。 眼睛非常靠近设备。 图案显示在屏幕上的一些小透镜或针孔下。 使用交互式软件，用户会使眼睛看到的图案对齐。 该软件允许用户移动图案的明显位置。 这种明显的运动是通过预处理离开小透镜显示器的射线束的位置和角度来实现的。 当用户对准图案的表观位置时，预​​翘曲的量变化。 为了使用户看到似乎是单个对齐的图案所需的预翘曲量指示眼睛的镜片像差。

公开(公告)号：US20120300062A1

公开(公告)日：2012-11-29

申请号：US13479185

申请日：2012-05-23

申请人： Rohit Pandharkar ,  Andreas Velten ,  Ramesh Raskar

发明人： Rohit Pandharkar ,  Andreas Velten ,  Ramesh Raskar

IPC分类号： H04N7/18

CPC分类号： G01S17/58 ,  G01S17/89

摘要： In exemplary implementations of this invention, a time of flight camera (ToF camera) can estimate the location, motion and size of a hidden moving object, even though (a) the hidden object cannot be seen directly (or through mirrors) from the vantage point of the ToF camera (including the camera's illumination source and sensor), and (b) the object is in a visually cluttered environment. The hidden object is a NLOS (non-line-of-sight) object. The time of flight camera comprises a streak camera and a laser. In these exemplary implementations, the motion and absolute locations of NLOS moving objects in cluttered environments can be estimated through tertiary reflections of pulsed illumination, using relative time differences of arrival at an array of receivers. Also, the size of NLOS moving objects can be estimated by backprojecting extremas of NLOS moving object time responses.

摘要翻译： 在本发明的示例性实施方式中，飞行时间相机（ToF相机）可以估计隐藏的移动物体的位置，运动和尺寸，即使（a）从有利位置看不到直接（或通过反射镜）隐藏的物体 ToF相机（包括相机的照明源和传感器）的点，（b）物体在视觉上混乱的环境中。 隐藏的对象是一个NLOS（非视距）对象。 飞行时间相机包括条纹相机和激光。 在这些示例性实施方案中，可以使用到达接收器阵列的相对时间差，通过脉冲照明的三次反射来估计NLOS移动物体在杂乱环境中的运动和绝对位置。 此外，NLOS移动对象的大小可以通过反向投影NLOS移动对象时间响应的极值来估计。

公开(公告)号：US20110191073A1

公开(公告)日：2011-08-04

申请号：US12700654

申请日：2010-02-04

申请人： Jaewon Kim ,  Ramesh Raskar

发明人： Jaewon Kim ,  Ramesh Raskar

IPC分类号： G06F17/10 ,  G01B11/26 ,  G01J3/50 ,  H04N7/18

CPC分类号： G01B11/26 ,  G01J3/50 ,  G06F17/10 ,  H04N7/18

摘要： In an exemplary implementation of this invention, light from a scattering scene passes through a spatial light attenuation pattern and strikes a sensor plane of a camera. Based on said camera's measurements of the received light, a processing unit calculates angular samples of the received light. Light that strikes the sensor plane at certain angles comprises both scattered and directly transmitted components; whereas light that strikes at other angles comprises solely scattered light. A processing unit calculates a polynomial model for the intensity of scattered-only light that falls at the latter angles, and further estimates the direct-only component of the light that falls at the former angles. Further, a processing unit may use the estimated direct component to calculate a reconstructed 3D shape, such as a 3D shape of a finger vein pattern, using an algebraic reconstruction technique.

摘要翻译： 在本发明的示例性实施方式中，来自散射场景的光通过空间光衰减图案并撞击照相机的传感器平面。 基于所述相机对所接收的光的测量，处理单元计算所接收的光的角度样本。 以某一角度撞击传感器平面的光包括散射和直接传输的部件; 而以其他角度撞击的光仅包括散射光。 处理单元计算以后角度落下的散射光强度的多项式模型，并且进一步估计以前一角度落下的光的直接分量。 此外，处理单元可以使用估计的直接分量来使用代数重建技术来计算重建的3D形状，例如手指静脉图案的3D形状。

公开(公告)号：US07780364B2

公开(公告)日：2010-08-24

申请号：US12113359

申请日：2008-05-01

申请人： Ramesh Raskar ,  Cyrus A. Wilson ,  Amit K. Agrawal

发明人： Ramesh Raskar ,  Cyrus A. Wilson ,  Amit K. Agrawal

IPC分类号： G03B7/00 ,  G03B9/02

CPC分类号： G02B27/0018 ,  H04N5/2171 ,  H04N5/2254 ,  H04N5/3572 ,  H04N17/002

摘要： Glare is reduced by acquiring an input image with a camera having a lens and a sensor, in which a pin-hole mask is placed in close proximity to the sensor. The mask localizes the glare at readily identifiable pixels, which can then be filtered to produce a glare reduce output image.

摘要翻译： 通过用具有透镜和传感器的相机获取输入图像来减少眩光，其中将针孔掩模放置在靠近传感器的位置。 掩模将容易识别的像素的眩光定位，然后可以对其进行滤波以产生眩光减少输出图像。

公开(公告)号：US20090116728A1

公开(公告)日：2009-05-07

申请号：US11936416

申请日：2007-11-07

申请人： Amit K. Agrawal ,  Ramesh Raskar

发明人： Amit K. Agrawal ,  Ramesh Raskar

IPC分类号： G06K9/00

CPC分类号： B22D46/00 ,  B22D11/1265 ,  G06T7/74 ,  G06T7/75

摘要： A method and system determines a 3D pose of an object in a scene. Depth edges are determined from a set of images acquired of a scene including multiple objects while varying illumination in the scene. The depth edges are linked to form contours. The images are segmented into regions according to the contours. An occlusion graph is constructed using the regions. The occlusion graph includes a source node representing an unoccluded region of an unoccluded object in scene. The contour associated with the unoccluded region is compared with a set of silhouettes of the objects, in which each silhouette has a known pose. The known pose of a best matching silhouette is selected as the pose of the unoccluded object.

摘要翻译： 方法和系统确定场景中对象的3D姿态。 深度边缘由在场景中改变照明的包括多个对象的场景获取的一组图像确定。 连接深度边缘以形成轮廓。 根据轮廓将图像分割成多个区域。 使用这些区域构建闭塞图。 闭塞图包括表示场景中未被占用对象的未被占领区域的源节点。 将与未被占领区域相关联的轮廓与对象的一组轮廓进行比较，其中每个轮廓具有已知姿势。 选择最佳匹配轮廓的已知姿势作为未被占用对象的姿势。

公开(公告)号：US20070258707A1

公开(公告)日：2007-11-08

申请号：US11430233

申请日：2006-05-08

申请人： Ramesh Raskar

发明人： Ramesh Raskar

IPC分类号： G03B17/00

CPC分类号： G03B17/00 ,  G06T5/003 ,  H04N5/23248 ,  H04N5/23258 ,  H04N5/2329 ,  H04N5/2353

摘要： A method and system deblurs images acquired of a scene by a camera. A light field acquired of a scene is modulated temporally according to a sequence of ons and offs. The modulated light field is integrated by a sensor of a camera during an exposure time to generate an encoded input image. The encoded input image is decoded according to a pseudo-inverse of a smearing matrix to produce a decoded output image having a reduced blur.

摘要翻译： 方法和系统通过照相机去除场景获取的图像。 场景获取的光场根据亮度和亮度的顺序进行时间调制。 调制光场在曝光时间期间由相机的传感器集成以产生编码的输入图像。 编码的输入图像根据拖尾矩阵的伪逆解码，以产生具有减小的模糊的解码输出图像。