公开(公告)号：US08654234B2

公开(公告)日：2014-02-18

申请号：US12622752

申请日：2009-11-20

Applicant: Matthew Hirsch ,  Ramesh Raskar ,  Henry Holtzman ,  Douglas Lanman

Inventor： Matthew Hirsch ,  Ramesh Raskar ,  Henry Holtzman ,  Douglas Lanman

IPC: H04N5/222 ,  H04N5/232 ,  H04N9/083 ,  H04B10/00

CPC classification number: G06F3/0425 ,  G06F3/0325 ,  H04N5/2226

Abstract: A bidirectional screen alternately switches between a display mode showing conventional graphics and a capture mode in which the LCD backlight is disabled and the LCD displays a pinhole array or a tiled-broadband code. A large-format image sensor is placed behind the liquid crystal layer. Together, the image sensor and LCD function as a mask-based light field camera, capturing an array of images equivalent to that produced by an array of cameras spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points from focus.

Abstract translation: 双向屏幕交替地在显示常规图形的显示模式和禁用LCD背光的捕获模式之间切换，并且LCD显示针孔阵列或平铺宽带码。 大幅面图像传感器放置在液晶层的后面。 一起，图像传感器和LCD作为基于掩模的光场摄像机，捕获与跨越显示表面的摄像机阵列相同的图像阵列。 恢复的多视角正交图像用于被动地估计焦点的场景点的深度。

公开(公告)号：US08593643B2

公开(公告)日：2013-11-26

申请号：US12700654

申请日：2010-02-04

Applicant: Jaewon Kim ,  Ramesh Raskar

Inventor： Jaewon Kim ,  Ramesh Raskar

IPC: G01B11/24 ,  G01N21/00 ,  G06K9/00

CPC classification number: G01B11/26 ,  G01J3/50 ,  G06F17/10 ,  H04N7/18

Abstract: In an exemplary implementation of this invention, light from a scattering scene passes through a spatial light attenuation pattern and strikes a sensor plane of a camera. Based on said camera's measurements of the received light, a processing unit calculates angular samples of the received light. Light that strikes the sensor plane at certain angles comprises both scattered and directly transmitted components; whereas light that strikes at other angles comprises solely scattered light. A processing unit calculates a polynomial model for the intensity of scattered-only light that falls at the latter angles, and further estimates the direct-only component of the light that falls at the former angles. Further, a processing unit may use the estimated direct component to calculate a reconstructed 3D shape, such as a 3D shape of a finger vein pattern, using an algebraic reconstruction technique.

Abstract translation: 在本发明的示例性实施方式中，来自散射场景的光通过空间光衰减图案并撞击照相机的传感器平面。 基于所述相机对所接收的光的测量，处理单元计算所接收的光的角度样本。 以某一角度撞击传感器平面的光包括散射和直接传输的部件; 而以其他角度撞击的光仅包括散射光。 处理单元计算以后角度落下的散射光强度的多项式模型，并且进一步估计以前一角度落下的光的直接分量。 此外，处理单元可以使用估计的直接分量来使用代数重建技术来计算重建的3D形状，例如手指静脉图案的3D形状。

公开(公告)号：US20130100339A1

公开(公告)日：2013-04-25

申请号：US13646719

申请日：2012-10-07

Applicant: Ramesh Raskar ,  Andreas Velten

Inventor： Ramesh Raskar ,  Andreas Velten

IPC: G03B17/17

CPC classification number: G03B17/17 ,  G03B15/00 ,  G03B39/005 ,  H04N5/225 ,  H04N5/2251

Abstract: In exemplary implementations of this invention, a set of two scanning mirrors scans the one dimensional field of view of a streak camera across a scene. The mirrors are continuously moving while the camera takes streak images. Alternately, the mirrors may only between image captures. An illumination source or other captured event is synchronized with the camera so that for every streak image the scene looks different. The scanning assures that different parts of the scene are captured.

公开(公告)号：US20130100250A1

公开(公告)日：2013-04-25

申请号：US13646703

申请日：2012-10-07

Applicant: Ramesh Raskar ,  Andreas Velten

Inventor： Ramesh Raskar ,  Andreas Velten

IPC: H04N13/02

CPC classification number: H04N13/254 ,  G01S7/4808 ,  G01S7/484 ,  G01S7/487 ,  G01S17/89 ,  H04N13/20

Abstract: In exemplary implementations of this invention, a 3D range camera “looks around a corner” to image a hidden object, using light that has bounced (reflected) off of a diffuse reflector. The camera can recover the 3D structure of the hidden object.

Abstract translation: 在本发明的示例性实施方案中，使用已经从漫反射器反弹（反射）的光，3D范围相机“环绕角落”来对隐藏物体成像。 相机可以恢复隐藏对象的3D结构。

公开(公告)号：US20120206694A1

公开(公告)日：2012-08-16

申请号：US13396556

申请日：2012-02-14

Applicant: Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

Inventor： Ramesh Raskar ,  Vitor Pamplona ,  Erick Passos ,  Jan Zizka

IPC: A61B3/02

CPC classification number: A61B3/112 ,  A61B3/022

Abstract: In exemplary implementations of this invention, cataracts in the human eye are assessed and mapped by measuring the perceptual impact of forward scattering on the foveal region. The same method can be used to measure scattering/blocking media inside lenses of a camera. Close-range anisotropic displays create collimated beams of light to scan through sub-apertures, scattering light as it strikes a cataract. User feedback is accepted and analyzed, to generate maps for opacity, attenuation, contrast and sub-aperture point-spread functions (PSFs). Optionally, the PSF data is used to reconstruct the individual's cataract-affected view.

Abstract translation: 在本发明的示例性实施方式中，通过测量前向散射对中心凹区域的感知影响来评估和映射人眼中的白内障。 相同的方法可以用于测量相机透镜内的散射/阻挡介质。 近距离各向异性显示器产生准直光束，以扫描子孔径，使其在发生白内障时散射光线。 用户反馈被接受和分析，以生成不透明度，衰减，对比度和子孔径点扩散函数（PSF）的图。 可选地，PSF数据用于重建个体的受白内障影响的视图。

公开(公告)号：US20110316968A1

公开(公告)日：2011-12-29

申请号：US12825608

申请日：2010-06-29

Applicant: Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

Inventor： Yuichi Taguchi ,  Amit K. Agrawal ,  Ashok N. Veeraraghavan ,  Srikumar Ramalingam ,  Ramesh Raskar

IPC: H04N7/00

CPC classification number: G06T5/50 ,  G06T2200/21 ,  G06T2207/10052 ,  H04N5/23238

Abstract: A single camera acquires an input image of a scene as observed in an array of spheres, wherein pixels in the input image corresponding to each sphere form a sphere image. A set of virtual cameras are defined for each sphere on a line joining a center of the sphere and a center of projection of the camera, wherein each virtual camera has a different virtual viewpoint and an associated cone of rays, appearing as a circle of pixels on its virtual image plane. A projective texture mapping of each sphere image is applied to all of the virtual cameras on the virtual image plane to produce a virtual camera image comprising circle of pixels. Each virtual camera image for each sphere is then projected to a refocusing geometry using a refocus viewpoint to produce a wide-angle lightfield view, which are averaged to produce a refocused wide-angle image.

Abstract translation: 单个相机获取在球体阵列中观察到的场景的输入图像，其中与每个球体对应的输入图像中的像素形成球面图像。 在连接球体中心的线和摄像机的投影中心的线上为每个球体定义一组虚拟照相机，其中每个虚拟照相机具有不同的虚拟视点和相关联的光线锥，呈现为像素圆 在其虚拟图像平面上。 每个球体图像的投影纹理映射被应用于虚拟图像平面上的所有虚拟相机，以产生包括像素圆的虚拟相机图像。 然后使用重聚焦点将每个球体的每个虚拟照相机图像投影到重聚焦几何，以产生广角光场视图，其被平均以产生重新聚焦的广角图像。

公开(公告)号：US07965936B2

公开(公告)日：2011-06-21

申请号：US12826868

申请日：2010-06-30

Applicant: Ramesh Raskar ,  Amit K. Agrawal

Inventor： Ramesh Raskar ,  Amit K. Agrawal

IPC: G03B13/00

CPC classification number: G02B27/0075

Abstract: A camera acquires a 4D light field of a scene. The camera includes a lens and sensor. A mask is arranged in a straight optical path between the lens and the sensor. The mask including an attenuation pattern to spatially modulate the 4D light field acquired of the scene by the sensor. The pattern has a low spatial frequency when the mask is arranged near the lens, and a high spatial frequency when the mask is arranged near the sensor.

Abstract translation: 相机获取场景的4D光场。 相机包括镜头和传感器。 掩模布置在透镜和传感器之间的直线光路中。 掩模包括用于空间调制由传感器获取的场景的4D光场的衰减图案。 当掩模布置在透镜附近时，图案具有低空间频率，当掩模布置在传感器附近时，该图案具有高的空间频率。

公开(公告)号：US07957007B2

公开(公告)日：2011-06-07

申请号：US11435565

申请日：2006-05-17

Applicant: Ramesh Raskar ,  Paul H. Dietz

Inventor： Ramesh Raskar ,  Paul H. Dietz

IPC: G01B11/24 ,  G01B11/30

CPC classification number: H04N5/222 ,  G01S17/023 ,  G01S17/74 ,  G01S17/875 ,  G01S17/89 ,  H04N5/2256 ,  H04N5/232

Abstract: A projector that illuminates a scene with multiplexed light patterns includes a passive physical mask, and a set of spatially dispersed optical emitters arranged behind the physical mask. The optical emitters are modulated to project a set of unique optical light patterns.

Abstract translation: 以复用光图案照亮场景的投影仪包括无源物理掩模和布置在物理掩模之后的一组空间分散的光发射器。 光发射器被调制以投射一组独特的光学光图案。

公开(公告)号：US07580620B2

公开(公告)日：2009-08-25

申请号：US11429694

申请日：2006-05-08

Applicant: Ramesh Raskar ,  Jack Tumblin ,  Amit Agrawal

Inventor： Ramesh Raskar ,  Jack Tumblin ,  Amit Agrawal

IPC: G03B17/00 ,  H04N5/228

CPC classification number: H04N5/23248 ,  H04N5/23258 ,  H04N5/2329 ,  H04N5/2353 ,  H04N5/238

Abstract: A method and system deblurs images acquired of a scene by a camera. A light field acquired of a scene is modulated temporally according to a sequence of ons and offs. An optimal coding pattern is selected. The modulated light field is integrated by a sensor of a camera during an exposure time to generate an encoded input image. The encoded input image is decoded according to a pseudo-inverse of a smearing matrix to produce a decoded output image having a reduced blur.

Abstract translation: 方法和系统通过照相机去除场景获取的图像。 场景获取的光场根据亮度和亮度的顺序进行时间调制。 选择最佳编码模式。 调制光场在曝光时间期间由相机的传感器集成以产生编码的输入图像。 编码的输入图像根据拖尾矩阵的伪逆解码，以产生具有减小的模糊的解码输出图像。

公开(公告)号：US20070285422A1

公开(公告)日：2007-12-13

申请号：US11624016

申请日：2007-01-17

Applicant: Shree Nayar ,  Gurunandan Krishnan ,  Michael Grossberg ,  Ramesh Raskar

Inventor： Shree Nayar ,  Gurunandan Krishnan ,  Michael Grossberg ,  Ramesh Raskar

IPC: G06T15/50

CPC classification number: G06T15/50 ,  G06K9/4661

Abstract: A method and apparatus for determine an effect of direct and global illumination in a scene. A scene is illuminated with spatially varying illumination. A set of images is acquired of the scene, and a direct and global radiance in the set of images is determined.

Abstract translation: 一种用于确定场景中直接和全局照明效果的方法和装置。 一个场景用空间变化的照明照亮。 获取场景的一组图像，并且确定该组图像中的直接和全局辐射。