公开(公告)号：US07019748B2

公开(公告)日：2006-03-28

申请号：US09930426

申请日：2001-08-15

Applicant: Ramesh Raskar

Inventor： Ramesh Raskar

IPC: G06T13/00

CPC classification number: G06T13/20

Abstract: A computer implemented method stimulates motion of a static 3D physical object in a static scene by first acquiring a 3D graphics model of the 3D physical object and the scene. A projector is registered with the 3D physical object, the scene and the 3D model. The model is then segmented into a plurality of parts, and each part is edited with graphics authoring tools to reflect a desired appearance and virtual motion of the part. The edited parts are rendered and projected, in real-time, as a video onto the 3D physical object and scene to give the 3D physical object and the scene the desired appearance and virtual motion.

公开(公告)号：US07001023B2

公开(公告)日：2006-02-21

申请号：US10635404

申请日：2003-08-06

Applicant: Johnny Chung Lee ,  Daniel Maynes-Aminzade ,  Paul H. Dietz ,  Ramesh Raskar

Inventor： Johnny Chung Lee ,  Daniel Maynes-Aminzade ,  Paul H. Dietz ,  Ramesh Raskar

IPC: G03B21/00 ,  G03B21/14 ,  G03B21/26 ,  H04N3/22 ,  H04N3/23

CPC classification number: H04N17/04 ,  H04N9/3185 ,  H04N9/3194

Abstract: A system determines correspondence between locations on a display surface and pixels in an output image of a projector. The display surface can have an arbitrary shape and pose. Locations of known coordinates are identified on the display surface. Each location is optically coupled to a photo sensor by an optical fiber installed in a throughhole in the surface. Known calibration patterns are projected, while sensing directly an intensity of light at each location for each calibration pattern. The intensities are used to determine correspondences between the locations and pixels in an output image of the projector so that projected images can be warped to conform to the display surface.

Abstract translation: 系统确定显示表面上的位置与投影仪的输出图像中的像素之间的对应关系。 显示表面可以具有任意形状和姿势。 已知坐标的位置在显示面上被识别。 每个位置通过安装在表面上的通孔中的光纤光耦合到光传感器。 已知的校准图案被投影，同时直接感测每个校准图案的每个位置处的光强度。 强度用于确定投影仪的输出图像中的位置和像素之间的对应关系，使得投影图像可以翘曲以符合显示表面。

公开(公告)号：US20050254720A1

公开(公告)日：2005-11-17

申请号：US10847069

申请日：2004-05-17

Applicant: Kar-Han Tan ,  Ramesh Raskar ,  Paul Dietz

Inventor： Kar-Han Tan ,  Ramesh Raskar ,  Paul Dietz

IPC: G06T5/00 ,  H01J40/14

CPC classification number: G06T5/003 ,  G06T7/13 ,  G06T7/564 ,  G06T7/586 ,  G06T2200/04 ,  G06T2207/10016 ,  G06T2207/10068 ,  G06T2207/10152 ,  G06T2207/20192 ,  G06T2207/30028

Abstract: A method enhances an output image of a 3D object. A set of input images are acquired of a 3D object. Each one of the input images is illuminated by a different one of a set of lights placed at different positions with respect to the 3D object. Boundaries of shadows are detected in the set of input images by comparing the set of input images. The boundaries of shadows that are closer to a direction of the set of lights are marked as depth edge pixels.

Abstract translation: 一种方法增强了3D对象的输出图像。 获取一组3D对象的输入图像。 输入图像中的每一个被放置在相对于3D对象的不同位置的一组光中的不同的一个被照亮。 通过比较输入图像的集合，在输入图像集中检测到阴影的边界。 更靠近该组光的方向的阴影的边界被标记为深度边缘像素。

公开(公告)号：US06930681B2

公开(公告)日：2005-08-16

申请号：US09930430

申请日：2001-08-14

Applicant: Ramesh Raskar ,  Gregory F. Welch ,  Kok-Lim Low

Inventor： Ramesh Raskar ,  Gregory F. Welch ,  Kok-Lim Low

IPC: G06T15/00

CPC classification number: G06T15/005

Abstract: A computer implemented method registers an image with a 3D physical object by first acquiring a 3D graphics model of an object. Multiple 3D calibration points a surface of the object and corresponding 3D model calibration points in the 3D graphics model are identified. The object is illuminated with a calibration image using a projector at a fixed location. The calibration image is aligned with each of the 3D calibration points on the surface of the 3D physical object to identify corresponding 2D pixels in the calibration image, and then a transformation between the 2D calibration pixels and the corresponding 3D model calibration points is determined to register the projector with the 3D physical object.

Abstract translation: 计算机实现的方法通过首先获取对象的3D图形模型来注册具有3D物体的图像。 识别3D图形模型中多个3D校准点对象的表面和相应的3D模型校准点。 使用投影仪在固定位置的校准图像照亮物体。 校准图像与3D物理物体表面上的每个3D校准点对准，以识别校准图像中的相应2D像素，然后确定2D校准像素与相应的3D模型校准点之间的变换以进行注册 该投影机具有3D物体。

公开(公告)号：US20050030486A1

公开(公告)日：2005-02-10

申请号：US10635404

申请日：2003-08-06

Applicant: Johnny Lee ,  Daniel Maynes-Aminzade ,  Paul Dietz ,  Ramesh Raskar

Inventor： Johnny Lee ,  Daniel Maynes-Aminzade ,  Paul Dietz ,  Ramesh Raskar

IPC: G03B21/00 ,  G03B21/14 ,  H04N5/74 ,  H04N9/31 ,  H04N17/00 ,  H04N17/04

CPC classification number: H04N17/04 ,  H04N9/3185 ,  H04N9/3194

Abstract: A system determines correspondence between locations on a display surface and pixels in an output image of a projector. The display surface can have an arbitrary shape and pose. Locations with know coordinates are identified on the display surface. Each location is optically coupled to a photo sensor by an optical fiber installed in a throughhole in the surface. Known calibration patterns are projected, while sensing directly an intensity of light at each location for each calibration pattern. The intensities are used to determine correspondences between the of locations and pixels in an output image of the projector so that projected images can warped to conform to the display surface.

Abstract translation: 系统确定显示表面上的位置与投影仪的输出图像中的像素之间的对应关系。 显示表面可以具有任意形状和姿势。 具有知识坐标的位置在显示面上被识别。 每个位置通过安装在表面上的通孔中的光纤光耦合到光传感器。 已知的校准图案被投影，同时直接感测每个校准图案的每个位置处的光强度。 强度用于确定投影仪的输出图像中的位置和像素之间的对应关系，使得投影图像可以翘曲以符合显示表面。

公开(公告)号：US06793350B1

公开(公告)日：2004-09-21

申请号：US10458386

申请日：2003-06-10

Applicant: Ramesh Raskar ,  Jeroen van Baar ,  Srinivasa G. Rao ,  Thomas H. Willwacher

Inventor： Ramesh Raskar ,  Jeroen van Baar ,  Srinivasa G. Rao ,  Thomas H. Willwacher

IPC: G03B2100

CPC classification number: G06T3/0081 ,  G03B37/04 ,  G06K9/2036 ,  G06T5/006 ,  H04N9/3147 ,  H04N9/3185 ,  H04N9/3194

Abstract: A method projects one or more image onto a curved display surface. First, a predetermined structured light pattern is projected onto the display surface. A stereo pair of images is acquired of the projected images on the display surface. Then, a quadric transfer function between the predetermined images and the stereo pair of images, via the display surface, is determined. Thus, an arbitrary output image can be warped according to the quadric transfer function so that when it is projected onto the display surface it appears correct.

Abstract translation: 一种方法将一个或多个图像投射到弯曲的显示表面上。 首先，将预定的结构光图案投影到显示面上。 在显示表面上获取投影图像的立体图像对。 然后，通过显示表面确定预定图像和立体对图像之间的二次传递函数。 因此，可以根据二次转移函数扭曲任意输出图像，使得当它被投影到显示表面上时它看起来正确。

公开(公告)号：US06764185B1

公开(公告)日：2004-07-20

申请号：US10636356

申请日：2003-08-07

Applicant: Paul A. Beardsley ,  Ramesh Raskar ,  Clifton L. Forlines ,  Dirk Brinkman

Inventor： Paul A. Beardsley ,  Ramesh Raskar ,  Clifton L. Forlines ,  Dirk Brinkman

IPC: G03B2100

CPC classification number: G03B21/00

Abstract: An interactive display system includes a sensor for sensing a relationship between a mobile coordinate frame fixed to a moving projector, and a stable coordinate frame fixed to a stationary display surface in the real world. An output image to be projected on the display surface is partitioned into a black image portion having a fixed relationship to the mobile coordinate frame, a stable image portion within the block image portion having a fixed relationship to the stable coordinate frame, and a mobile image portion within the stable image portion having a fixed relationship to the mobile coordinate frame. The mobile portion can be used as a pointer within the stable portion in a mouse-cursor like manner.

Abstract translation: 交互式显示系统包括用于感测固定到移动投影仪的移动坐标系与固定在现实世界中的固定显示表面的稳定坐标系之间的关系的传感器。 要投影在显示表面上的输出图像被分割成与移动坐标系具有固定关系的黑色图像部分，在与稳定坐标系具有固定关系的块图像部分内的稳定图像部分和移动图像 稳定图像部分内的部分与移动坐标系具有固定的关系。 移动部分可以以类似于鼠标光标的方式用作稳定部分内的指针。

公开(公告)号：US06755537B1

公开(公告)日：2004-06-29

申请号：US10393686

申请日：2003-03-21

Applicant: Ramesh Raskar ,  Jeroen van Baar ,  Paul A. Beardsley

Inventor： Ramesh Raskar ,  Jeroen van Baar ,  Paul A. Beardsley

IPC: G03B2126

CPC classification number: H04N9/3147 ,  H04N5/74 ,  H04N9/3194

Abstract: A method forms a cluster from a set of projectors. Each projector in the set includes a projector sub-system in a fixed physical relationship to a camera sub-system, and a communication sub-system for sending and receiving messages. A calibrate message is received in the projectors via the communications sub-system. A ready message is broadcast by the projectors using the communications sub-system. A structured pattern is projected sequentially by each of the projectors on a display surface using the projector sub-system. An input image of the structured pattern is acquired sequentially by each of the projectors using the camera sub-system. The projectors are globally aligned with each other and the display surface according to the input images.

Abstract translation: 一种方法从一组投影机形成一个集群。 该组中的每个投影仪包括与照相机子系统固定物理关系的投影仪子系统和用于发送和接收消息的通信子系统。 通过通信子系统在投影机中接收校准信息。 投影机使用通信子系统广播就绪消息。 使用投影仪子系统，在显示表面上通过每个投影仪依次投影结构化图案。 使用相机子系统的每个投影仪顺序地获取结构化图案的输入图像。 投影机根据输入图像在全球范围内对准显示面。

公开(公告)号：US09897699B2

公开(公告)日：2018-02-20

申请号：US14795113

申请日：2015-07-09

Applicant: Achuta Kadambi ,  Hang Zhao ,  Boxin Shi ,  Ayush Bhandari ,  Ramesh Raskar

Inventor： Achuta Kadambi ,  Hang Zhao ,  Boxin Shi ,  Ayush Bhandari ,  Ramesh Raskar

IPC: G01C3/08 ,  G01S17/89 ,  G01S17/00 ,  G01S17/46

CPC classification number: G01S17/89 ,  G01S17/003 ,  G01S17/46

Abstract: A time-of-flight camera images an object around a corner or through a diffuser. In the case of imaging around a corner, light from a hidden target object reflects off a diffuse surface and travels to the camera. Points on the diffuse surface function as a virtual sensors. In the case of imaging through a diffuser, light from the target object is transmitted through a diffusive media and travels to the camera. Points on a surface of the diffuse media that is visible to the camera function as virtual sensors. In both cases, a computer represents phase and intensity measurements taken by the camera as a system of linear equations and solves a linear inverse problem to (i) recover an image of the target object; or (ii) to compute a 3D position for each point in a set of points on an exterior surface of the target object.

公开(公告)号：US09405124B2

公开(公告)日：2016-08-02

申请号：US14248539

申请日：2014-04-09

Applicant: Matthew Hirsch ,  Gordon Wetzstein ,  Ramesh Raskar ,  Vincent Lee

Inventor： Matthew Hirsch ,  Gordon Wetzstein ,  Ramesh Raskar ,  Vincent Lee

IPC: G03B21/00 ,  G02B27/22 ,  H04N5/74 ,  G02B3/00 ,  H04N13/04

CPC classification number: G02B27/2214 ,  G02B3/0068 ,  G03B21/00 ,  H04N5/7416 ,  H04N13/305 ,  H04N13/307 ,  H04N13/363

Abstract: In exemplary implementations of this invention, light from a light field projector is transmitted through an angle-expanding screen to create a glasses-free, 3D display. The display can be horizontal-only parallax or full parallax. In the former case, a vertical diffuser may positioned in the optical stack. The angle-expanding screen may comprise two planar arrays of optical elements (e.g., lenslets or lenticules) separated from each other by the sum of their focal distances. Alternatively, a light field projector may project light rays through a focusing lens onto a diffuse, transmissive screen. In this alternative approach, the light field projector may comprise two spatial light modulators (SLMs). A focused image of the first SLM, and a slightly blurred image of the second SLM, are optically combined on the diffuser, creating a combined image that has a higher spatial resolution and a higher dynamic range than either of two SLMs.

Abstract translation: 在本发明的示例性实施方案中，来自光场投影仪的光通过角度扩展屏幕传输，以产生无眼镜的3D显示器。 显示器可以是仅水平视差或全视差。 在前一种情况下，垂直扩散器可以位于光学堆叠中。 角度扩展屏幕可以包括通过其焦距的总和彼此分离的两个光学元件（例如，小透镜或微透镜）的平面阵列。 或者，光场投影仪可将通过聚焦透镜的光线投射到漫射透射屏幕上。 在这种替代方法中，光场投影仪可以包括两个空间光调制器（SLM）。 第一SLM的聚焦图像和第二SLM的稍微模糊的图像被光学地组合在漫射器上，产生具有比两个SLM中的任一个更高的空间分辨率和更高的动态范围的组合图像。