公开(公告)号：US08406556B2

公开(公告)日：2013-03-26

申请号：US12797859

申请日：2010-06-10

申请人： Jiaping Wang ,  Yue Dong ,  Xin Tong ,  Zhouchen Lin ,  Baining Guo

发明人： Jiaping Wang ,  Yue Dong ,  Xin Tong ,  Zhouchen Lin ,  Baining Guo

IPC分类号： G06K9/40

CPC分类号： G06T15/50

摘要： A “Scene Re-Lighter” provides various techniques for using an automatically reconstructed light transport matrix derived from a sparse sampling of images to provide various combinations of complex light transport effects in images, including caustics, complex occlusions, inter-reflections, subsurface scattering, etc. More specifically, the Scene Re-Lighter reconstructs the light transport matrix from a relatively small number of acquired images using a “Kernel Nyström” based technique adapted for low rank matrices constructed from sparsely sampled images. A “light transport kernel” is incorporated into the Nyström method to exploit nonlinear coherence in the light transport matrix. Further, an adaptive process is used to efficiently capture the sparsely sampled images from a scene. The Scene Re-Lighter is capable of achieving good reconstruction of the light transport matrix with only few hundred images to produce high quality relighting results. Further, the Scene Re-Lighter is also effective for modeling scenes with complex lighting effects and occlusions.

摘要翻译： 场景再打火机提供了使用从图像稀疏采样得到的自动重建光传输矩阵的各种技术，以提供图像中复杂光传输效应的各种组合，包括焦散，复杂遮挡，相互反射，地下散射等。 更具体地说，场景重新点亮器使用适用于由稀疏采样图像构成的低秩矩阵的基于内核Nyström的技术，从相对较少数量的获取图像重构光传输矩阵。 光传输核被并入Nyström方法，以利用光传输矩阵中的非线性相干性。 此外，使用自适应处理来有效地从场景捕获稀疏采样的图像。 场景重新打火机能够通过仅仅几百张图像实现光传输矩阵的良好重建，从而产生高品质的重视效果。 此外，场景重新打火机对于对具有复杂的照明效果和遮挡的场景进行建模也是有效的。

公开(公告)号：US20110304745A1

公开(公告)日：2011-12-15

申请号：US12797859

申请日：2010-06-10

申请人： Jiaping Wang ,  Yue Dong ,  Zhouchen Lin ,  Xin Tong ,  Baining Guo

发明人： Jiaping Wang ,  Yue Dong ,  Zhouchen Lin ,  Xin Tong ,  Baining Guo

IPC分类号： H04N5/235 ,  G06K9/40

CPC分类号： G06T15/50

摘要： A “Scene Re-Lighter” provides various techniques for using an automatically reconstructed light transport matrix derived from a sparse sampling of images to provide various combinations of complex light transport effects in images, including caustics, complex occlusions, inter-reflections, subsurface scattering, etc. More specifically, the Scene Re-Lighter reconstructs the light transport matrix from a relatively small number of acquired images using a “Kernel Nyström” based technique adapted for low rank matrices constructed from sparsely sampled images. A “light transport kernel” is incorporated into the Nyström method to exploit nonlinear coherence in the light transport matrix. Further, an adaptive process is used to efficiently capture the sparsely sampled images from a scene. The Scene Re-Lighter is capable of achieving good reconstruction of the light transport matrix with only few hundred images to produce high quality relighting results. Further, the Scene Re-Lighter is also effective for modeling scenes with complex lighting effects and occlusions.

摘要翻译： “场景再打火机”提供了各种技术，用于使用从图像的稀疏采样导出的自动重建的光传输矩阵，以提供图像中复杂光传输效应的各种组合，包括焦散，复杂遮挡，相互反射，地下散射， 等等。更具体地，场景重新点亮器使用适用于由稀疏采样图像构成的低秩矩阵的基于“内核Nyström”的技术，从相对较少数量的获取图像重构光传输矩阵。 将“光传输核”纳入Nyström方法以利用光传输矩阵中的非线性相干性。 此外，使用自适应处理来有效地从场景捕获稀疏采样的图像。 场景重新打火机能够通过仅仅几百张图像实现光传输矩阵的良好重建，从而产生高品质的重视效果。 此外，场景重新打火机对于对具有复杂的照明效果和遮挡的场景进行建模也是有效的。

公开(公告)号：US08243071B2

公开(公告)日：2012-08-14

申请号：US12072925

申请日：2008-02-29

申请人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

发明人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

IPC分类号： G06T15/00 ,  G06T15/60 ,  G06K9/00

CPC分类号： G06T15/506 ,  G01N21/47 ,  G01N21/4738 ,  G06T15/50

摘要： An exemplary method includes providing image data for an illuminated physical sample of a heterogeneous translucent material, determining one or more material properties of the material based in part on a diffusion equation where one of the material properties is a diffusion coefficient for diffusion of radiation in the material and where the determining includes a regularization term for the diffusion coefficient, mapping the one or more material properties to a virtual object volume, assigning virtual illumination conditions to the virtual object volume, and rendering the virtual object volume using the virtual illumination conditions as a boundary condition for a system of diffusion equations of the virtual object volume. Other methods, devices and systems are also disclosed.

摘要翻译： 一种示例性方法包括提供用于异质半透明材料的照明物理样品的图像数据，部分地基于扩散方程来确定材料的一种或多种材料性质，其中材料性质之一是用于辐射的扩散的扩散系数 材料，并且其中确定包括扩散系数的正则化术语，将一个或多个材料属性映射到虚拟对象体积，将虚拟照明条件分配给虚拟对象体积，以及使用虚拟照明条件将虚拟对象体积呈现为 虚拟物体体积扩散方程组的边界条件。 还公开了其它方法，装置和系统。

公开(公告)号：US08730240B2

公开(公告)日：2014-05-20

申请号：US13584158

申请日：2012-08-13

申请人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

发明人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

IPC分类号： G06T15/50 ,  G06T15/60 ,  G01N21/47

CPC分类号： G06T15/506 ,  G01N21/47 ,  G01N21/4738 ,  G06T15/50

摘要： An exemplary method includes providing image data for an illuminated physical sample of a heterogeneous translucent material, determining one or more material properties of the material based in part on a diffusion equation where one of the material properties is a diffusion coefficient for diffusion of radiation in the material and where the determining includes a regularization term for the diffusion coefficient, mapping the one or more material properties to a virtual object volume, assigning virtual illumination conditions to the virtual object volume, and rendering the virtual object volume using the virtual illumination conditions as a boundary condition for a system of diffusion equations of the virtual object volume. Other methods, devices and systems are also disclosed.

摘要翻译： 一种示例性方法包括提供用于异质半透明材料的照明物理样品的图像数据，部分地基于扩散方程来确定材料的一种或多种材料性质，其中材料性质之一是用于辐射的扩散的扩散系数 材料，并且其中确定包括扩散系数的正则化术语，将一个或多个材料属性映射到虚拟对象体积，将虚拟照明条件分配给虚拟对象体积，以及使用虚拟照明条件将虚拟对象体积呈现为 虚拟物体体积扩散方程组的边界条件。 还公开了其它方法，装置和系统。

公开(公告)号：US20120306878A1

公开(公告)日：2012-12-06

申请号：US13584158

申请日：2012-08-13

申请人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

发明人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

IPC分类号： G06T15/50

CPC分类号： G06T15/506 ,  G01N21/47 ,  G01N21/4738 ,  G06T15/50

摘要： An exemplary method includes providing image data for an illuminated physical sample of a heterogeneous translucent material, determining one or more material properties of the material based in part on a diffusion equation where one of the material properties is a diffusion coefficient for diffusion of radiation in the material and where the determining includes a regularization term for the diffusion coefficient, mapping the one or more material properties to a virtual object volume, assigning virtual illumination conditions to the virtual object volume, and rendering the virtual object volume using the virtual illumination conditions as a boundary condition for a system of diffusion equations of the virtual object volume. Other methods, devices and systems are also disclosed.

摘要翻译： 一种示例性方法包括提供用于异质半透明材料的照明物理样品的图像数据，部分地基于扩散方程来确定材料的一种或多种材料性质，其中材料性质之一是用于辐射的扩散的扩散系数 材料，并且其中确定包括扩散系数的正则化术语，将一个或多个材料属性映射到虚拟对象体积，将虚拟照明条件分配给虚拟对象体积，以及使用虚拟照明条件将虚拟对象体积呈现为 虚拟物体体积扩散方程组的边界条件。 还公开了其它方法，装置和系统。

公开(公告)号：US20090219287A1

公开(公告)日：2009-09-03

申请号：US12072925

申请日：2008-02-29

申请人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

发明人： Jiaping Wang ,  Xin Tong ,  Stephen S. Lin ,  Baining Guo ,  Heung-Yeung Shum ,  Zhouchen Lin

IPC分类号： G06T15/50 ,  G06F3/048

CPC分类号： G06T15/506 ,  G01N21/47 ,  G01N21/4738 ,  G06T15/50

摘要： An exemplary method includes providing image data for an illuminated physical sample of a heterogeneous translucent material, determining one or more material properties of the material based in part on a diffusion equation where one of the material properties is a diffusion coefficient for diffusion of radiation in the material and where the determining includes a regularization term for the diffusion coefficient, mapping the one or more material properties to a virtual object volume, assigning virtual illumination conditions to the virtual object volume, and rendering the virtual object volume using the virtual illumination conditions as a boundary condition for a system of diffusion equations of the virtual object volume. Other methods, devices and systems are also disclosed.

摘要翻译： 一种示例性方法包括提供用于异质半透明材料的照明物理样品的图像数据，部分地基于扩散方程来确定材料的一种或多种材料性质，其中材料性质之一是用于辐射的扩散的扩散系数 材料，并且其中确定包括扩散系数的正则化术语，将一个或多个材料属性映射到虚拟对象体积，将虚拟照明条件分配给虚拟对象体积，以及使用虚拟照明条件将虚拟对象体积呈现为 虚拟物体体积扩散方程组的边界条件。 还公开了其它方法，装置和系统。

公开(公告)号：US09098945B2

公开(公告)日：2015-08-04

申请号：US12433910

申请日：2009-05-01

申请人： Jiaping Wang ,  Shuang Zhao ,  Xin Tong ,  John M. Snyder ,  Baining Guo

发明人： Jiaping Wang ,  Shuang Zhao ,  Xin Tong ,  John M. Snyder ,  Baining Guo

IPC分类号： G06T15/50

CPC分类号： G06T15/506

摘要： Described is a search technology in which spatially varying anisotropic reflectance is modeled using image data captured from a single view. Reflectance at each point is represented using a microfacet-based Bidirectional Reflectance Distribution Function (BRDF). Modeling processes the image data, which provides a partial normal distribution function (NDF) for each surface point. The NDF at each selected point is completed by texture synthesis using similar, overlapping partial NDFs from other points. Also described is a scanning device that illuminates a sample surface from a two-dimensional set of light directions using a linear array of LEDs moved over a flat sample.

摘要翻译： 描述了一种搜索技术，其中使用从单个视图捕获的图像数据来建模空间变化的各向异性反射率。 每个点的反射率使用基于微量的基于双向反射分布函数（BRDF）表示。 建模处理图像数据，为每个表面点提供部分正态分布函数（NDF）。 每个选定点的NDF通过纹理合成完成，使用与其他点相似的，重叠的部分NDF。 还描述了使用在扁平样品上移动的LED的线性阵列从二维光方向照射样品表面的扫描装置。

公开(公告)号：US20070247472A1

公开(公告)日：2007-10-25

申请号：US11277938

申请日：2006-03-29

申请人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Jiaping Wang ,  John Snyder

发明人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Jiaping Wang ,  John Snyder

IPC分类号： G09G5/00

CPC分类号： G01B11/24 ,  G01S17/89 ,  G06T15/04

摘要： A method and system for implementing capturing and rendering geometric details for mesostructure surfaces is described herein. A mesostructure distance function is defined as a function of a given reference point and a given viewing direction. A distance from a reference point to a mesostructure surface point along a viewing direction is measured using the mesostructure distance function. This distance is used to determine the visibility of mesostructure surface for rendering silhouettes. The lighting visibility of the mesostructure surface point may also be determined and used for determining whether the mesostructure surface point is in shadow. This determination may then be used for rendering shadow silhouettes.

摘要翻译： 本文描述了一种用于实现用于介观结构表面的捕获和渲染几何细节的方法和系统。 介观结构距离函数被定义为给定参考点和给定观察方向的函数。 使用介观结构距离函数测量从参考点到观察方向的介观结构表面点的距离。 该距离用于确定用于渲染轮廓的介观结构表面的可见性。 也可以确定介观结构表面点的照明可见度，并用于确定介观结构表面点是否处于阴影。 然后可以将该确定用于渲染阴影剪影。

公开(公告)号：US08953037B2

公开(公告)日：2015-02-10

申请号：US13274191

申请日：2011-10-14

申请人： Jiaping Wang ,  Baining Guo ,  Peiran Ren ,  John Michael Snyder ,  Xin Tong

发明人： Jiaping Wang ,  Baining Guo ,  Peiran Ren ,  John Michael Snyder ,  Xin Tong

IPC分类号： H04N9/47 ,  H04N1/00 ,  G01N21/55

CPC分类号： H04N1/00018 ,  G01N21/55 ,  H04N1/00013 ,  H04N1/00045 ,  H04N1/00087

摘要： A system for reflectance acquisition of a target includes a light source, an image capture device, and a reflectance reference chart. The reflectance reference chart is fixed relative to the target. The light source provides a uniform band of light across at least a dimension of the target. The image capture device is configured and positioned to encompass at least a portion of the target and at least a portion of the reflectance reference chart within a field-of-view of the image capture device. The image capture device captures a sequence of images of the target and the reflectance reference chart during a scan thereof. Reflectance responses are calculated for the pixels in the sequence of images. Reference reflectance response distribution functions are matched to the calculated reflectance responses, and an image of the target is reconstructed based at least in part on the matched reference reflectance response distribution functions.

摘要翻译： 用于目标的反射获取的系统包括光源，图像捕获装置和反射率参考图。 反射率参考图表相对于目标是固定的。 光源在目标的至少一维上提供均匀的光束。 图像捕获设备被配置和定位成在图像捕获设备的视野内包围目标的至少一部分和反射参考图的至少一部分。 图像捕获装置在其扫描期间捕获目标的图像序列和反射率参考图。 针对图像序列中的像素计算反射响应。 参考反射响应分布函数与所计算的反射率响应匹配，并且至少部分地基于匹配的参考反射响应分布函数来重建目标的图像。

公开(公告)号：US08570522B2

公开(公告)日：2013-10-29

申请号：US13538558

申请日：2012-06-29

申请人： Jiaping Wang ,  Moshe Benezra ,  Xin Tong ,  John Michael Snyder ,  Baining Guo

发明人： Jiaping Wang ,  Moshe Benezra ,  Xin Tong ,  John Michael Snyder ,  Baining Guo

IPC分类号： G01N21/55

CPC分类号： G01N21/55

摘要： A mechanism is disclosed for capturing reflected rays from a surface. A first and second lens aligned along a same optical center axis are configured so that a beam of light collimated parallel to the lens center axis directed to a first side, is converged toward the lens center axis on a second side. A first light beam source between the first and second lenses directs a light beam toward the first lens parallel to the optical center axis. Second light beam source(s) on the second side of the first lens, direct a light beam toward a focal plane of the first lens at a desired angle. An image capturing component, at the second side of the second lens, has an image capture surface directed toward the second lens to capture images of the light reflected from a sample capture surface at the focal plane of the first lens.

摘要翻译： 公开了用于从表面捕获反射光线的机构。 沿着相同的光学中心轴对准的第一和第二透镜被配置为使得平行于指向第一侧的透镜中心轴准直的光束在第二侧上朝向透镜中心轴会聚。 第一和第二透镜之间的第一光束源将平行于光学中心轴的光束朝着第一透镜引导。 在第一透镜的第二侧上的第二光束源将光束以期望的角度引导到第一透镜的焦平面。 在第二透镜的第二侧的图像捕获部件具有指向第二透镜的图像捕获表面，以捕获在第一透镜的焦平面处从样品捕获表面反射的光的图像。