公开(公告)号：US20070013813A1

公开(公告)日：2007-01-18

申请号：US11183226

申请日：2005-07-15

申请人： Jian Sun ,  Jiaya Jia ,  Heung-Yeung Shum

发明人： Jian Sun ,  Jiaya Jia ,  Heung-Yeung Shum

IPC分类号： H04N9/74

CPC分类号： G06T7/12 ,  G06T7/194 ,  G06T2207/20092

摘要： An exemplary method includes receiving a trimap for an image that specifies a background region, a foreground region and an unknown region for the image wherein a boundary exists between the foreground region and the unknown region and wherein another boundary exists between the unknown region and the background region, solving a set of Poisson equations having boundary conditions for the two boundaries to provide a matte that distinguishes a foreground region from a background region in the unknown region, and refining the matte by solving a set of Poisson equations for a local unknown region. Various other exemplary technologies are also presented.

摘要翻译： 一种示例性方法包括：接收用于图像的微调，该图像指定用于图像的背景区域，前景区域和未知区域，其中在前景区域和未知区域之间存在边界，并且其中在未知区域和背景之间存在另一边界 区域，求解一组具有两个边界的边界条件的泊松方程，以提供区分未知区域中的前景区域和背景区域的无光泽，以及通过求解一组局部未知区域的泊松方程来改善无光泽。 还提出了各种其它示例性技术。

公开(公告)号：US20060028481A1

公开(公告)日：2006-02-09

申请号：US11240878

申请日：2005-09-30

申请人： Jingdan Zhang ,  Kun Zhou ,  Baining Guo ,  Heung-Yeung Shum

发明人： Jingdan Zhang ,  Kun Zhou ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G09G5/00

CPC分类号： G06T11/001

摘要： Methods for synthesizing progressively-variant textures based on texton masks are provided. A first method creates a synthesized texture image guided by a sample texture, first texton mask corresponding to the sample texture and a second texton mask modified based on the first texton mask. A second method also creates a synthesized texture image guided by a first and second sample textures and corresponding first and second texton masks. A method for rendering a synthesized texture on an image of a three-dimensional object includes creating a synthesized texture on the object guided by a two-dimensional progressively-variant sample texture, a texton mask for the sample texture and a mesh of a plurality of vertices representing the object.

公开(公告)号：US20050285872A1

公开(公告)日：2005-12-29

申请号：US11192639

申请日：2005-07-28

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G06T15/20 ,  G09G5/00

CPC分类号： G06T15/04

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

摘要翻译： 描述用于从场景的多个视图重建最佳纹理图的系统和过程。 实质上，这种重建是基于来自多个源的纹理的最佳合成。 这通常使用基本图像处理理论来实现，以导出用于混合多个视图的正确权重。 即，遵循重构，翘曲，预过滤和重采样的步骤，以便将参考纹理扭曲到期望的位置，并计算用于最佳混合的空间变体权重。 这些权重考虑到纹理投影中的各向异性和由于缩短引起的采样频率的变化。 权重相结合，最优纹理的计算被视为恢复问题，其涉及求解线性方程组。 这种方法可以并入各种应用中，例如3D模型的纹理化，通过合成方法的分析，超分辨率技术和视图相关的纹理映射。

公开(公告)号：US20050213813A1

公开(公告)日：2005-09-29

申请号：US10809167

申请日：2004-03-23

申请人： Stephen Lin ,  Heung-Yeung Shum ,  Jinwei Gu

发明人： Stephen Lin ,  Heung-Yeung Shum ,  Jinwei Gu

IPC分类号： G01J3/46 ,  G06T1/00 ,  G06T7/00 ,  G06T7/40 ,  H04N1/46 ,  H04N1/60 ,  G06K9/00

CPC分类号： H04N1/603 ,  G06T7/80 ,  G06T7/90

摘要： A radiometric calibration system finds an inverse response function of a camera from a single digital image of a scene in which the actual colors of the scene are not known a priori. The system analyzes pixels of the image that correspond to an “edge” between two colors of the scene. These “edge” pixels represent a blended color formed from these two “component” colors, as measured by the camera. The system determines an inverse response function at least in part by: (a) finding suitable edge pixels; and (b) determining a function that maps the measured blended colors of edge pixels and their measured component colors into linear distributions. Reference data that includes predetermined inverse response functions of known cameras can be used in determining an inverse response function via a Bayesian Estimation.

摘要翻译： 辐射校准系统从场景的实际颜色先前不知道的场景的单个数字图像中发现摄像机的反向响应功能。 该系统分析对应于场景两种颜色之间的“边缘”的图像像素。 这些“边缘”像素表示由相机测量的由这两个“分量”颜色形成的混合色。 系统至少部分地通过以下方式确定反应响应函数：（a）找到合适的边缘像素; 和（b）确定将所测量的边缘像素的混合颜色及其测量的分量颜色映射成线性分布的函数。 包括已知摄像机的预定反向响应功能的参考数据可以用于经由贝叶斯估计来确定反向响应函数。

公开(公告)号：US20050104883A1

公开(公告)日：2005-05-19

申请号：US10951272

申请日：2004-09-27

申请人： John Snyder ,  Peter-Pike Sloan ,  Xinguo Liu ,  Heung-Yeung Shum

发明人： John Snyder ,  Peter-Pike Sloan ,  Xinguo Liu ,  Heung-Yeung Shum

IPC分类号： G06T15/50 ,  G06T15/60

CPC分类号： G06T15/50

摘要： The described systems and methods are directed at interactively rendering graphics using precomputed radiance transfer (PRT). A reflectance matrix that represents the reflectance of a particular object to be rendered is determined. Source lighting associated with the object is represented using basis functions. The reflectance matrix is factored into view and light components. A raw transfer matrix is determined based, in part, from the factored reflectance matrix and the source lighting. The raw transfer matrix is partitioned to obtain transfer matrices, which are used to render the object. The described systems and methods are capable of rendering glossy objects with well-defined shadows.

摘要翻译： 所描述的系统和方法针对使用预计算辐射传输（PRT）的交互式渲染图形。 确定表示要呈现的特定对象的反射率的反射率矩阵。 使用基础函数表示与对象相关联的源照明。 反射率矩阵被考虑到视图和光分量中。 原始转移矩阵部分地基于因子反射矩阵和源照明来确定。 原始传输矩阵被分割以获得用于渲染对象的传输矩阵。 所描述的系统和方法能够渲染具有明确定义阴影的光泽对象。

公开(公告)号：US20050093857A1

公开(公告)日：2005-05-05

申请号：US10698909

申请日：2003-10-31

申请人： Lifeng Wang ,  Xi Wang ,  Xing Tong ,  Baining Guo ,  Heung-Yeung Shum

发明人： Lifeng Wang ,  Xi Wang ,  Xing Tong ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06T15/20 ,  G06T15/00

CPC分类号： G06T15/04

摘要： A computer implemented method for generating a representation of structure for use in rendering a synthesized image is provided. The representation is a view-dependent displacement mapping that represents displacements along a viewing direction. This view dependency allows the representation to be used to determine self shadows as well as shading, occlusion and silhouettes when used during rendering for synthesis.

摘要翻译： 提供了一种用于生成用于渲染合成图像的结构的表示的计算机实现的方法。 该表示是视图相关的位移映射，其表示沿观察方向的位移。 该视图依赖性允许在用于合成的渲染期间使用表示来确定自身阴影以及阴影，遮挡和剪影。

公开(公告)号：US06871166B1

公开(公告)日：2005-03-22

申请号：US09620533

申请日：2000-07-23

申请人： Ying-Qing Xu ,  Baining Guo ,  Hua Zhong ,  Heung-Yeung Shum

发明人： Ying-Qing Xu ,  Baining Guo ,  Hua Zhong ,  Heung-Yeung Shum

IPC分类号： D04B7/04 ,  D04B37/00 ,  G06F17/50 ,  G06G7/48

CPC分类号： D04B37/00

摘要： Knitwear modeling is disclosed. A macrostructure corresponding to a three-dimensional object is generated, based on a stitch pattern and optionally a color pattern. Yarn microstructure is generated and applied to the macrostructure to yield a knitwear model. The stitch positions of the macrostructure can be perturbed to achieve stitch position irregularities. The fluffiness of the yarn microstructure can be controlled. In an alternative embodiment, a two-dimensional knitwear texture is generated, which can then be mapped to a three-dimensional object to yield a knitwear model.

摘要翻译： 披露了针织品造型。 基于针迹图案和可选的颜色图案，生成对应于三维物体的宏观结构。 生产纱线微观结构并应用于宏观结构以产生针织品模型。 可以扰动宏观结构的缝合位置以达到缝合位置不规则。 可以控制纱线微结构的蓬松性。 在替代实施例中，生成二维针织品纹理，然后将其映射到三维对象以产生针织品模型。

公开(公告)号：US20050052543A1

公开(公告)日：2005-03-10

申请号：US10970511

申请日：2004-10-21

申请人： Jiang Li ,  Heung-Yeung Shum

发明人： Jiang Li ,  Heung-Yeung Shum

IPC分类号： H04N5/225 ,  H04N5/228 ,  H04N13/00

CPC分类号： H04N13/279 ,  H04N13/221 ,  H04N13/243

摘要： In one embodiment, a longitudinal camera array is rotated through a capture cylinder, with each camera in the array capturing multiple images as the array rotates. These images can be looking outward along the radials of the cylinder, or alternatively looking tangential to the cylinder. The longitudinal camera array allows the surrounding scene to be captured from multiple different planes that are substantially parallel to the ends of the capture cylinder, allowing for more accurate subsequent rendering of the scene. A view of the scene can be subsequently rendered by determining a location and direction of view of an observer, and then selecting one or more of the multiple lateral and longitudinally adjacent capture images, as well as one or more pixels within that capture image(s), to use to determine a display value for the pixel.

摘要翻译： 在一个实施例中，纵向相机阵列旋转通过捕获圆筒，阵列中的每个相机在阵列中捕获多个图像。 这些图像可以沿着圆柱体的径向向外看，或者与圆筒相切地看。 纵向相机阵列允许从基本上平行于捕获圆筒的端部的多个不同平面捕获周围场景，从而允许更准确地随后渲染场景。 可以随后通过确定观察者的位置和方向，然后选择多个横向和纵向相邻捕获图像中的一个或多个，以及该捕获图像内的一个或多个像素来呈现场景视图 ），用于确定像素的显示值。

公开(公告)号：US06760026B2

公开(公告)日：2004-07-06

申请号：US09754660

申请日：2001-01-02

申请人： Jiang Li ,  Heung-Yeung Shum

发明人： Jiang Li ,  Heung-Yeung Shum

IPC分类号： G06T1760

CPC分类号： G06T15/20 ,  A63F2300/6661 ,  A63F2300/69 ,  A63F2300/8082

摘要： A system and process for rendering a virtual reality environment having an image-based background, which allows a viewer to move about and interact with 3D graphic objects in a virtual interaction space of the environment. This is generally accomplished by first rendering an image-based background, and separately rendering geometry-based foreground objects. The foreground objects are then integrated into the background, and a combined image is presented to the viewer.

摘要翻译： 一种用于渲染具有基于图像的背景的虚拟现实环境的系统和过程，其允许观看者围绕环境的虚拟交互空间中的3D图形对象移动并与其交互。 这通常是通过首先渲染基于图像的背景，并分别渲染基于几何的前景对象来实现的。 然后将前景对象集成到背景中，并且将合并的图像呈现给观看者。

公开(公告)号：US06738533B1

公开(公告)日：2004-05-18

申请号：US09538067

申请日：2000-03-29

申请人： Heung-Yeung Shum ,  Jin-Xiang Chai ,  Xin Tong

发明人： Heung-Yeung Shum ,  Jin-Xiang Chai ,  Xin Tong

IPC分类号： G06K932

CPC分类号： G06T15/205 ,  Y10S707/99942

摘要： A minimum sampling rate and a minimum sampling curve for continuous representation of a scene are disclosed. The minimum sampling rate for light-field rendering is determined in accordance with Δ ⁢   ⁢ t max = 1 2 ⁢ K Ω v ⁢   ⁢ fh d , where K&OHgr;v accounts for a light-field signal cut-off frequency, a sampling camera resolution and an output resolution, ƒ specifies a sampling camera focal length, and hd specifies a light-field depth range. The minimum sampling curve for image-based rendering is determined as constrained by Nd=2K&OHgr;vƒhd&Dgr;t, Nd≧1, where Nd is the number of depth layers, &Dgr;t specifies a sampling interval along a t direction. Where IBR is be performed under uncertain depth, the curve is determined as Δ ⁢   ⁢ t max = min z e ⁢   ⁢ ( z e + Δ ⁢   ⁢ η ) ⁢   ⁢ ( z e - Δ ⁢   ⁢ η ) 4 ⁢   ⁢ fK Ω v ⁢   ⁢ Δ ⁢   ⁢ η , where &Dgr;tmax specifies a maximum sampling interval along a t direction, ze specifies an estimated depth, and &Dgr;&eegr; specifies a depth error.

摘要翻译： 公开了用于连续表示场景的最小采样率和最小采样曲线。 光场渲染的最小采样率根据KOmegav考虑到光场信号截止频率，采样相机分辨率和输出分辨率，f指定采样摄像机焦距，并且hd指定发光二极管， 场深度范围。 基于图像的渲染的最小采样曲线被确定为Nd = 2KOmegavfhdDeltat，Nd> = 1，其中Nd是深度层的数量，Deltat指定沿t方向的采样间隔。 在不确定深度下执行IBR的情况下，确定曲线，其中Deltatmax指定沿t方向的最大采样间隔，ze指定估计深度，Deltaeta指定深度误差。