公开(公告)号：US20050280647A1

公开(公告)日：2005-12-22

申请号：US10990142

申请日：2004-11-15

申请人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06T15/20 ,  G06T15/50 ,  G06T15/60 ,  G06T17/00 ,  G09G5/00

CPC分类号： G06T15/04

摘要： A “mesostructure renderer” uses pre-computed multi-dimensional “generalized displacement maps” (GDM) to provide real-time rendering of general non-height-field mesostructures on both open and closed surfaces of arbitrary geometry. In general, the GDM represents the distance to solid mesostructure along any ray cast from any point within a volumetric sample. Given the pre-computed GDM, the mesostructure renderer then computes mesostructure visibility jointly in object space and texture space, thereby enabling both control of texture distortion and efficient computation of texture coordinates and shadowing. Further, in one embodiment, the mesostructure renderer uses the GDM to render mesostructures with either local or global illumination as a per-pixel process using conventional computer graphics hardware to accelerate the real-time rendering of the mesostructures. Further acceleration of mesostructure rendering is achieved in another embodiment by automatically reducing the number of triangles in the rendering pipeline according to a user-specified threshold for acceptable texture distortion.

摘要翻译： “mesostructure渲染器”使用预先计算的多维“广义位移图”（GDM），以便在任意几何的开放和闭合表面上提供一般非高度场介观结构的实时渲染。 一般来说，GDM表示沿着体积样品内的任何点的任何射线投射到固体介观结构的距离。 给定预先计算的GDM，然后，介观结构渲染器在对象空间和纹理空间中联合计算介观结构可见度，从而实现纹理失真的控制和纹理坐标和阴影的有效计算。 此外，在一个实施例中，使用传统计算机图形硬件的介面结构渲染器使用GDM来渲染具有局部或全局照明的介观结构作为每像素处理，以加速介观结构的实时渲染。 在另一个实施例中，通过根据用户指定的可接受纹理失真的阈值自动减少渲染流水线中的三角形数量来实现进一步加速的介观结构渲染。

公开(公告)号：US07609264B2

公开(公告)日：2009-10-27

申请号：US11277935

申请日：2006-03-29

申请人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Stephen Lin ,  Ying Song

发明人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Stephen Lin ,  Ying Song

IPC分类号： G06T15/00

CPC分类号： G06T15/55

摘要： A shell radiance texture function (SRTF) is defined to record an outgoing radiance from a base volume of an object to be rendered. Using the SRTF, radiance values are precomputed and stored for the base volume. The object is rendered using the precomputed radiance values.

摘要翻译： 外壳辐射纹理函数（SRTF）被定义为记录要渲染的对象的基本卷的传出辐射。 使用SRTF，辐射值被预先计算并存储为基本卷。 使用预先计算的辐射值渲染对象。

公开(公告)号：US20080240540A1

公开(公告)日：2008-10-02

申请号：US11694840

申请日：2007-03-30

申请人： Jiaping Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Jiaping Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06K9/00

CPC分类号： G06T19/00 ,  G06T13/00 ,  G06T2210/64

摘要： A method for modeling a time-variant appearance of a material is described. A sample analysis of a material sample is performed, wherein the sample analysis orders surface points of the material sample with respect to weathering from data captured at a single instant in time. An appearance synthesis using the sample analysis is performed, wherein the appearance synthesis generates a time-variant sequence of frames for weathering an object.

摘要翻译： 描述了用于对材料的时变外观进行建模的方法。 进行材料样品的样品分析，其中样品分析根据在单个时刻捕获的数据对材料样品的表面点进行排序。 执行使用样本分析的外观合成，其中外观合成生成用于风化对象的帧的时变序列。

公开(公告)号：US20050280646A1

公开(公告)日：2005-12-22

申请号：US10965603

申请日：2004-10-13

申请人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06T15/20 ,  G06T15/50 ,  G06T15/60 ,  G06T17/00 ,  G09G5/00

CPC分类号： G06T15/04

摘要： A “mesostructure renderer” uses pre-computed multi-dimensional “generalized displacement maps” (GDM) to provide real-time rendering of general non-height-field mesostructures on both open and closed surfaces of arbitrary geometry. In general, the GDM represents the distance to solid mesostructure along any ray cast from any point within a volumetric sample. Given the pre-computed GDM, the mesostructure renderer then computes mesostructure visibility jointly in object space and texture space, thereby enabling both control of texture distortion and efficient computation of texture coordinates and shadowing. Further, in one embodiment, the mesostructure renderer uses the GDM to render mesostructures with either local or global illumination as a per-pixel process using conventional computer graphics hardware to accelerate the real-time rendering of the mesostructures. Further acceleration of mesostructure rendering is achieved in another embodiment by automatically reducing the number of triangles in the rendering pipeline according to a user-specified threshold for acceptable texture distortion.

摘要翻译： “mesostructure渲染器”使用预先计算的多维“广义位移图”（GDM），以便在任意几何的开放和闭合表面上提供一般非高度场介观结构的实时渲染。 一般来说，GDM表示沿着体积样品内的任何点的任何射线投射到固体介观结构的距离。 给定预先计算的GDM，然后，介观结构渲染器在对象空间和纹理空间中联合计算介观结构可见度，从而实现纹理失真的控制和纹理坐标和阴影的有效计算。 此外，在一个实施例中，使用传统计算机图形硬件的介面结构渲染器使用GDM来渲染具有局部或全局照明的介观结构作为每像素处理，以加速介观结构的实时渲染。 在另一个实施例中，通过根据用户指定的可接受纹理失真的阈值自动减少渲染流水线中的三角形数量来实现进一步加速的介观结构渲染。

公开(公告)号：US20070229502A1

公开(公告)日：2007-10-04

申请号：US11277935

申请日：2006-03-29

申请人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Stephen Lin ,  Ying Song

发明人： Xin Tong ,  Yanyun Chen ,  Baining Guo ,  Heung-Yeung Shum ,  Stephen Lin ,  Ying Song

IPC分类号： G06T15/50

CPC分类号： G06T15/55

摘要： A shell radiance texture function (SRTF) is defined to record an outgoing radiance from a base volume of an object to be rendered. Using the SRTF, radiance values are precomputed and stored for the base volume. The object is rendered using the precomputed radiance values.

摘要翻译： 外壳辐射纹理函数（SRTF）被定义为记录要渲染的对象的基本卷的传出辐射。 使用SRTF，辐射值被预先计算并存储为基本卷。 使用预先计算的辐射值渲染对象。

公开(公告)号：US07184052B2

公开(公告)日：2007-02-27

申请号：US10965603

申请日：2004-10-13

申请人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Xi Wang ,  Xin Tong ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06T17/00 ,  G06T15/60 ,  G09G5/00 ,  G06T15/50

CPC分类号： G06T15/04

摘要： A “mesostructure renderer” uses pre-computed multi-dimensional “generalized displacement maps” (GDM) to provide real-time rendering of general non-height-field mesostructures on both open and closed surfaces of arbitrary geometry. In general, the GDM represents the distance to solid mesostructure along any ray cast from any point within a volumetric sample. Given the pre-computed GDM, the mesostructure renderer then computes mesostructure visibility jointly in object space and texture space, thereby enabling both control of texture distortion and efficient computation of texture coordinates and shadowing. Further, in one embodiment, the mesostructure renderer uses the GDM to render mesostructures with either local or global illumination as a per-pixel process using conventional computer graphics hardware to accelerate the real-time rendering of the mesostructures. Further acceleration of mesostructure rendering is achieved in another embodiment by automatically reducing the number of triangles in the rendering pipeline according to a user-specified threshold for acceptable texture distortion.

摘要翻译： “mesostructure渲染器”使用预先计算的多维“广义位移图”（GDM），以便在任意几何的开放和闭合表面上提供一般非高度场介观结构的实时渲染。 一般来说，GDM表示沿着体积样品内的任何点的任何射线投射到固体介观结构的距离。 给定预先计算的GDM，然后，介观结构渲染器在对象空间和纹理空间中联合计算介观结构可见度，从而实现纹理失真的控制和纹理坐标和阴影的有效计算。 此外，在一个实施例中，使用传统计算机图形硬件的介面结构渲染器使用GDM来渲染具有局部或全局照明的介观结构作为每像素处理，以加速介观结构的实时渲染。 在另一个实施例中，通过根据用户指定的可接受纹理失真的阈值自动减少渲染流水线中的三角形数量来实现进一步加速的介观结构渲染。

公开(公告)号：US20060279570A1

公开(公告)日：2006-12-14

申请号：US11147921

申请日：2005-06-08

申请人： Kun Zhou ,  Yaohua Hu ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Kun Zhou ,  Yaohua Hu ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06T15/50

CPC分类号： G06T15/60

摘要： Pre-computed shadow fields are described. In one aspect, shadow fields for multiple entities are pre-computed. The shadow fields are pre-computed independent of scene configuration. The multiple entities include at least one occluding object and at least one light source. A pre-computed shadow field for a light source indicates radiance from the light source. A pre-computed shadow field for an occluding object indicates occlusion of radiance from the at least one light source.

公开(公告)号：US20060204060A1

公开(公告)日：2006-09-14

申请号：US11435122

申请日：2006-05-16

申请人： Ying Huang ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Ying Huang ,  Stephen Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06K9/00

CPC分类号： G06K9/00335 ,  G10L2021/105

摘要： A novel method for synchronizing the lips of a sketched face to an input voice. The lip synchronization system and method approach is to use training video as much as possible when the input voice is similar to the training voice sequences. Initially, face sequences are clustered from video segments, then by making use of sub-sequence Hidden Markov Models, a correlation between speech signals and face shape sequences is built. From this re-use of video, the discontinuity between two consecutive output faces is decreased and accurate and realistic synthesized animations are obtained. The lip synchronization system and method can synthesize faces from input audio in real-time without noticeable delay. Since acoustic feature data calculated from audio is directly used to drive the system without considering its phonemic representation, the method can adapt to any kind of voice, language or sound.

公开(公告)号：US08190403B2

公开(公告)日：2012-05-29

申请号：US11830794

申请日：2007-07-30

申请人： Kun Zhou ,  Zhong Ren ,  Stephen Ssu-te Lin ,  Baining Guo ,  Heung-Yeung Shum

发明人： Kun Zhou ,  Zhong Ren ,  Stephen Ssu-te Lin ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G06F17/10

CPC分类号： G06T15/55

摘要： A real-time algorithm for rendering of an inhomogeneous scattering media such as smoke under dynamic low-frequency environment lighting is described. An input media animation is represented as a sequence of density fields, each of which is decomposed into a weighted sum of a set of radial basis functions (RBFs) and an optional residual field. Source radiances from single and optionally multiple scattering are directly computed at only the RBF centers and then approximated at other points in the volume using an RBF-based interpolation. Unique approximation techniques are introduced in the computational algorithms to simplify and speed up the computation of source radiance contributed by single and multiple scattering. Using the computed source radiances, a ray marching technique using slice-based integration of radiance along each viewing ray may be performed to render the final image.

摘要翻译： 描述了在动态低频环境照明下渲染非均匀散射介质（如烟雾）的实时算法。 输入媒体动画被表示为密度字段序列，每个密度字段被分解成一组径向基函数（RBF）和可选残余字段的加权和。 仅从RBF中心直接计算来自单个和任选多个散射的源辐射，然后使用基于RBF的插值在体积中的其他点处近似。 在计算算法中引入了独特的近似技术，以简化和加快由单次和多次散射贡献的源辐射的计算。 使用计算的源辐射，可以执行使用沿着每个观察射线的基于片段的辐射积分的射线行进技术来渲染最终图像。

公开(公告)号：US20090244083A1

公开(公告)日：2009-10-01

申请号：US12059041

申请日：2008-03-31

申请人： Li-Yi Wei ,  Kun Zhou ,  Jianwei Han ,  Baining Guo ,  Heung-Yeung Shum

发明人： Li-Yi Wei ,  Kun Zhou ,  Jianwei Han ,  Baining Guo ,  Heung-Yeung Shum

IPC分类号： G09G5/00

CPC分类号： G06T11/001

摘要： A “texture generator” uses an inverse texture synthesis solution that runs in the opposite direction to traditional forward synthesis techniques to construct 2D texture compactions for use by a graphics processing unit (GPU) of a computer system. These small 2D texture compactions generally summarize an original globally variant texture or image, and are used to reconstruct the original texture or image, or to re-synthesize new textures or images under user-supplied constraints. In various embodiments, the texture generator uses the texture compaction to provide real-time synthesis of globally variant textures on a GPU, where texture memory is generally too small for large textures. Further, the texture generator provides an optimization framework for inverse texture synthesis which ensures that each input region is properly encoded in the output compaction. In addition, the texture generator also computes orientation fields for anisotropic textures containing both low- and high-frequency regions.

摘要翻译： “纹理生成器”使用逆向纹理合成解决方案，其以与传统的前向合成技术相反的方向运行，以构建2D纹理压缩以供计算机系统的图形处理单元（GPU）使用。 这些小的2D纹理压缩通常总结原始的全局变体纹理或图像，并用于重构原始纹理或图像，或者在用户提供的约束条件下重新合成新的纹理或图像。 在各种实施例中，纹理生成器使用纹理压缩以在GPU上提供全局变体纹理的实时合成，其中纹理存储器通常对于大纹理来说太小。 此外，纹理生成器提供用于逆纹理合成的优化框架，其确保每个输入区域在输出压缩中被适当地编码。 此外，纹理生成器还计算包含低频和高频区域的各向异性纹理的取向场。