公开(公告)号：US20050285872A1

公开(公告)日：2005-12-29

申请号：US11192639

申请日：2005-07-28

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G06T15/20 ,  G09G5/00

CPC分类号： G06T15/04

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

摘要翻译： 描述用于从场景的多个视图重建最佳纹理图的系统和过程。 实质上，这种重建是基于来自多个源的纹理的最佳合成。 这通常使用基本图像处理理论来实现，以导出用于混合多个视图的正确权重。 即，遵循重构，翘曲，预过滤和重采样的步骤，以便将参考纹理扭曲到期望的位置，并计算用于最佳混合的空间变体权重。 这些权重考虑到纹理投影中的各向异性和由于缩短引起的采样频率的变化。 权重相结合，最优纹理的计算被视为恢复问题，其涉及求解线性方程组。 这种方法可以并入各种应用中，例如3D模型的纹理化，通过合成方法的分析，超分辨率技术和视图相关的纹理映射。

公开(公告)号：US06985156B2

公开(公告)日：2006-01-10

申请号：US10875741

申请日：2004-06-23

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G09G5/00

CPC分类号： G06T11/001

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

摘要翻译： 描述用于从场景的多个视图重建最佳纹理图的系统和过程。 实质上，这种重建是基于来自多个源的纹理的最佳合成。 这通常使用基本图像处理理论来实现，以导出用于混合多个视图的正确权重。 即，遵循重构，翘曲，预过滤和重采样的步骤，以便将参考纹理扭曲到期望的位置，并计算用于最佳混合的空间变体权重。 这些权重考虑到纹理投影中的各向异性和由于缩短引起的采样频率的变化。 权重相结合，最优纹理的计算被视为恢复问题，其涉及求解线性方程组。 这种方法可以并入各种应用中，例如3D模型的纹理化，通过合成方法的分析，超分辨率技术和视图相关的纹理映射。

公开(公告)号：US07205998B2

公开(公告)日：2007-04-17

申请号：US11192639

申请日：2005-07-28

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G09G5/00

CPC分类号： G06T15/04

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

摘要翻译： 描述用于从场景的多个视图重建最佳纹理图的系统和过程。 实质上，这种重建是基于来自多个源的纹理的最佳合成。 这通常使用基本图像处理理论来实现，以导出用于混合多个视图的正确权重。 即，遵循重构，翘曲，预过滤和重采样的步骤，以便将参考纹理扭曲到期望的位置，并计算用于最佳混合的空间变体权重。 这些权重考虑到纹理投影中的各向异性和由于缩短引起的采样频率的变化。 权重相结合，最优纹理的计算被视为恢复问题，其涉及求解线性方程组。 这种方法可以并入各种应用中，例如3D模型的纹理化，通过合成方法的分析，超分辨率技术和视图相关的纹理映射。

公开(公告)号：US06999095B2

公开(公告)日：2006-02-14

申请号：US10983193

申请日：2004-11-05

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G09G5/00

CPC分类号： G06T11/001

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

公开(公告)号：US06825850B2

公开(公告)日：2004-11-30

申请号：US10283562

申请日：2002-10-30

申请人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Bing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G09G500

CPC分类号： G06T11/001

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

公开(公告)号：US20050093877A1

公开(公告)日：2005-05-05

申请号：US10983193

申请日：2004-11-05

申请人： Lifeng Wang ,  Sing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

发明人： Lifeng Wang ,  Sing Kang ,  Richard Szeliski ,  Heung-Yeung Shum ,  Baining Guo

IPC分类号： G09G5/00

CPC分类号： G06T11/001

摘要： A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

摘要翻译： 描述用于从场景的多个视图重建最佳纹理图的系统和过程。 实质上，这种重建是基于来自多个源的纹理的最佳合成。 这通常使用基本图像处理理论来实现，以导出用于混合多个视图的正确权重。 即，遵循重构，翘曲，预过滤和重采样的步骤，以便将参考纹理扭曲到期望的位置，并计算用于最佳混合的空间变体权重。 这些权重考虑到纹理投影中的各向异性和由于缩短引起的采样频率的变化。 权重相结合，最优纹理的计算被视为恢复问题，其涉及求解线性方程组。 这种方法可以并入各种应用中，例如3D模型的纹理化，通过合成方法的分析，超分辨率技术和视图相关的纹理映射。

公开(公告)号：US6097854A

公开(公告)日：2000-08-01

申请号：US905023

申请日：1997-08-01

申请人： Richard Szeliski ,  Heung-Yeung Shum

发明人： Richard Szeliski ,  Heung-Yeung Shum

IPC分类号： G06T3/40 ,  G06K9/36

CPC分类号： G06K9/209 ,  G06T3/4038 ,  G06K2009/2045

摘要： The system of the invention aligns a set plural overlapping images useful in constructing a mosaic by performing patch-based alignment of the set of overlapping images to produce a set of warped images, performing block adjustment of the set of warped images to produce a set of block-adjusted images, and then performing pair-wise motion-based local warping of the set of block-adjusted images.

摘要翻译： 本发明的系统通过执行重叠图像集合的基于图像的对齐来产生一组翘曲图像，对组合的翘曲图像执行块调整以产生一组 块调整后的图像，然后对块调整后的图像进行成对的基于运动的局部翘曲。

公开(公告)号：US6009190A

公开(公告)日：1999-12-28

申请号：US905099

申请日：1997-08-01

申请人： Richard Szeliski ,  Heung-Yeung Shum

发明人： Richard Szeliski ,  Heung-Yeung Shum

IPC分类号： G06T3/40 ,  G06T7/00 ,  G06T15/04 ,  G06K9/00 ,  G06K9/36

CPC分类号： G06K9/209 ,  G06T15/04 ,  G06T3/4038 ,  G06T7/0024 ,  G06K2009/2045

摘要： The texture map construction method and apparatus of the invention constructs, from a set of overlapping images, a texture map divisible into plural faces. This is accomplished for each one of the plural faces by computing a texture mapping transform which maps between pixel locations in the texture map and a three-dimensional coordinate system. For each image of the set, an image transform is computed which maps between pixel locations in the image and the three-dimensional coordinate system. For each image of the set, the texture mapping transform and the image transform are combined to produce a texture map-to-image space transform mapping between pixel locations in the image and pixel locations in the texture map. For each one of the pixel locations in the one face of the texture map, the system computes from the texture map-to-image space transform a pixel value of a pixel location in the image corresponding to the one pixel location in the one face of the texture map. This produces a set of image pixel values from the set of overlapping images for the one pixel location in the texture space. Finally, the set of image pixel values are blended to produce a composite pixel value for the one pixel location in the one face of the texture map.

摘要翻译： 本发明的纹理图构造方法和装置从一组重叠图像构造可分割成多个面的纹理图。 这通过计算在纹理映射图中的像素位置和三维坐标系之间映射的纹理映射变换来实现多个面中的每一个面。 对于集合的每个图像，计算在图像中的像素位置和三维坐标系之间映射的图像变换。 对于集合的每个图像，组合纹理映射变换和图像变换以在图像中的像素位置和纹理映射中的像素位置之间产生纹理映射到图像空间变换映射。 对于纹理映射的一个面中的每个像素位置，系统从纹理映射到图像空间中计算对应于一个像素中的一个像素位置的图像中的像素位置的像素值 纹理贴图。 这从纹理空间中的一个像素位置的重叠图像集合产生一组图像像素值。 最后，将该组图像像素值混合以产生纹理图的一个面中的一个像素位置的复合像素值。

公开(公告)号：US6157747A

公开(公告)日：2000-12-05

申请号：US904922

申请日：1997-08-01

申请人： Richard Szeliski ,  Heung-Yeung Shum

发明人： Richard Szeliski ,  Heung-Yeung Shum

IPC分类号： G06T3/00 ,  G06K9/36

CPC分类号： G06K9/209 ,  G06K9/32 ,  G06T3/0081 ,  G06T3/4038 ,  G06K2009/2045

摘要： The invention aligns a set of plural images to construct a mosaic image. At least different pairs of the images overlap partially (or fully), and typically are images captured by a camera looking at the same scene but oriented at different angles from approximately the same location or similar locations. In order to align one of the images with another one of the images, the following steps are carried out: (a) determining a difference error between the one image and the other image; (b) computing an incremental rotation of the one image relative to a 3-dimensional coordinate system through an incremental angle which tends to reduce the difference error; and (c) rotating the one image in accordance with the incremental rotation to produce an incrementally warped version of the one image. As long as the difference error remains significant, the method continues by re-performing the foregoing determining, computing and rotating steps but this time with the incrementally warped version of the one image.

摘要翻译： 本发明对齐一组多个图像以构建马赛克图像。 至少不同的图像对部分地（或完全）重叠，并且通常是由相机看到的相机拍摄的图像，但是定位在与大致相同的位置或相似位置不同的角度。 为了使图像中的一个与另一个图像对准，执行以下步骤：（a）确定一个图像和另一个图像之间的差异误差; （b）通过倾向于减小差异误差的增量角计算一幅图像相对于三维坐标系的增量旋转; 和（c）根据增量旋转旋转一个图像以产生一个图像的递增翘曲版本。 只要差异误差保持显着，该方法通过重新执行上述确定，计算和旋转步骤而继续，但是这一次随着一个图像的递增翘曲版本。

公开(公告)号：US5987164A

公开(公告)日：1999-11-16

申请号：US904921

申请日：1997-08-01

申请人： Richard Szeliski ,  Heung-Yeung Shum

发明人： Richard Szeliski ,  Heung-Yeung Shum

IPC分类号： G06T3/40 ,  G06T7/00 ,  G06K9/00 ,  G06K9/36

CPC分类号： G06T7/0028 ,  G06K9/209 ,  G06T3/4038 ,  G06K2009/2045

摘要： The invention is embodied in a block adjustment method and apparatus which simultaneously aligns a set of overlapping images in order to construct an image mosaic. For each one of the images of the set, the invention performs the alignment by determining ray directions relative to a 3-dimensional coordinate system at plural predetermined pixel locations in the one image. For each one of the plural pixel locations in the one image, ray directions are determined relative to the 3-dimensional coordinate system of the corresponding pixel location in each one of the other images overlapping the one predetermined pixel location of the one image. Then, incremental deformations of the overlapping images are computed which simultaneously minimize differences between the ray directions of plural pairs of the overlapping images which include the one image. The foregoing is performed for each of the plural predetermined pixel locations of the one image simultaneously. The images are warped in accordance with the incremental deformations and the process is repeated.

摘要翻译： 本发明体现在块调整方法和装置中，其同时对齐一组重叠图像以构建图像拼接。 对于该组的每个图像，本发明通过在一个图像中的多个预定像素位置处确定相对于三维坐标系的光线方向来执行对准。 对于一个图像中的多个像素位置中的每个像素位置，相对于与一个图像的一个预定像素位置重叠的每个其它图像中的对应像素位置的3维坐标系确定射线方向。 然后，计算重叠图像的增量变形，其同时使包括一个图像的多对重叠图像的射线方向之间的差异最小化。 对于一个图像的多个预定像素位置中的每一个同时进行上述。 图像根据增量变形而变形，重复该过程。