System and method for extracting reflection and transparency layers from multiple images

    公开(公告)号:US20060056682A1

    公开(公告)日:2006-03-16

    申请号:US11242204

    申请日:2005-10-01

    IPC分类号: G06K9/00

    CPC分类号: H04N19/53 G06T7/215

    摘要: The present invention is embodied in a system and method for extracting structure from multiple images of a scene by representing the scene as a group of image layers, including reflection and transparency layers. In general, the present invention performs layer extraction from multiple images containing reflections and transparencies. The present invention includes an optimal approach for recovering layer images and their associated motions from an arbitrary number of composite images. The present invention includes image formation equations, the constrained least squares technique used to recover the component images, a novel method to estimate upper and lower bounds on the solution using min- and max-composites, and a motion refinement method.

    System and process for optimal texture map reconstruction from multiple views

    公开(公告)号:US06999095B2

    公开(公告)日:2006-02-14

    申请号:US10983193

    申请日:2004-11-05

    IPC分类号: G09G5/00

    CPC分类号: G06T11/001

    摘要: A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

    System and process for optimal texture map reconstruction from multiple views

    公开(公告)号:US06825850B2

    公开(公告)日:2004-11-30

    申请号:US10283562

    申请日:2002-10-30

    IPC分类号: G09G500

    CPC分类号: G06T11/001

    摘要: A system and process for reconstructing optimal texture maps from multiple views of a scene is described. In essence, this reconstruction is based on the optimal synthesis of textures from multiple sources. This is generally accomplished using basic image processing theory to derive the correct weights for blending the multiple views. Namely, the steps of reconstructing, warping, prefiltering, and resampling are followed in order to warp reference textures to a desired location, and to compute spatially-variant weights for optimal blending. These weights take into consideration the anisotropy in the texture projection and changes in sampling frequency due to foreshortening. The weights are combined and the computation of the optimal texture is treated as a restoration problem, which involves solving a linear system of equations. This approach can be incorporated in a variety of applications, such as texturing of 3D models, analysis by synthesis methods, super-resolution techniques, and view-dependent texture mapping.

    Methods and apparatus for storing, accessing and processing images
through the use of row and column pointers
    84.
    发明授权
    Methods and apparatus for storing, accessing and processing images through the use of row and column pointers 失效
    通过使用行和列指针来存储,访问和处理图像的方法和装置

    公开(公告)号:US6075545A

    公开(公告)日:2000-06-13

    申请号:US960510

    申请日:1997-10-29

    IPC分类号: G06T1/60 G06F12/06

    CPC分类号: G06T1/60

    摘要: Methods and apparatus for storing, accessing, and processing information representing images through the use of row and column pointers are described. By manipulating and/or generating new sets of row and column pointers, many image processing operations can be performed without the need to access or copy the original image data. Padding, enlargement and reduction operations are examples of image processing operations that can be performed virtually. A logical image is created as the result of a virtual image processing operation. In order to permit the fast and efficient access of the image data which represents the logical image, the logical image is divided into safe and unsafe logical image regions. In a safe logical image region, data representing the image is regularly spaced in memory and may be accessed using a first relatively fast and efficient memory access technique. In unsafe logical image regions, the data representing the logical image is not regularly spaced in memory and is accessed using a second memory access technique that uses both the row and column pointers associated with the unsafe image region. The methods and apparatus of the present invention allow many image processing operations to be performed using less memory and/or by performing fewer computations than conventional image processing techniques.

    摘要翻译: 描述了通过使用行和列指针来存储,访问和处理表示图像的信息的方法和装置。 通过操作和/或生成新的行和列指针集合,可以执行许多图像处理操作,而不需要访问或复制原始图像数据。 填充,放大和缩小操作是可以虚拟执行的图像处理操作的示例。 作为虚拟图像处理操作的结果,创建逻辑图像。 为了允许代表逻辑图像的图像数据的快速和有效的访问,逻辑图像被划分为安全和不安全的逻辑图像区域。 在安全的逻辑图像区域中,表示图像的数据在存储器中规则地间隔开,并且可以使用第一相对快速和有效的存储器访问技术来访问。 在不安全的逻辑图像区域中,表示逻辑图像的数据在存储器中不规则地间隔,并且使用使用与不安全图像区域相关联的行和列指针的第二存储器访问技术进行访问。 本发明的方法和装置允许使用较少的存储器和/或通过执行比常规图像处理技术更少的计算来执行许多图像处理操作。

    Deghosting method and apparatus for construction of image mosaics
    85.
    发明授权
    Deghosting method and apparatus for construction of image mosaics 失效
    图像马赛克构造的脱色方法和装置

    公开(公告)号:US5986668A

    公开(公告)日:1999-11-16

    申请号:US905103

    申请日:1997-08-01

    IPC分类号: G06T3/40 G06T7/00 G06F15/00

    CPC分类号: G06T7/0028 G06T3/4038

    摘要: The invention is embodied in a deghosting method and apparatus which locally aligns individual images in a set of overlapping images of a mosaic. This is accomplished by determining, at plural predetermined pixel locations of each one of the images, motions between the one image and other images of the set, combining the motions to produce an estimated motion at each of the plural predetermined pixel locations of the one image, and then warping the one image in accordance with the estimated motions. Preferably, it is first which of the images of the set overlies the one image. This determination is made by determining alignment transformations relating the images to a 3-dimensional coordinate system and then inferring mutual overlap between images from the transformations. The images are resampled in accordance with these alignment transformations. The warping of each image is accomplished by constructing a mapping of warped pixel locations from the estimated motions and then resampling the one image at the warped pixel locations. The mapping is preferably a reverse mapping of pixels in an unwarped version of the one image.

    摘要翻译: 本发明体现在以马赛克的重叠图像的集合中的各个图像局部对齐的消反像方法和装置。 这是通过在每个图像的多个预定像素位置处确定一个图像与该组的其他图像之间的运动来组合运动以在一个图像的多个预定像素位置的每一个处产生估计的运动来实现的 ,然后根据估计的动作扭曲一幅图像。 优选地,集合中的哪一个图像覆盖在一个图像上。 通过确定将图像与三维坐标系相关联的对准变换确定,然后推断来自变换的图像之间的相互重叠。 根据这些对准转换重新采样图像。 每个图像的翘曲通过从估计的运动构建翘曲的像素位置的映射,然后在翘曲的像素位置重新采样一个图像来实现。 该映射优选地是该一个图像的不正确版本中的像素的反向映射。

    Three-dimensional object browsing in documents
    86.
    发明授权
    Three-dimensional object browsing in documents 有权
    文件中的三维对象浏览

    公开(公告)号:US09025860B2

    公开(公告)日:2015-05-05

    申请号:US13567105

    申请日:2012-08-06

    IPC分类号: G06K9/00 G06F17/30

    CPC分类号: G06F17/30268

    摘要: A document that includes a representation of a two-dimensional (2-D) image may be obtained. A selection indicator indicating a selection of at least a portion of the 2-D image may be obtained. A match correspondence may be determined between the selected portion of the 2-D image and a three-dimensional (3-D) image object stored in an object database, the match correspondence based on a web crawler analysis result. A 3-D rendering of the 3-D image object that corresponds to the selected portion of the 2-D image may be initiated.

    摘要翻译: 可以获得包括二维(2-D)图像的表示的文档。 可以获得指示选择2-D图像的至少一部分的选择指示符。 可以在2-D图像的所选部分和存储在对象数据库中的三维(3-D)图像对象之间确定匹配对应关系,该匹配对应基于网络爬行器分析结果。 可以启动对应于2-D图像的所选部分的3-D图像对象的3-D渲染。

    Reducing motion-related artifacts in rolling shutter video information
    87.
    发明授权
    Reducing motion-related artifacts in rolling shutter video information 有权
    滚动快门视频信息中减少与运动相关的人为因素

    公开(公告)号:US08358359B2

    公开(公告)日:2013-01-22

    申请号:US12690929

    申请日:2010-01-21

    CPC分类号: G06T5/003 G06T2207/20201

    摘要: A system is described for reducing artifacts produced by a rolling shutter capture technique in the presence of high-frequency motion, e.g., produced by large accelerations or jitter. The system operates by computing low-frequency information based on the motion of points from one frame to the next. The system then uses the low-frequency information to infer the high-frequency motion, e.g., by treating the low-frequency information as known integrals of the unknown underlying high-frequency information. The system then uses the high-frequency information to reduce the presence of artifacts. In effect, the correction aims to re-render video information as though all the pixels in each frame were imaged at the same time using a global shutter technique. An auto-calibration module can estimate the value of a capture parameter, which relates to a time interval between the capture of two subsequent rows of video information.

    摘要翻译: 描述了一种用于在存在高频运动(例如由大的加速度或抖动产生的)的情况下减少由快门拍摄技术产生的假象的系统。 该系统通过基于从一帧到下一帧的点的运动来计算低频信息来进行操作。 然后,系统使用低频信息来推断高频运动,例如通过将低频信息作为未知底层高频信息的已知积分来处理。 然后,系统使用高频信息来减少伪像的存在。 实际上,校正旨在重新渲染视频信息,就像使用全局快门技术同时成像每个帧中的所有像素一样。 自动校准模块可以估计捕获参数的值,其涉及捕获两个后续行的视频信息之间的时间间隔。

    Using photo collections for three dimensional modeling

    公开(公告)号:US08350850B2

    公开(公告)日:2013-01-08

    申请号:US12059794

    申请日:2008-03-31

    IPC分类号: G06T17/00 G06T15/00

    摘要: A collection of photos and a three-dimensional reconstruction of the photos are used to construct and texture a mesh model. In one embodiment, a first digital image of a first view of a real world scene is analyzed to identify lines in the first view. Among the lines, parallel lines are identified. A three-dimensional vanishing direction in a three-dimensional space is determined based on the parallel lines and an orientation of the digital image in the three-dimensional space. A plane is automatically generated by fitting the plane to the vanishing direction. A rendering of a three-dimensional model with the plane is displayed. Three-dimensional points corresponding to features common to the photos may be used to constrain the plane. The photos may be projected onto the model to provide visual feedback when editing the plane. Furthermore, the photos may be used to texture the model.

    Image blending using multi-splines
    89.
    发明授权
    Image blending using multi-splines 有权
    使用多样条的图像混合

    公开(公告)号:US08189959B2

    公开(公告)日:2012-05-29

    申请号:US12104446

    申请日:2008-04-17

    IPC分类号: G06K9/36

    CPC分类号: G06T3/4038

    摘要: Multi-spline image blending technique embodiments are presented which generally employ a separate low-resolution offset field for every image region being blended, rather than a single (piecewise smooth) offset field for all the regions to produce a visually consistent blended image. Each of the individual offset fields is smoothly varying, and so is represented using a low-dimensional spline. A resulting linear system can be rapidly solved because it involves many fewer variables than the number of pixels being blended.

    摘要翻译: 提出了多样条图像混合技术实施例,其通常对于混合的每个图像区域采用单独的低分辨率偏移场,而不是针对所有区域的单个(分段平滑)偏移场,以产生视觉上一致的混合图像。 每个单独的偏移场都是平滑变化的,因此使用低维样条表示。 由此产生的线性系统可以快速解决,因为它涉及比混合像素数少许多的变量。

    Reducing Motion-Related Artifacts in Rolling Shutter Video Information
    90.
    发明申请
    Reducing Motion-Related Artifacts in Rolling Shutter Video Information 有权
    减少滚动快门视频信息中的运动相关人工制品

    公开(公告)号:US20110176043A1

    公开(公告)日:2011-07-21

    申请号:US12690929

    申请日:2010-01-21

    IPC分类号: H04N5/335

    CPC分类号: G06T5/003 G06T2207/20201

    摘要: A system is described for reducing artifacts produced by a rolling shutter capture technique in the presence of high-frequency motion, e.g., produced by large accelerations or jitter. The system operates by computing low-frequency information based on the motion of points from one frame to the next. The system then uses the low-frequency information to infer the high-frequency motion, e.g., by treating the low-frequency information as known integrals of the unknown underlying high-frequency information. The system then uses the high-frequency information to reduce the presence of artifacts. In effect, the correction aims to re-render video information as though all the pixels in each frame were imaged at the same time using a global shutter technique. An auto-calibration module can estimate the value of a capture parameter, which relates to a time interval between the capture of two subsequent rows of video information.

    摘要翻译: 描述了一种用于在存在高频运动(例如由大的加速度或抖动产生的)的情况下减少由快门拍摄技术产生的假象的系统。 该系统通过基于从一帧到下一帧的点的运动来计算低频信息来进行操作。 然后,系统使用低频信息来推断高频运动,例如通过将低频信息作为未知底层高频信息的已知积分来处理。 然后,系统使用高频信息来减少伪像的存在。 实际上,校正旨在重新渲染视频信息,就像使用全局快门技术同时成像每个帧中的所有像素一样。 自动校准模块可以估计捕获参数的值,其涉及捕获两个后续行的视频信息之间的时间间隔。