Multi-Stage Linear Structure from Motion
    1.
    发明申请
    Multi-Stage Linear Structure from Motion 有权
    来自运动的多级线性结构

    公开(公告)号:US20110311104A1

    公开(公告)日:2011-12-22

    申请号:US12817216

    申请日:2010-06-17

    IPC分类号: G06T7/60

    摘要: Described is a linear structure from motion technique that is scalable, parallelizable, treats images equally, and is robust to outliers, without requiring intermediate bundle adjustment. Camera rotations for images are estimated using feature point correspondence and vanishing points matched across the images. The camera rotation data is fed into a linear system for structure and translation estimation that removes outliers and provides output data corresponding to structure from motion parameters. The data may be used in further optimization e.g. with a final non-linear optimization stage referred to as bundle adjustment to provide final refined structure from motion parameters.

    摘要翻译: 描述了来自运动技术的线性结构,其是可扩展的,可并行化的,平均地对待图像,并且对异常值是鲁棒的,而不需要中间束调整。 图像的相机旋转使用特征点对应和跨图像匹配的消失点进行估计。 相机旋转数据被馈送到用于结构和平移估计的线性系统中,其消除异常值并提供对应于运动参数的结构的输出数据。 数据可以用于进一步的优化,例如 最终的非线性优化阶段被称为束调整,以从运动参数提供最终的精细结构。

    Multi-stage linear structure from motion
    2.
    发明授权
    Multi-stage linear structure from motion 有权
    多级线性结构从运动

    公开(公告)号:US08837811B2

    公开(公告)日:2014-09-16

    申请号:US12817216

    申请日:2010-06-17

    IPC分类号: G06K9/00 G06T7/00

    摘要: Described is a linear structure from motion technique that is scalable, parallelizable, treats images equally, and is robust to outliers, without requiring intermediate bundle adjustment. Camera rotations for images are estimated using feature point correspondence and vanishing points matched across the images. The camera rotation data is fed into a linear system for structure and translation estimation that removes outliers and provides output data corresponding to structure from motion parameters. The data may be used in further optimization e.g. with a final non-linear optimization stage referred to as bundle adjustment to provide final refined structure from motion parameters.

    摘要翻译: 描述了来自运动技术的线性结构,其是可扩展的,可并行化的,平均地对待图像,并且对异常值是鲁棒的,而不需要中间束调整。 图像的相机旋转使用特征点对应和跨图像匹配的消失点进行估计。 相机旋转数据被馈送到用于结构和平移估计的线性系统中,其消除异常值并提供对应于运动参数的结构的输出数据。 数据可以用于进一步的优化,例如 最终的非线性优化阶段被称为束调整,以从运动参数提供最终的精细结构。

    System and method for extracting reflection and transparency layers from multiple images
    4.
    发明授权
    System and method for extracting reflection and transparency layers from multiple images 有权
    从多个图像中提取反射和透明层的系统和方法

    公开(公告)号:US07590265B2

    公开(公告)日:2009-09-15

    申请号:US11242204

    申请日:2005-10-01

    IPC分类号: G06K9/00

    CPC分类号: H04N19/53 G06T7/215

    摘要: The present invention is embodied in a system and method for extracting structure from multiple images of a scene by representing the scene as a group of image layers, including reflection and transparency layers. In general, the present invention performs layer extraction from multiple images containing reflections and transparencies. The present invention includes an optimal approach for recovering layer images and their associated motions from an arbitrary number of composite images. The present invention includes image formation equations, the constrained least squares technique used to recover the component images, a novel method to estimate upper and lower bounds on the solution using min- and max-composites, and a motion refinement method.

    摘要翻译: 本发明体现在一种用于通过将场景表示为包括反射和透明层的图像层的组来从场景的多个图像提取结构的系统和方法。 通常,本发明从包含反射和透明度的多个图像中执行层提取。 本发明包括从任意数量的合成图像中恢复层图像及其相关运动的最佳方法。 本发明包括图像形成方程,用于恢复分量图像的约束最小二乘法技术,使用最小和最大复合材料估计解的上限和下限的新方法,以及运动细化方法。

    Region-based image denoising
    5.
    发明授权
    Region-based image denoising 有权
    基于区域的图像去噪

    公开(公告)号:US07587099B2

    公开(公告)日:2009-09-08

    申请号:US11340969

    申请日:2006-01-27

    IPC分类号: G06K9/40 G06K9/00

    摘要: An “Image Denoiser” provides a probabilistic process for denoising color images by segmenting an input image into regions, estimating statistics within each region, and then estimating a clean (or denoised) image using a probabilistic model of image formation. In one embodiment, estimated blur between each region is used to reduce artificial sharpening of region boundaries resulting from denoising the input image. In further embodiments, the estimated blur is used for additional purposes, including sharpening edges between one or more regions, and selectively blurring or sharpening one or more specific regions of the image (i.e., “selective focus”) while maintaining the original blurring between the various regions.

    摘要翻译: “图像去噪器”提供了通过将输入图像分割成区域来去除彩色图像的概率过程,估计每个区域内的统计量,然后使用图像形成的概率模型来估计干净(或去噪)图像。 在一个实施例中,使用每个区域之间的估计模糊来减少由于对输入图像的去噪而导致的区域边界的人造锐化。 在另外的实施例中,估计的模糊被用于额外的目的,包括在一个或多个区域之间锐化边缘,以及选择性地模糊或锐化图像的一个或多个特定区域(即,“选择性聚焦”),同时保持原始模糊 各地区。

    Panoramic video
    6.
    发明授权
    Panoramic video 有权
    全景视频

    公开(公告)号:US06788333B1

    公开(公告)日:2004-09-07

    申请号:US09611646

    申请日:2000-07-07

    IPC分类号: H04N700

    摘要: A system and process for generating a panoramic video. Essentially, the panoramic video is created by first acquiring multiple videos of the scene being depicted. Preferably, these videos collectively depict a full 360 degree view of the surrounding scene and are captured using a multiple camera rig. The acquisition phase also includes a calibration procedure that provides information about the camera rig used to capture the videos that is used in the next phase for creating the panoramic video. This next phase, which is referred to as the authoring phase, involves mosaicing or stitching individual frames of the videos, which were captured at approximately the same moment in time, to form each frame of the panoramic video. A series of texture maps are then constructed for each frame of the panoramic video. Each texture map coincides with a portion of a prescribed environment model of the scene. The texture map representations of each frame of the panoramic video are encoded so as to facilitate their transfer and viewing. This can include compressing the panoramic video frames. Such a procedure is useful in applications where the panoramic video is to be transferred over a network, such as the Internet.

    摘要翻译: 用于生成全景视频的系统和过程。 本质上,通过首先获取所描绘的场景的多个视频来创建全景视频。 优选地,这些视频共同地描绘了周围场景的完整360度视图,并且使用多个相机钻机来捕获。 采集阶段还包括一个校准程序,该程序提供有关用于捕获下一阶段中用于创建全景视频的视频的摄像机的信息。 这个下一个阶段(被称为创作阶段)涉及拼接或缝合在大约相同的时刻被捕获的视频的各个帧,以形成全景视频的每个帧。 然后为全景视频的每个帧构建一系列纹理贴图。 每个纹理贴图与场景的规定环境模型的一部分重合。 对全景视频的每个帧的纹理映射表示进行编码,以便于它们的传送和观看。 这可以包括压缩全景视频帧。 这样的程序在通过诸如因特网的网络传输全景视频的应用中是有用的。

    System and process for improving the uniformity of the exposure and tone of a digital image
    7.
    发明授权
    System and process for improving the uniformity of the exposure and tone of a digital image 失效
    用于改善数字图像曝光和色调均匀性的系统和过程

    公开(公告)号:US06687400B1

    公开(公告)日:2004-02-03

    申请号:US09334860

    申请日:1999-06-16

    IPC分类号: G06K900

    CPC分类号: H04N5/235

    摘要: A system and method for manipulating a set of images of a static scene captured at different exposures (i.e., “bracketed” images) to yield a composite image with improved uniformity in exposure and tone. In general, the aforementioned goal can be achieved by analyzing a set of bracketed images using a multi-dimensional histogram and merging the images via an approach that projects pixels onto a curve that fits the data. However, it has been found that the desired composite image can be produced in a simpler manner by summing the pixel brightness levels across the multiple images, followed by an equalization process. One possible equalization process involves simply averaging the summed pixel brightness values by dividing the summed value of each pixel set (i.e., groups of corresponding pixels from the bracketed images) by the number of bracketed images. An even better result can be achieved using a histogram equalization process. In essence, this histogram equalization involves creating a count of the number of pixels sets having the same summed brightness level. From this count, a cumulative distribution function is computed and normalized to a maximum value corresponding to the maximum summed brightness level. The cumulative distribution function is then used to determine new pixel brightness levels for use in generating the composite image.

    摘要翻译: 一种用于操纵在不同曝光(即,“括号”的图像)处拍摄的静态场景的一组图像以产生具有改善的曝光和色调均匀性的合成图像的系统和方法。 通常,可以通过使用多维直方图分析一组括号图像并通过将像素投影到适合数据的曲线上的方法来合并图像来实现上述目标。 然而,已经发现,可以通过对多个图像之间的像素亮度等级进行求和,然后进行均衡处理,以更简单的方式产生期望的合成图像。 一个可能的均衡处理涉及通过将每个像素组(即,来自括号的图像的相应像素的组)的相加值除以包围的图像的数量来简单地对相加的像素亮度值进行平均。 使用直方图均衡过程可以获得更好的结果。 实质上,该直方图均衡涉及产生具有相同的相加亮度水平的像素集合的数量的计数。 从该计数,计算累积分布函数并将其归一化为对应于最大相加亮度水平的最大值。 然后累积分布函数用于确定用于生成合成图像的新像素亮度级别。

    Method and system for digital plenoptic imaging
    8.
    发明授权
    Method and system for digital plenoptic imaging 失效
    数字全景成像方法与系统

    公开(公告)号:US6023523A

    公开(公告)日:2000-02-08

    申请号:US885259

    申请日:1997-06-30

    CPC分类号: G06T15/50 G06T15/06

    摘要: A computer-based method and system for digital 3-dimensional imaging of an object which allows for viewing images of the object from arbitrary vantage points. The system, referred to as the Lumigraph system, collects a complete appearance of either a synthetic or real object (or a scene), stores a representation of the appearance, and uses the representation to render images of the object from any vantage point. The appearance of an object is a collection of light rays that emanate from the object in all directions. The system stores the representation of the appearance as a set of coefficients of a 4-dimensional function, referred to as the Lumigraph function. From the Lumigraph function with these coefficients, the Lumigraph system can generate 2-dimensional images of the object from any vantage point. The Lumigraph system generates an image by evaluating the Lumigraph function to identify the intensity values of light rays that would emanate from the object to form the image. The Lumigraph system then combines these intensity values to form the image.

    摘要翻译: 一种用于对象的数字三维成像的基于计算机的方法和系统,其允许从任意有利位置观看对象的图像。 称为Lumigraph系统的系统收集合成或实物(或场景)的完整外观,存储外观的表示,并使用该表示从任何优势点呈现对象的图像。 物体的外观是从各个方向从物体发出的光线的集合。 该系统将外观的表示存储为称为Lumigraph函数的四维函数的一组系数。 从具有这些系数的Lumigraph函数,Lumigraph系统可以从任何有利位置生成对象的二维图像。 Lumigraph系统通过评估Lumigraph函数来生成图像,以识别从物体发出的形成图像的光线的强度值。 然后,Lumigraph系统将这些强度值组合以形成图像。

    Hardware assisted image deblurring
    9.
    发明授权
    Hardware assisted image deblurring 有权
    硬件辅助图像去模糊

    公开(公告)号:US08264553B2

    公开(公告)日:2012-09-11

    申请号:US12616782

    申请日:2009-11-12

    IPC分类号: H04N5/228 G06K9/40

    摘要: The described implementations relate to deblurring images. One system includes an imaging device configured to capture an image, a linear motion detector and a rotational motion detector. This system also includes a controller configured to receive a signal from the imaging device relating to capture of the image and to responsively cause the linear motion detector and the rotational motion detector to detect motion-related information. Finally, this particular system includes a motion calculator configured to recover camera motion associated with the image based upon the detected motion-related information and to infer imaging device motion induced blur of the image and an image deblurring component configured to reduce imaging device induced blur from the image utilizing the inferred camera motion induced blur.

    摘要翻译: 所描述的实现涉及去模糊图像。 一个系统包括被配置为捕获图像的成像装置,线性运动检测器和旋转运动检测器。 该系统还包括控制器,其被配置为从成像装置接收与捕获图像有关的信号,并且响应地使线性运动检测器和旋转运动检测器检测运动相关信息。 最后,该特定系统包括运动计算器,该运动计算器被配置为基于检测到的运动相关信息来恢复与图像相关联的摄像机运动,并且推断图像的成像装置运动引起的模糊,以及被配置成减少成像装置引起的模糊的图像去模糊部件 该图像利用推测的相机运动引起的模糊。