System and Method for Classifying the Blur State of Digital Image Pixels
    1.
    发明申请
    System and Method for Classifying the Blur State of Digital Image Pixels 有权
    用于分类数字图像像素的模糊状态的系统和方法

    公开(公告)号:US20130129233A1

    公开(公告)日:2013-05-23

    申请号:US12956996

    申请日:2010-11-30

    IPC分类号: G06K9/74

    摘要: A blur classification module may compute the probability that a given pixel in a digital image was blurred using a given two-dimensional blur kernel, and may store the computed probability in a blur classification probability matrix that stores probability values for all combinations of image pixels and the blur kernels in a set of likely blur kernels. Computing these probabilities may include computing a frequency power spectrum for windows into the digital image and/or for the likely blur kernels. The blur classification module may generate a coherent mapping between pixels of the digital image and respective blur states, or may perform a segmentation of the image into blurry and sharp regions, dependent on values stored in the matrix. Input image data may be pre-processed. Blur classification results may be employed in image editing operations to automatically target image subjects or background regions, or to estimate the depth of image elements.

    摘要翻译: 模糊分类模块可以使用给定的二维模糊核心来计算数字图像中的给定像素模糊的概率,并且可以将所计算的概率存储在模糊分类概率矩阵中,所述模糊分类概率矩阵存储图像像素的所有组合的概率值, 一组可能的模糊内核中的模糊内核。 计算这些概率可以包括计算窗口进入数字图像和/或可能的模糊内核的频率功率谱。 模糊分类模块可以产生数字图像的像素和相应的模糊状态之间的相干映射,或者可以根据存储在矩阵中的值来执行图像到模糊和锐利区域的分割。 可以预处理输入图像数据。 可以在图像编辑操作中使用模糊分类结果来自动对象图像对象或背景区域,或者估计图像元素的深度。

    System and method for classifying the blur state of digital image pixels
    2.
    发明授权
    System and method for classifying the blur state of digital image pixels 有权
    用于分类数字图像像素的模糊状态的系统和方法

    公开(公告)号:US08503801B2

    公开(公告)日:2013-08-06

    申请号:US12956996

    申请日:2010-11-30

    IPC分类号: G06K9/62

    摘要: A blur classification module may compute the probability that a given pixel in a digital image was blurred using a given two-dimensional blur kernel, and may store the computed probability in a blur classification probability matrix that stores probability values for all combinations of image pixels and the blur kernels in a set of likely blur kernels. Computing these probabilities may include computing a frequency power spectrum for windows into the digital image and/or for the likely blur kernels. The blur classification module may generate a coherent mapping between pixels of the digital image and respective blur states, or may perform a segmentation of the image into blurry and sharp regions, dependent on values stored in the matrix. Input image data may be pre-processed. Blur classification results may be employed in image editing operations to automatically target image subjects or background regions, or to estimate the depth of image elements.

    摘要翻译: 模糊分类模块可以使用给定的二维模糊核心来计算数字图像中的给定像素模糊的概率,并且可以将所计算的概率存储在模糊分类概率矩阵中,所述模糊分类概率矩阵存储图像像素的所有组合的概率值, 一组可能的模糊内核中的模糊内核。 计算这些概率可以包括计算窗口进入数字图像和/或可能的模糊内核的频率功率谱。 模糊分类模块可以产生数字图像的像素和相应的模糊状态之间的相干映射,或者可以根据存储在矩阵中的值来执行图像到模糊和锐利区域的分割。 可以预处理输入图像数据。 可以在图像编辑操作中使用模糊分类结果来自动对象图像对象或背景区域,或者估计图像元素的深度。

    System and method for estimating spatially varying defocus blur in a digital image
    3.
    发明授权
    System and method for estimating spatially varying defocus blur in a digital image 有权
    用于估计数字图像中的空间变化的散焦模糊的系统和方法

    公开(公告)号:US08885941B2

    公开(公告)日:2014-11-11

    申请号:US13562618

    申请日:2012-07-31

    摘要: An image editing application (or a blur classification module thereof) may automatically estimate a coherent defocus blur map from a single input image. The application may represent the blur spectrum as a differentiable function of radius r, and the optimal radius may be estimated by optimizing the likelihood function through a gradient descent algorithm. The application may generate the spectrum function over r through polynomial-based fitting. After fitting, the application may generate look-up tables to store values for the spectrum and for its first and second order derivatives, respectively. The use of these tables in the likelihood optimization process may significantly reduce the computational costs of a given blur estimation exercise. The application may minimize an energy function that includes a data term, a smoothness term, and a smoothness parameter that is adaptive to local image content. The output blur map may be used for image object depth estimation.

    摘要翻译: 图像编辑应用(或其模糊分类模块)可以从单个输入图像自动估计相干散焦模糊图。 应用可以将模糊光谱表示为半径r的可微分函数,并且可以通过梯度下降算法优化似然函数来估计最佳半径。 该应用可以通过基于多项式的拟合来生成基于r的频谱函数。 在拟合之后,应用程序可以生成查找表以分别存储频谱的值和其第一和第二阶导数。 在可能性优化过程中使用这些表可以显着降低给定模糊估计练习的计算成本。 应用可以最小化能量函数,其包括适应于局部图像内容的数据项,平滑度项和平滑度参数。 输出模糊图可以用于图像对象深度估计。

    Stereo-aware image editing
    4.
    发明授权
    Stereo-aware image editing 有权
    立体感觉图像编辑

    公开(公告)号:US09098930B2

    公开(公告)日:2015-08-04

    申请号:US13629309

    申请日:2012-09-27

    IPC分类号: G06T17/00 G06T19/00 H04N13/02

    摘要: Embodiments of methods and systems for stereo-aware image editing are described. A three-dimensional model of a stereo scene is built from one or more input images. Camera parameters for the input images are computed. The three-dimensional model is modified. In some embodiments, the modifying the three-dimensional model includes modifying one or more of the images and applying results of the modifying one or more of the images to corresponding model vertices. The scene is re-rendered from the camera parameters to produce an edited stereo pair that is consistent with the three-dimensional model.

    摘要翻译: 描述了用于立体感知图像编辑的方法和系统的实施例。 一个立体场景的三维模型是由一个或多个输入图像构成的。 计算输入图像的相机参数。 修改三维模型。 在一些实施例中,修改三维模型包括修改一个或多个图像并将修改一个或多个图像的结果应用于对应的模型顶点。 从相机参数重新渲染场景,以产生与三维模型一致的编辑立体声对。

    Object Selection in Stereo Image Pairs
    5.
    发明申请
    Object Selection in Stereo Image Pairs 有权
    立体图像对中的对象选择

    公开(公告)号:US20130127824A1

    公开(公告)日:2013-05-23

    申请号:US13193303

    申请日:2011-07-28

    IPC分类号: G06T15/00

    摘要: A method is disclosed. Input data indicates a location within a region of a digital image of a stereo image pair. A boundary of the region and a corresponding boundary of a corresponding region of another digital image are defined based on the input data, content of the digital image, and content of the another digital image. The boundary and the corresponding boundary represent boundaries of a visual feature in the digital image and the other digital image. The defining further includes constructing a probability distribution for the digital image and another probability distribution for the other digital image. The probability distribution for the digital image represents a probability that each pixel of a set of pixels of the digital image is within the region. The other probability distribution represents a probability that each pixel of another set of pixels of the another digital image is within the corresponding region.

    摘要翻译: 公开了一种方法。 输入数据表示立体图像对的数字图像的区域内的位置。 基于输入数据,数字图像的内容和另一数字图像的内容来定义区域的边界和另一数字图像的对应区域的对应边界。 边界和相应的边界表示数字图像和其他数字图像中视觉特征的边界。 该定义还包括构建数字图像的概率分布和另一数字图像的另一概率分布。 数字图像的概率分布表示数字图像的一组像素的每个像素在该区域内的概率。 其他概率分布表示另一数字图像的另一组像素的每个像素在相应区域内的概率。

    High-Quality Denoising of an Image Sequence
    6.
    发明申请
    High-Quality Denoising of an Image Sequence 有权
    图像序列的高质量去噪

    公开(公告)号:US20130071041A1

    公开(公告)日:2013-03-21

    申请号:US13481491

    申请日:2012-05-25

    IPC分类号: G06K9/40

    摘要: A method, system, and computer-readable storage medium are disclosed for denoising an image sequence. A first patch is determined in a first frame in an image sequence comprising a plurality of frames. The first patch comprises a subset of image data in the first frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames. One or more neighboring related patches are determined for each of the plurality of corresponding patches in a same frame as the respective one of the corresponding patches. A denoised first patch is generated by averaging image data in the one or more neighboring related patches in the neighboring set of the plurality of frames.

    摘要翻译: 公开了一种用于对图像序列进行去噪的方法,系统和计算机可读存储介质。 在包括多个帧的图像序列中的第一帧中确定第一贴片。 第一贴片包括第一帧中的图像数据的子集。 在多个帧的相邻集合中确定多个对应的片段的位置。 在与相应的补丁相应的一个相同的帧中,为多个对应的补丁中的每一个确定一个或多个相邻的相关补丁。 通过对多个帧的相邻集合中的一个或多个相邻相关片段中的图像数据进行平均来生成去噪的第一贴片。

    High-Quality Upscaling of an Image Sequence
    7.
    发明申请
    High-Quality Upscaling of an Image Sequence 有权
    高质量的图像序列升序

    公开(公告)号:US20130071040A1

    公开(公告)日:2013-03-21

    申请号:US13481477

    申请日:2012-05-25

    IPC分类号: G06K9/36

    摘要: A method, system, and computer-readable storage medium are disclosed for upscaling an image sequence. An upsampled frame is generated based on an original frame in an original image sequence comprising a plurality of frames. A smoothed image sequence is generated based on the original image sequence. A plurality of patches are determined in the upsampled frame. Each patch comprises a subset of image data in the upsampled frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames in the smoothed image sequence. A plurality of high-frequency patches are generated. Each high-frequency patch is based on image data at the locations of the corresponding patches in the original image sequence. The plurality of high-frequency patches are added to the upsampled frame to generate a high-quality upscaled frame.

    摘要翻译: 公开了一种用于升高图像序列的方法,系统和计算机可读存储介质。 基于包括多个帧的原始图像序列中的原始帧生成上采样帧。 基于原始图像序列生成平滑的图像序列。 在上采样帧中确定多个补丁。 每个贴片包括上采样帧中的图像数据的子集。 在平滑图像序列中的多个帧的相邻集合中确定多个对应的片段的位置。 产生多个高频补丁。 每个高频片基于原始图像序列中相应片段位置处的图像数据。 将多个高频贴片添加到上采样帧以产生高质量的放大的帧。

    Methods and apparatus for robust rigid and non-rigid motion tracking
    8.
    发明授权
    Methods and apparatus for robust rigid and non-rigid motion tracking 有权
    用于坚固刚体和非刚性运动跟踪的方法和装置

    公开(公告)号:US08320620B1

    公开(公告)日:2012-11-27

    申请号:US12549126

    申请日:2009-08-27

    申请人: Scott D. Cohen

    发明人: Scott D. Cohen

    IPC分类号: G06K9/00

    摘要: Methods and apparatus for robust rigid and non-rigid motion tracking. An image, a next image, and a mask corresponding to an area in the image may be obtained. The area includes a plurality of points; each point indicates a location of the point in a position space and a color of the point in a color space. An iterative closest point algorithm may be applied that iteratively computes correspondences from a transformation and computes a new transformation from the correspondences. The algorithm tracks motion of the area in the image between the image and the next image. The algorithm matches points indicated by the mask to points in the next image in both position space and color space. An indication of an area in the next image that corresponds to the area in the image as tracked by the algorithm is generated.

    摘要翻译: 用于坚固刚体和非刚性运动跟踪的方法和装置。 可以获得与图像中的区域对应的图像,下一图像和掩模。 该区域包括多个点; 每个点表示位置空间中的点的位置和颜色空间中的点的颜色。 可以应用迭代最近点算法,其迭代地计算来自变换的对应关系,并从对应关系计算新的变换。 该算法跟踪图像和下一图像之间的图像中的区域的运动。 该算法将掩模指示的点与位置空间和颜色空间中的下一个图像中的点相匹配。 生成与算法跟踪的图像中的区域对应的下一图像中的区域的指示。

    Live coherent image selection to differentiate foreground and background pixels
    9.
    发明授权
    Live coherent image selection to differentiate foreground and background pixels 有权
    实时相干图像选择以区分前景和背景像素

    公开(公告)号:US08050498B2

    公开(公告)日:2011-11-01

    申请号:US11517189

    申请日:2006-09-06

    IPC分类号: G06K9/34 G06K9/00

    CPC分类号: G06T7/162 G06T7/12 G06T7/194

    摘要: Methods, systems, and apparatus, including computer program products, featuring receiving user input defining a sample of pixels from an image, the image being defined by a raster of pixels. While receiving the user input, the following actions are performed one or more times: pixels are coherently classified in the raster of pixels as being foreground or background based on the sample of pixels; and a rendering of the image is updated on a display to depict classified foreground pixels and background pixels as the sample is being defined.

    摘要翻译: 方法,系统和装置,包括计算机程序产品,其特征在于接收用户输入定义来自图像的像素样本,所述图像由像素光栅定义。 在接收用户输入时,执行以下动作一次或多次:基于像素样本,像素被相干地分类为像素的光栅作为前景或背景; 并且在显示器上更新图像的呈现以描绘正在定义样本的分类的前景像素和背景像素。

    Identifying one or more objects within an image
    10.
    发明授权
    Identifying one or more objects within an image 有权
    识别图像中的一个或多个对象

    公开(公告)号:US07805003B1

    公开(公告)日:2010-09-28

    申请号:US10716782

    申请日:2003-11-18

    IPC分类号: G06K9/34 G06K9/00

    CPC分类号: G06K9/00463

    摘要: Methods and apparatus, including computer program products, implementing techniques for identifying one or more objects within an image. The techniques include receiving an image that includes at least one object; identifying a plurality of edge pixels in the image, an edge pixel being a pixel that borders two contrasting areas of the image, the plurality of edge pixels including both inner edge pixels and outer edge pixels; and finding a substantially connected component correlated with each object, the substantially connected component comprising a set of the edge pixels that are connected by traversing substantially only edge pixels.

    摘要翻译: 方法和装置,包括计算机程序产品,用于识别图像内的一个或多个对象的技术。 所述技术包括接收包括至少一个对象的图像; 识别图像中的多个边缘像素,边缘像素是与图像的两个对比区域相邻的像素,所述多个边缘像素包括内边缘像素和外边缘像素; 并且找到与每个对象相关联的基本连接的分量,所述基本连接的分量包括通过遍历基本上仅边缘像素而连接的一组边缘像素。