摘要:
A blur classification module may compute the probability that a given pixel in a digital image was blurred using a given two-dimensional blur kernel, and may store the computed probability in a blur classification probability matrix that stores probability values for all combinations of image pixels and the blur kernels in a set of likely blur kernels. Computing these probabilities may include computing a frequency power spectrum for windows into the digital image and/or for the likely blur kernels. The blur classification module may generate a coherent mapping between pixels of the digital image and respective blur states, or may perform a segmentation of the image into blurry and sharp regions, dependent on values stored in the matrix. Input image data may be pre-processed. Blur classification results may be employed in image editing operations to automatically target image subjects or background regions, or to estimate the depth of image elements.
摘要:
A blur classification module may compute the probability that a given pixel in a digital image was blurred using a given two-dimensional blur kernel, and may store the computed probability in a blur classification probability matrix that stores probability values for all combinations of image pixels and the blur kernels in a set of likely blur kernels. Computing these probabilities may include computing a frequency power spectrum for windows into the digital image and/or for the likely blur kernels. The blur classification module may generate a coherent mapping between pixels of the digital image and respective blur states, or may perform a segmentation of the image into blurry and sharp regions, dependent on values stored in the matrix. Input image data may be pre-processed. Blur classification results may be employed in image editing operations to automatically target image subjects or background regions, or to estimate the depth of image elements.
摘要:
An image editing application (or a blur classification module thereof) may automatically estimate a coherent defocus blur map from a single input image. The application may represent the blur spectrum as a differentiable function of radius r, and the optimal radius may be estimated by optimizing the likelihood function through a gradient descent algorithm. The application may generate the spectrum function over r through polynomial-based fitting. After fitting, the application may generate look-up tables to store values for the spectrum and for its first and second order derivatives, respectively. The use of these tables in the likelihood optimization process may significantly reduce the computational costs of a given blur estimation exercise. The application may minimize an energy function that includes a data term, a smoothness term, and a smoothness parameter that is adaptive to local image content. The output blur map may be used for image object depth estimation.
摘要:
Embodiments of methods and systems for stereo-aware image editing are described. A three-dimensional model of a stereo scene is built from one or more input images. Camera parameters for the input images are computed. The three-dimensional model is modified. In some embodiments, the modifying the three-dimensional model includes modifying one or more of the images and applying results of the modifying one or more of the images to corresponding model vertices. The scene is re-rendered from the camera parameters to produce an edited stereo pair that is consistent with the three-dimensional model.
摘要:
A method is disclosed. Input data indicates a location within a region of a digital image of a stereo image pair. A boundary of the region and a corresponding boundary of a corresponding region of another digital image are defined based on the input data, content of the digital image, and content of the another digital image. The boundary and the corresponding boundary represent boundaries of a visual feature in the digital image and the other digital image. The defining further includes constructing a probability distribution for the digital image and another probability distribution for the other digital image. The probability distribution for the digital image represents a probability that each pixel of a set of pixels of the digital image is within the region. The other probability distribution represents a probability that each pixel of another set of pixels of the another digital image is within the corresponding region.
摘要:
A method, system, and computer-readable storage medium are disclosed for denoising an image sequence. A first patch is determined in a first frame in an image sequence comprising a plurality of frames. The first patch comprises a subset of image data in the first frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames. One or more neighboring related patches are determined for each of the plurality of corresponding patches in a same frame as the respective one of the corresponding patches. A denoised first patch is generated by averaging image data in the one or more neighboring related patches in the neighboring set of the plurality of frames.
摘要:
A method, system, and computer-readable storage medium are disclosed for upscaling an image sequence. An upsampled frame is generated based on an original frame in an original image sequence comprising a plurality of frames. A smoothed image sequence is generated based on the original image sequence. A plurality of patches are determined in the upsampled frame. Each patch comprises a subset of image data in the upsampled frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames in the smoothed image sequence. A plurality of high-frequency patches are generated. Each high-frequency patch is based on image data at the locations of the corresponding patches in the original image sequence. The plurality of high-frequency patches are added to the upsampled frame to generate a high-quality upscaled frame.
摘要:
Methods and apparatus for robust rigid and non-rigid motion tracking. An image, a next image, and a mask corresponding to an area in the image may be obtained. The area includes a plurality of points; each point indicates a location of the point in a position space and a color of the point in a color space. An iterative closest point algorithm may be applied that iteratively computes correspondences from a transformation and computes a new transformation from the correspondences. The algorithm tracks motion of the area in the image between the image and the next image. The algorithm matches points indicated by the mask to points in the next image in both position space and color space. An indication of an area in the next image that corresponds to the area in the image as tracked by the algorithm is generated.
摘要:
Methods, systems, and apparatus, including computer program products, featuring receiving user input defining a sample of pixels from an image, the image being defined by a raster of pixels. While receiving the user input, the following actions are performed one or more times: pixels are coherently classified in the raster of pixels as being foreground or background based on the sample of pixels; and a rendering of the image is updated on a display to depict classified foreground pixels and background pixels as the sample is being defined.
摘要:
Methods and apparatus, including computer program products, implementing techniques for identifying one or more objects within an image. The techniques include receiving an image that includes at least one object; identifying a plurality of edge pixels in the image, an edge pixel being a pixel that borders two contrasting areas of the image, the plurality of edge pixels including both inner edge pixels and outer edge pixels; and finding a substantially connected component correlated with each object, the substantially connected component comprising a set of the edge pixels that are connected by traversing substantially only edge pixels.