Abstract:
Techniques and systems are described to recolor a group of images for color consistency. Techniques include extracting color palettes for images of the group of images and generating a group theme color palette based on the color palettes for the images. Image color palettes are then mapped to the group theme color palette and the images are modified in response to the mapping. In some examples, the mapping includes discouraging multiple colors of a single color palette from mapping to a single color of the group theme color palette. Additionally, or alternatively, the mapping includes discouraging a forced mapping of a dissimilar color of an image color palette from mapping to the group theme color palette.
Abstract:
User input-based object selection using multiple visual cues is described. User selection input is received for selecting a portion of an image. Once the user selection input is received, one of a plurality of visual cues that convey different information about content depicted in the image is selected for each pixel. The one visual cue is selected as a basis for identifying the pixel as part of the selected portion of the image or part of an unselected remainder of the image. The visual cues are selected by determining confidences, based in part on the user selection input, that the plurality of visual cues can be used to discriminate whether the pixel is part of the selected portion or part of the remainder. The information conveyed by the selected visual cues is used to identify the pixels as part of the selected portion or part of the remainder.
Abstract:
Techniques and systems are described to model and extract knowledge from images. A digital medium environment is configured to learn and use a model to compute a descriptive summarization of an input image automatically and without user intervention. Training data is obtained to train a model using machine learning in order to generate a structured image representation that serves as the descriptive summarization of an input image. The images and associated text are processed to extract structured semantic knowledge from the text, which is then associated with the images. The structured semantic knowledge is processed along with corresponding images to train a model using machine learning such that the model describes a relationship between text features within the structured semantic knowledge. Once the model is learned, the model is usable to process input images to generate a structured image representation of the image.
Abstract:
Content creation and sharing integration techniques and systems are described. In one or more implementations, techniques are described in which modifiable versions of content (e.g., images) are created and shared via a content sharing service such that image creation functionality used to create the images is preserved to permit continued creation using this functionality. In one or more additional implementations, image creation functionality employed by a creative professional to create content is leveraged to locate similar images from a content sharing service.
Abstract:
Joint depth estimation and semantic labeling techniques usable for processing of a single image are described. In one or more implementations, global semantic and depth layouts are estimated of a scene of the image through machine learning by the one or more computing devices. Local semantic and depth layouts are also estimated for respective ones of a plurality of segments of the scene of the image through machine learning by the one or more computing devices. The estimated global semantic and depth layouts are merged with the local semantic and depth layouts by the one or more computing devices to semantically label and assign a depth value to individual pixels in the image.
Abstract:
In techniques for video denoising using optical flow, image frames of video content include noise that corrupts the video content. A reference frame is selected, and matching patches to an image patch in the reference frame are determined from within the reference frame. A noise estimate is computed for previous and subsequent image frames relative to the reference frame. The noise estimate for an image frame is computed based on optical flow, and is usable to determine a contribution of similar motion patches to denoise the image patch in the reference frame. The similar motion patches from the previous and subsequent image frames that correspond to the image patch in the reference frame are determined based on the optical flow computations. The image patch is denoised based on an average of the matching patches from reference frame and the similar motion patches determined from the previous and subsequent image frames.
Abstract:
Depth map stereo correspondence techniques are described. In one or more implementations, a depth map generated through use of a depth sensor is leveraged as part of processing of stereo images to assist in identifying which parts of stereo images correspond to each other. For example, the depth map may be utilized to describe depth of an image scene which may be used as part of a stereo correspondence calculation. The depth map may also be utilized as part of a determination of a search range to be employed as part of the stereo correspondence calculation.
Abstract:
Image upscaling techniques are described. These techniques may include use of iterative and adjustment upscaling techniques to upscale an input image. A variety of functionality may be incorporated as part of these techniques, examples of which include content-adaptive patch finding techniques that may be employed to give preference to an in-place patch to minimize structure distortion. In another example, content metric techniques may be employed to assign weights for combining patches. In a further example, algorithm parameters may be adapted with respect to algorithm iterations, which may be performed to increase efficiency of computing device resource utilization and speed of performance. For instance, algorithm parameters may be adapted to enforce a minimum and/or maximum number to iterations, cease iterations for image sizes over a threshold amount, set sampling step sizes for patches, employ techniques based on color channels (which may include independence and joint processing techniques), and so on.
Abstract:
Image matting and alpha value techniques are described. In one or more implementations, techniques are described in which matting operations are applied to image data that is in a raw or substantially raw image format. This may be used to decompose image data into foreground and background images as well as to generate an alpha value that describes a linear combination of the foreground and background images for a respective pixel. Further, implementations are also described in which a plurality of alpha values is generated for each of a plurality of pixels. These alpha values may be utilized to support a variety of different functionality, such as matting operations and so on.
Abstract:
Methods and apparatus for disparity map correction through statistical analysis on local neighborhoods. A disparity map correction technique may be used to correct mistakes in a disparity or depth map. The disparity map correction technique may detect and mark invalid pixel pairs in a disparity map, segment the image, and perform a statistical analysis of the disparities in each segment to identify outliers. The invalid and outlier pixels may then be corrected using other disparity values in the local neighborhood. Multiple iterations of the disparity map correction technique may be performed to further improve the output disparity map.