Generating modified digital images by identifying digital image patch matches utilizing a Gaussian mixture model

    公开(公告)号:US11037019B2

    公开(公告)日:2021-06-15

    申请号:US15906783

    申请日:2018-02-27

    Applicant: Adobe Inc.

    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.

    Texture interpolation using neural networks

    公开(公告)号:US10818043B1

    公开(公告)日:2020-10-27

    申请号:US16392968

    申请日:2019-04-24

    Applicant: Adobe Inc.

    Abstract: An example method for neural network based interpolation of image textures includes training a global encoder network to generate global latent vectors based on training texture images, and training a local encoder network to generate local latent tensors based on the training texture images. The example method further includes interpolating between the global latent vectors associated with each set of training images, and interpolating between the local latent tensors associated with each set of training images. The example method further includes training a decoder network to generate reconstructions of the training texture images and to generate an interpolated texture based on the interpolated global latent vectors and the interpolated local latent tensors. The training of the encoder and decoder networks is based on a minimization of a loss function of the reconstructions and a minimization of a loss function of the interpolated texture.

    Image modification using detected symmetry

    公开(公告)号:US10573040B2

    公开(公告)日:2020-02-25

    申请号:US15346638

    申请日:2016-11-08

    Applicant: Adobe Inc.

    Abstract: Image modification using detected symmetry is described. In example implementations, an image modification module detects multiple local symmetries in an original image by discovering repeated correspondences that are each related by a transformation. The transformation can include a translation, a rotation, a reflection, a scaling, or a combination thereof. Each repeated correspondence includes three patches that are similar to one another and are respectively defined by three pixels of the original image. The image modification module generates a global symmetry of the original image by analyzing an applicability to the multiple local symmetries of multiple candidate homographies contributed by the multiple local symmetries. The image modification module associates individual pixels of the original image with a global symmetry indicator to produce a global symmetry association map. The image modification module produces a manipulated image by manipulating the original image under global symmetry constraints imposed by the global symmetry association map.

    DEEP PATCH FEATURE PREDICTION FOR IMAGE INPAINTING

    公开(公告)号:US20190295227A1

    公开(公告)日:2019-09-26

    申请号:US15935994

    申请日:2018-03-26

    Applicant: Adobe Inc.

    Abstract: Techniques for using deep learning to facilitate patch-based image inpainting are described. In an example, a computer system hosts a neural network trained to generate, from an image, code vectors including features learned by the neural network and descriptive of patches. The image is received and contains a region of interest (e.g., a hole missing content). The computer system inputs it to the network and, in response, receives the code vectors. Each code vector is associated with a pixel in the image. Rather than comparing RGB values between patches, the computer system compares the code vector of a pixel inside the region to code vectors of pixels outside the region to find the best match based on a feature similarity measure (e.g., a cosine similarity). The pixel value of the pixel inside the region is set based on the pixel value of the matched pixel outside this region.

    GENERATING MODIFIED DIGITAL IMAGES BY IDENTIFYING DIGITAL IMAGE PATCH MATCHES UTILIZING A GAUSSIAN MIXTURE MODEL

    公开(公告)号:US20190266438A1

    公开(公告)日:2019-08-29

    申请号:US15906783

    申请日:2018-02-27

    Applicant: Adobe Inc.

    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.

Patent Agency Ranking