ITERATIVE IMAGE INPAINTING WITH CONFIDENCE FEEDBACK

    公开(公告)号:US20220366546A1

    公开(公告)日:2022-11-17

    申请号:US17812639

    申请日:2022-07-14

    Applicant: ADOBE INC.

    Abstract: Methods and systems are provided for accurately filling holes, regions, and/or portions of images using iterative image inpainting. In particular, iterative inpainting utilize a confidence analysis of predicted pixels determined during the iterations of inpainting. For instance, a confidence analysis can provide information that can be used as feedback to progressively fill undefined pixels that comprise the holes, regions, and/or portions of an image where information for those respective pixels is not known. To allow for accurate image inpainting, one or more neural networks can be used. For instance, a coarse result neural network (e.g., a GAN comprised of a generator and a discriminator) and a fine result neural network (e.g., a GAN comprised of a generator and two discriminators). The image inpainting system can use such networks to predict an inpainting image result that fills the hole, region, and/or portion of the image using predicted pixels and generates a corresponding confidence map of the predicted pixels.

    GUIDED UP-SAMPLING FOR IMAGE INPAINTING

    公开(公告)号:US20210342984A1

    公开(公告)日:2021-11-04

    申请号:US16864388

    申请日:2020-05-01

    Applicant: ADOBE INC.

    Abstract: Methods and systems are provided for accurately filling holes, regions, and/or portions of high-resolution images using guided upsampling during image inpainting. For instance, an image inpainting system can apply guided upsampling to an inpainted image result to enable generation of a high-resolution inpainting result from a lower-resolution image that has undergone inpainting. To allow for guided upsampling during image inpainting, one or more neural networks can be used. For instance, a low-resolution result neural network (e.g., comprised of an encoder and a decoder) and a high-resolution input neural network (e.g., comprised of an encoder and a decoder). The image inpainting system can use such networks to generate a high-resolution inpainting image result that fills the hole, region, and/or portion of the image.

    ENHANCED SEMANTIC SEGMENTATION OF IMAGES

    公开(公告)号:US20210082118A1

    公开(公告)日:2021-03-18

    申请号:US16574513

    申请日:2019-09-18

    Applicant: ADOBE INC.

    Abstract: Enhanced methods and systems for the semantic segmentation of images are described. A refined segmentation mask for a specified object visually depicted in a source image is generated based on a coarse and/or raw segmentation mask. The refined segmentation mask is generated via a refinement process applied to the coarse segmentation mask. The refinement process correct at least a portion of both type I and type II errors, as well as refine boundaries of the specified object, associated with the coarse segmentation mask. Thus, the refined segmentation mask provides a more accurate segmentation of the object than the coarse segmentation mask. A segmentation refinement model is employed to generate the refined segmentation mask based on the coarse segmentation mask. That is, the segmentation model is employed to refine the coarse segmentation mask to generate more accurate segmentations of the object. The refinement process is an iterative refinement process carried out via a trained neural network.

    EDGE ENHANCEMENT FOR SKY REPLACEMENT
    6.
    发明公开

    公开(公告)号:US20240338794A1

    公开(公告)日:2024-10-10

    申请号:US18352828

    申请日:2023-07-14

    Applicant: Adobe Inc.

    Abstract: Techniques are disclosed for automatic sky replacement with edge lighting enhancements. A method of automatic sky replacement includes generating a clean mask and a compositing mask for an input image using a mask generation network. A plurality of layers is generated using the clean mask and the compositing mask. The plurality of layers includes an edge lighting layer generated based on a subset of the plurality of layers and the clean mask. A composite image is generated by combining the input image and the plurality of layers including the edge lighting layer.

    SURFACE NORMAL PREDICTION USING PAIR-WISE ANGULAR TRAINING

    公开(公告)号:US20240193802A1

    公开(公告)日:2024-06-13

    申请号:US18076855

    申请日:2022-12-07

    Applicant: ADOBE INC.

    Inventor: Jianming ZHANG

    CPC classification number: G06T7/60 G06T7/74 G06T2207/20081

    Abstract: A surface normal model is trained to predict normal maps from single images using pair-wise angular losses. A training dataset comprising a training image and a ground truth normal map for the training image is received. To train the surface normal model using the training dataset, a predicted normal map is generated for the training image using the surface normal model. A loss is determined as a function of angular values between pairs of normal vectors for the predicted normal map and corresponding angular values between pairs of normal vectors for the ground truth normal map. The surface normal model is updated based on the loss.

    ENHANCED SEMANTIC SEGMENTATION OF IMAGES

    公开(公告)号:US20220101531A1

    公开(公告)日:2022-03-31

    申请号:US17479646

    申请日:2021-09-20

    Applicant: ADOBE INC.

    Abstract: Enhanced methods and systems for the semantic segmentation of images are described. A refined segmentation mask for a specified object visually depicted in a source image is generated based on a coarse and/or raw segmentation mask. The refined segmentation mask is generated via a refinement process applied to the coarse segmentation mask. The refinement process correct at least a portion of both type I and type II errors, as well as refine boundaries of the specified object, associated with the coarse segmentation mask. Thus, the refined segmentation mask provides a more accurate segmentation of the object than the coarse segmentation mask. A segmentation refinement model is employed to generate the refined segmentation mask based on the coarse segmentation mask. That is, the segmentation model is employed to refine the coarse segmentation mask to generate more accurate segmentations of the object. The refinement process is an iterative refinement process carried out via a trained neural network.

    ITERATIVE IMAGE INPAINTING WITH CONFIDENCE FEEDBACK

    公开(公告)号:US20210342983A1

    公开(公告)日:2021-11-04

    申请号:US16861548

    申请日:2020-04-29

    Applicant: ADOBE INC.

    Abstract: Methods and systems are provided for accurately filling holes, regions, and/or portions of images using iterative image inpainting. In particular, iterative inpainting utilize a confidence analysis of predicted pixels determined during the iterations of inpainting. For instance, a confidence analysis can provide information that can be used as feedback to progressively fill undefined pixels that comprise the holes, regions, and/or portions of an image where information for those respective pixels is not known. To allow for accurate image inpainting, one or more neural networks can be used. For instance, a coarse result neural network (e.g., a GAN comprised of a generator and a discriminator) and a fine result neural network (e.g., a GAN comprised of a generator and two discriminators). The image inpainting system can use such networks to predict an inpainting image result that fills the hole, region, and/or portion of the image using predicted pixels and generates a corresponding confidence map of the predicted pixels.

Patent Agency Ranking