Automatic Digital Parameter Adjustment Including Tone and Color Correction

    公开(公告)号:US20210160466A1

    公开(公告)日:2021-05-27

    申请号:US16696160

    申请日:2019-11-26

    Applicant: Adobe Inc.

    Abstract: Systems and techniques for automatic digital parameter adjustment are described that leverage insights learned from an image set to automatically predict parameter values for an input item of digital visual content. To do so, the automatic digital parameter adjustment techniques described herein captures visual and contextual features of digital visual content to determine balanced visual output in a range of visual scenes and settings. The visual and contextual features of digital visual content are used to train a parameter adjustment model through machine learning techniques that captures feature patterns and interactions. The parameter adjustment model exploits these feature interactions to determine visually pleasing parameter values for an input item of digital visual content. The predicted parameter values are output, allowing further adjustment to the parameter values.

    Video object segmentation by reference-guided mask propagation

    公开(公告)号:US10671855B2

    公开(公告)日:2020-06-02

    申请号:US15949935

    申请日:2018-04-10

    Applicant: Adobe Inc.

    Abstract: Various embodiments describe video object segmentation using a neural network and the training of the neural network. The neural network both detects a target object in the current frame based on a reference frame and a reference mask that define the target object and propagates the segmentation mask of the target object for a previous frame to the current frame to generate a segmentation mask for the current frame. In some embodiments, the neural network is pre-trained using synthetically generated static training images and is then fine-tuned using training videos.

    Image modification using detected symmetry

    公开(公告)号:US10573040B2

    公开(公告)日:2020-02-25

    申请号:US15346638

    申请日:2016-11-08

    Applicant: Adobe Inc.

    Abstract: Image modification using detected symmetry is described. In example implementations, an image modification module detects multiple local symmetries in an original image by discovering repeated correspondences that are each related by a transformation. The transformation can include a translation, a rotation, a reflection, a scaling, or a combination thereof. Each repeated correspondence includes three patches that are similar to one another and are respectively defined by three pixels of the original image. The image modification module generates a global symmetry of the original image by analyzing an applicability to the multiple local symmetries of multiple candidate homographies contributed by the multiple local symmetries. The image modification module associates individual pixels of the original image with a global symmetry indicator to produce a global symmetry association map. The image modification module produces a manipulated image by manipulating the original image under global symmetry constraints imposed by the global symmetry association map.

    Compositing Aware Digital Image Search
    24.
    发明申请

    公开(公告)号:US20190361994A1

    公开(公告)日:2019-11-28

    申请号:US15986401

    申请日:2018-05-22

    Applicant: Adobe Inc.

    Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.

    Automatic digital parameter adjustment including tone and color correction

    公开(公告)号:US11178368B2

    公开(公告)日:2021-11-16

    申请号:US16696160

    申请日:2019-11-26

    Applicant: Adobe Inc.

    Abstract: Systems and techniques for automatic digital parameter adjustment are described that leverage insights learned from an image set to automatically predict parameter values for an input item of digital visual content. To do so, the automatic digital parameter adjustment techniques described herein captures visual and contextual features of digital visual content to determine balanced visual output in a range of visual scenes and settings. The visual and contextual features of digital visual content are used to train a parameter adjustment model through machine learning techniques that captures feature patterns and interactions. The parameter adjustment model exploits these feature interactions to determine visually pleasing parameter values for an input item of digital visual content. The predicted parameter values are output, allowing further adjustment to the parameter values.

    INCORPORATING BLACK-BOX FUNCTIONS IN NEURAL NETWORKS

    公开(公告)号:US20210012189A1

    公开(公告)日:2021-01-14

    申请号:US16507675

    申请日:2019-07-10

    Applicant: Adobe Inc.

    Abstract: Techniques for incorporating a black-box function into a neural network are described. For example, an image editing function may be the black-box function and may be wrapped into a layer of the neural network. A set of parameters and a source image are provided to the black-box function, and the output image that represents the source image with the set of parameters applied to the source image is output from the black-box function. To address the issue that the black-box function may not be differentiable, a loss optimization may calculate the gradients of the function using, for example, a finite differences calculation, and the gradients are used to train the neural network to ensure the output image is representative of an expected ground truth image.

    Compositing Aware Digital Image Search
    29.
    发明申请

    公开(公告)号:US20200349189A1

    公开(公告)日:2020-11-05

    申请号:US16929429

    申请日:2020-07-15

    Applicant: Adobe Inc.

    Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.

    Material capture using imaging
    30.
    发明授权

    公开(公告)号:US10818022B2

    公开(公告)日:2020-10-27

    申请号:US16229759

    申请日:2018-12-21

    Applicant: ADOBE INC.

    Abstract: Methods and systems are provided for performing material capture to determine properties of an imaged surface. A plurality of images can be received depicting a material surface. The plurality of images can be calibrated to align corresponding pixels of the images and determine reflectance information for at least a portion of the aligned pixels. After calibration, a set of reference materials from a material library can be selected using the calibrated images. The set of reference materials can be used to determine a material model that accurately represents properties of the material surface.

Patent Agency Ranking