Integrated interactive image segmentation

    公开(公告)号:US11538170B2

    公开(公告)日:2022-12-27

    申请号:US16839209

    申请日:2020-04-03

    Applicant: ADOBE INC.

    Abstract: Methods and systems are provided for optimal segmentation of an image based on multiple segmentations. In particular, multiple segmentation methods can be combined by taking into account previous segmentations. For instance, an optimal segmentation can be generated by iteratively integrating a previous segmentation (e.g., using an image segmentation method) with a current segmentation (e.g., using the same or different image segmentation method). To allow for optimal segmentation of an image based on multiple segmentations, one or more neural networks can be used. For instance, a convolutional RNN can be used to maintain information related to one or more previous segmentations when transitioning from one segmentation method to the next. The convolutional RNN can combine the previous segmentation(s) with the current segmentation without requiring any information about the image segmentation method(s) used to generate the segmentations.

    Compositing aware digital image search

    公开(公告)号:US11263259B2

    公开(公告)日:2022-03-01

    申请号:US16929429

    申请日:2020-07-15

    Applicant: Adobe Inc.

    Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.

    INTERACTIVE IMAGE MATTING USING NEURAL NETWORKS

    公开(公告)号:US20210256708A1

    公开(公告)日:2021-08-19

    申请号:US17313158

    申请日:2021-05-06

    Applicant: Adobe Inc.

    Abstract: Techniques are disclosed for deep neural network (DNN) based interactive image matting. A methodology implementing the techniques according to an embodiment includes generating, by the DNN, an alpha matte associated with an image, based on user-specified foreground region locations in the image. The method further includes applying a first DNN subnetwork to the image, the first subnetwork trained to generate a binary mask based on the user input, the binary mask designating pixels of the image as background or foreground. The method further includes applying a second DNN subnetwork to the generated binary mask, the second subnetwork trained to generate a trimap based on the user input, the trimap designating pixels of the image as background, foreground, or uncertain status. The method further includes applying a third DNN subnetwork to the generated trimap, the third subnetwork trained to generate the alpha matte based on the user input.

    Compositing aware digital image search

    公开(公告)号:US10747811B2

    公开(公告)日:2020-08-18

    申请号:US15986401

    申请日:2018-05-22

    Applicant: Adobe Inc.

    Abstract: Compositing aware digital image search techniques and systems are described that leverage machine learning. In one example, a compositing aware image search system employs a two-stream convolutional neural network (CNN) to jointly learn feature embeddings from foreground digital images that capture a foreground object and background digital images that capture a background scene. In order to train models of the convolutional neural networks, triplets of training digital images are used. Each triplet may include a positive foreground digital image and a positive background digital image taken from the same digital image. The triplet also contains a negative foreground or background digital image that is dissimilar to the positive foreground or background digital image that is also included as part of the triplet.

    SYSTEMS AND METHODS FOR IMAGE COMPOSITING

    公开(公告)号:US20250022099A1

    公开(公告)日:2025-01-16

    申请号:US18351838

    申请日:2023-07-13

    Applicant: ADOBE INC.

    Abstract: Systems and methods for image compositing are provided. An aspect of the systems and methods includes obtaining a first image and a second image, wherein the first image includes a target location and the second image includes a target element; encoding the second image using an image encoder to obtain an image embedding; generating a descriptive embedding based on the image embedding using an adapter network; and generating a composite image based on the descriptive embedding and the first image using an image generation model, wherein the composite image depicts the target element from the second image at the target location of the first image.

    Methods and systems for geometry-aware image contrast adjustments via image-based ambient occlusion estimation

    公开(公告)号:US12147896B2

    公开(公告)日:2024-11-19

    申请号:US18296525

    申请日:2023-04-06

    Applicant: Adobe Inc.

    Abstract: Embodiments of the present invention provide systems, methods, and non-transitory computer storage media for generating an ambient occlusion (AO) map for a 2D image that can be combined with the 2D image to adjust the contrast of the 2D image based on the geometric information in the 2D image. In embodiments, using a trained neural network, an AO map for a 2D image is automatically generated without any predefined 3D scene information. Optimizing the neural network to generate an estimated AO map for a 2D image requires training, testing, and validating the neural network using a synthetic dataset comprised of pairs of images and ground truth AO maps rendered from 3D scenes. By using an estimated AO map to adjust the contrast of a 2D image, the contrast of the image can be adjusted to make the image appear lifelike by modifying the shadows and shading in the image based on the ambient lighting present in the image.

    PERFORMING MULTIPLE SEGMENTATION TASKS
    8.
    发明公开

    公开(公告)号:US20240249413A1

    公开(公告)日:2024-07-25

    申请号:US18100419

    申请日:2023-01-23

    Applicant: Adobe Inc.

    CPC classification number: G06T7/11 G06T2207/20081 G06T2207/20104

    Abstract: In implementations of systems for performing multiple segmentation tasks, a computing device implements a segment system to receive input data describing a digital image depicting an object. The segment system computes per-pixel embeddings for the digital image using a pixel decoder of a machine learning model. Output embeddings are generated using a transformer decoder of the machine learning model based on the per-pixel embeddings for the digital image, input embeddings for a first segmentation task and input embeddings for a second segmentation task. The segment system outputs a first digital image and a second digital image. The first digital image depicts the object segmented based on the first segmentation task and the second digital image depicts the object segmented based on the second segmentation task.

    Joint Trimap Estimation and Alpha Matte Prediction for Video Matting

    公开(公告)号:US20230360177A1

    公开(公告)日:2023-11-09

    申请号:US17736397

    申请日:2022-05-04

    Applicant: Adobe Inc.

    Abstract: In implementations of systems for joint trimap estimation and alpha matte prediction, a computing device implements a matting system to estimate a trimap for a frame of a digital video using a first stage of a machine learning model. An alpha matte is predicted for the frame based on the trimap and the frame using a second stage of the machine learning model. The matting system generates a refined trimap and a refined alpha matte for the frame based on the alpha matte, the trimap, and the frame using a third stage of the machine learning model. An additional trimap is estimated for an additional frame of the digital video based on the refined trimap and the refined alpha matte using the first stage of the machine learning model.

Patent Agency Ranking