GENERALIZED MASK PROPAGATION FOR VIDEO SEGMENTATION

    公开(公告)号:US20250029386A1

    公开(公告)日:2025-01-23

    申请号:US18356892

    申请日:2023-07-21

    Applicant: Adobe Inc.

    Abstract: Embodiments are disclosed for performing universal segmentation to mask objects across multiple frames of a video. The method may include determining an image segmentation mask which masks an object of a frame of a video sequence using the frame and an image segmentation module of a segmentation system. The method further includes determining a mask propagation mask which masks the object of the frame of the video sequence using the frame, a representation of a previous frame of the video sequence, and a mask propagation module of the segmentation system. The method further includes determining a frame mask which masks the object of the frame of the video sequence based on a comparison of the image segmentation mask and the mask propagation mask. The method further includes displaying the frame mask of the video sequence.

    PANOPTIC MASK PROPAGATION WITH ACTIVE REGIONS

    公开(公告)号:US20240397059A1

    公开(公告)日:2024-11-28

    申请号:US18322310

    申请日:2023-05-23

    Applicant: Adobe Inc.

    Abstract: A method includes receiving a frame depicting an object. The frame is one frame of a plurality of frames of a video sequence. The method further includes encoding a plurality of tokens of the frame. Each token is a representation of a grid of pixels of the frame. The method further includes selecting a subset of tokens for decoding based on a likelihood of a token satisfying a confidence threshold. The token satisfies the confidence threshold based on a confidence score of the token including a past object in a past frame. The method further includes decoding the subset of tokens using a decoder.

    SUB-OBJECT SEGMENTATION
    4.
    发明申请

    公开(公告)号:US20240371002A1

    公开(公告)日:2024-11-07

    申请号:US18312858

    申请日:2023-05-05

    Applicant: Adobe Inc.

    Abstract: A method includes receiving an object mask of an object in an image. The method further includes generating a mask of a sub-object in the image using a machine learning model configured to receive the mask of the object. A first branch of the machine learning model predicts whether a pixel of the image belongs to a sub-object.

    INSTANT MASKS WITH POLARIZED LIGHT
    6.
    发明公开

    公开(公告)号:US20230169658A1

    公开(公告)日:2023-06-01

    申请号:US17536384

    申请日:2021-11-29

    Applicant: Adobe Inc.

    CPC classification number: G06T7/11 H04N5/272 G06T2207/10024 G06T2207/10028

    Abstract: Embodiments are disclosed for generating an instant mask from polarized input images. A method of generating the mask includes obtaining, by a user interface manager, a set of polarized input images, the set of polarized images including background images depicting a background and subject images depicting a foreground object in front of the background and backlit by a polarized light source, the set of polarized input images including more than two polarized images, each associated with a different polarization angle, determining, by a matte optimization manager, an at least partially polarized reflection on the foreground object based on the set of polarized input images, determining, by the matte optimization manager, an alpha matte based at least on intensity values associated with each of the set of polarized input images such that the alpha matte isolates the foreground object and removes the at least partially polarized reflection, and generating, by a matte generator, an output matte based on the alpha matte.

    SEMANTIC-AWARE AUTO WHITE BALANCE
    8.
    发明公开

    公开(公告)号:US20230410553A1

    公开(公告)日:2023-12-21

    申请号:US17842056

    申请日:2022-06-16

    Applicant: ADOBE INC.

    CPC classification number: G06V40/162 G06T2207/10024 G06T5/001 G06V40/172

    Abstract: An image processing system auto white balances an image using an object in the image and a reference color distribution. Given an input image, a target object in the input image is identified. A reference color distribution for the object type of the target object from the input image is accessed. One or more image processing settings are determined that, when applied to the input image, minimize a difference in values between pixels of the target object and the reference color distribution. A white balanced image is generated by applying the one or more image processing settings to the input image, and the white balanced image is provided for presentation.

Patent Agency Ranking