公开(公告)号：US20230401716A1

公开(公告)日：2023-12-14

申请号：US17806312

申请日：2022-06-10

Applicant: ADOBE INC.

Inventor： Yilin Wang ,  Chenglin Yang ,  Jianming Zhang ,  He Zhang ,  Zijun Wei ,  Zhe Lin

IPC: G06T7/10 ,  G06T11/60 ,  G06N3/08

CPC classification number: G06T7/10 ,  G06T11/60 ,  G06N3/088

Abstract: Systems and methods for image segmentation are described. Embodiments of the present disclosure receive an image depicting an object; generate image features for the image by performing a convolutional self-attention operation that outputs a plurality of attention-weighted values for a convolutional kernel applied at a position of a sliding window on the image; and generate label data that identifies the object based on the image features.

公开(公告)号：US11875510B2

公开(公告)日：2024-01-16

申请号：US17200525

申请日：2021-03-12

Applicant: Adobe Inc.

Inventor： Yilin Wang ,  Chenglin Yang ,  Jianming Zhang ,  He Zhang ,  Zhe Lin

IPC: G06K9/00 ,  G06T7/11 ,  G06N3/08 ,  G06T3/40 ,  G06F18/213 ,  G06N3/044

CPC classification number: G06T7/11 ,  G06F18/213 ,  G06N3/044 ,  G06N3/08 ,  G06T3/4046 ,  G06T2207/20084

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilizes a neural network having a hierarchy of hierarchical point-wise refining blocks to generate refined segmentation masks for high-resolution digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network having an encoder and a recursive decoder to generate the refined segmentation masks. The recursive decoder includes a deconvolution branch for generating feature maps and a refinement branch for generating and refining segmentation masks. In particular, in some cases, the refinement branch includes a hierarchy of hierarchical point-wise refining blocks that recursively refine a segmentation mask generated for a digital visual media item. In some cases, the disclosed systems utilize a segmentation refinement neural network that includes a low-resolution network and a high-resolution network, each including an encoder and a recursive decoder, to generate the refined segmentation masks.

公开(公告)号：US20230401717A1

公开(公告)日：2023-12-14

申请号：US17806314

申请日：2022-06-10

Applicant: ADOBE INC.

Inventor： Yilin Wang ,  Chenglin Yang ,  Jianming Zhang ,  He Zhang ,  Zijun Wei ,  Zhe Lin

IPC: G06T7/11 ,  G06V20/70 ,  G06V10/778 ,  G06V10/82

CPC classification number: G06T7/11 ,  G06V20/70 ,  G06V10/778 ,  G06V10/82 ,  G06T2207/20021 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems and methods for image segmentation are described. Embodiments of the present disclosure receive an image depicting an object; generate image features for the image by performing an atrous self-attention operation based on a plurality of dilation rates for a convolutional kernel applied at a position of a sliding window on the image; and generate label data that identifies the object based on the image features.

公开(公告)号：US20220292684A1

公开(公告)日：2022-09-15

申请号：US17200525

申请日：2021-03-12

Applicant: Adobe Inc.

Inventor： Yilin Wang ,  Chenglin Yang ,  Jianming Zhang ,  He Zhang ,  Zhe Lin

IPC: G06T7/11 ,  G06K9/62 ,  G06T3/40 ,  G06N3/04 ,  G06N3/08

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilizes a neural network having a hierarchy of hierarchical point-wise refining blocks to generate refined segmentation masks for high-resolution digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network having an encoder and a recursive decoder to generate the refined segmentation masks. The recursive decoder includes a deconvolution branch for generating feature maps and a refinement branch for generating and refining segmentation masks. In particular, in some cases, the refinement branch includes a hierarchy of hierarchical point-wise refining blocks that recursively refine a segmentation mask generated for a digital visual media item. In some cases, the disclosed systems utilize a segmentation refinement neural network that includes a low-resolution network and a high-resolution network, each including an encoder and a recursive decoder, to generate the refined segmentation masks.