-
公开(公告)号:US12124439B2
公开(公告)日:2024-10-22
申请号:US17513127
申请日:2021-10-28
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhe Lin , Zhaowen Wang , Zhankui He , Ajinkya Gorakhnath Kale
IPC: G06F16/245 , G06F16/248 , G06N20/00
CPC classification number: G06F16/245 , G06F16/248 , G06N20/00
Abstract: Digital content search techniques are described that overcome the challenges found in conventional sequence-based techniques through use of a query-aware sequential search. In one example, a search query is received and sequence input data is obtained based on the search query. The sequence input data describes a sequence of digital content and respective search queries. Embedding data is generated based on the sequence input data using an embedding module of a machine-learning model. The embedding module includes a query-aware embedding layer that generates embeddings of the sequence of digital content and respective search queries. A search result is generated referencing at least one item of digital content by processing the embedding data using at least one layer of the machine-learning model.
-
公开(公告)号:US12118752B2
公开(公告)日:2024-10-15
申请号:US17658799
申请日:2022-04-11
Applicant: Adobe Inc.
Inventor: Zhihong Ding , Scott Cohen , Zhe Lin , Mingyang Ling
CPC classification number: G06T7/90 , G06F18/22 , G06F18/24 , G06N3/02 , G06V10/56 , G06V20/20 , G06T2207/10024 , G06T2207/20084
Abstract: The present disclosure relates to a color classification system that accurately classifies objects in digital images based on color. In particular, in one or more embodiments, the color classification system utilizes a multidimensional color space and one or more color mappings to match objects to colors. Indeed, the color classification system can accurately and efficiently detect the color of an object utilizing one or more color similarity regions generated in the multidimensional color space.
-
公开(公告)号:US12019671B2
公开(公告)日:2024-06-25
申请号:US17501191
申请日:2021-10-14
Applicant: Adobe Inc.
Inventor: Handong Zhao , Zhankui He , Zhaowen Wang , Ajinkya Gorakhnath Kale , Zhe Lin
IPC: G06F16/43 , G06F16/438 , G06F16/44 , G06N3/045
CPC classification number: G06F16/438 , G06F16/447 , G06N3/045
Abstract: Digital content search techniques are described. In one example, the techniques are incorporated as part of a multi-head self-attention module of a transformer using machine learning. A localized self-attention module, for instance, is incorporated as part of the multi-head self-attention module that applies local constraints to the sequence. This is performable in a variety of ways. In a first instance, a model-based local encoder is used, examples of which include a fixed-depth recurrent neural network (RNN) and a convolutional network. In a second instance, a masking-based local encoder is used, examples of which include use of a fixed window, Gaussian initialization, and an adaptive predictor.
-
224.
公开(公告)号:US20240185393A1
公开(公告)日:2024-06-06
申请号:US18440248
申请日:2024-02-13
Applicant: Adobe Inc.
Inventor: He Zhang , Yifan Jiang , Yilin Wang , Jianming Zhang , Kalyan Sunkavalli , Sarah Kong , Su Chen , Sohrab Amirghodsi , Zhe Lin
CPC classification number: G06T5/50 , G06N3/04 , G06N3/08 , G06T7/194 , G06T11/001 , G06T11/60 , G06T2207/20081 , G06T2207/20084 , G06T2207/20092 , G06T2207/20132 , G06T2207/20212
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating harmonized digital images utilizing a self-supervised image harmonization neural network. In particular, the disclosed systems can implement, and learn parameters for, a self-supervised image harmonization neural network to extract content from one digital image (disentangled from its appearance) and appearance from another from another digital image (disentangled from its content). For example, the disclosed systems can utilize a dual data augmentation method to generate diverse triplets for parameter learning (including input digital images, reference digital images, and pseudo ground truth digital images), via cropping a digital image with perturbations using three-dimensional color lookup tables (“LUTs”). Additionally, the disclosed systems can utilize the self-supervised image harmonization neural network to generate harmonized digital images that depict content from one digital image having the appearance of another digital image.
-
225.
公开(公告)号:US20240169631A1
公开(公告)日:2024-05-23
申请号:US18532485
申请日:2023-12-07
Applicant: Adobe Inc.
Inventor: Soo Ye Kim , Zhe Lin , Scott Cohen , Jianming Zhang , Luis Figueroa , Zhihong Ding
IPC: G06T11/60 , G06F3/0481 , G06F3/04845 , G06F3/0486 , G06T5/00 , G06T11/00
CPC classification number: G06T11/60 , G06F3/0481 , G06F3/04845 , G06F3/0486 , G06T5/002 , G06T5/005 , G06T11/001 , G06T2200/24 , G06T2207/20092 , G06T2207/20212
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing to remove a shadow for an object. For instance, in one or more embodiments, the disclosed systems receive a digital image depicting a scene. The disclosed systems access a shadow mask of the shadow in a first location. Further, the disclosed systems generate the modified digital image without the shadow by generating a fill for the first location that preserves a visible location of the first location. Moreover, the disclosed systems generate the digital image without the shadow for the object by combining the fill with the digital image.
-
226.
公开(公告)号:US20240135509A1
公开(公告)日:2024-04-25
申请号:US18190500
申请日:2023-03-27
Applicant: Adobe Inc.
Inventor: Qing Liu , Jianming Zhang , Krishna Kumar Singh , Scott Cohen , Zhe Lin
CPC classification number: G06T5/005 , G06T5/002 , G06T7/11 , G06T11/60 , G06V10/764 , G06V10/82 , G06V20/70 , G06T2200/24 , G06T2207/20021 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify digital images via scene-based editing using image understanding facilitated by artificial intelligence. For example, in one or more embodiments the disclosed systems utilize generative machine learning models to create modified digital images portraying human subjects. In particular, the disclosed systems generate modified digital images by performing infill modifications to complete a digital image or human inpainting for portions of a digital image that portrays a human. Moreover, in some embodiments, the disclosed systems perform reposing of subjects portrayed within a digital image to generate modified digital images. In addition, the disclosed systems in some embodiments perform facial expression transfer and facial expression animations to generate modified digital images or animations.
-
227.
公开(公告)号:US20240127411A1
公开(公告)日:2024-04-18
申请号:US17937706
申请日:2022-10-03
Applicant: Adobe Inc.
Inventor: Zhe Lin , Haitian Zheng , Elya Shechtman , Jianming Zhang , Jingwan Lu , Ning Xu , Qing Liu , Scott Cohen , Sohrab Amirghodsi
CPC classification number: G06T5/005 , G06T7/11 , G06T2200/24 , G06T2207/20081 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
-
公开(公告)号:US20240127410A1
公开(公告)日:2024-04-18
申请号:US17937695
申请日:2022-10-03
Applicant: Adobe Inc.
Inventor: Zhe Lin , Haitian Zheng , Elya Shechtman , Jianming Zhang , Jingwan Lu , Ning Xu , Qing Liu , Scott Cohen , Sohrab Amirghodsi
CPC classification number: G06T5/005 , G06T7/11 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
-
公开(公告)号:US11935217B2
公开(公告)日:2024-03-19
申请号:US17200338
申请日:2021-03-12
Applicant: Adobe Inc.
Inventor: He Zhang , Yifan Jiang , Yilin Wang , Jianming Zhang , Kalyan Sunkavalli , Sarah Kong , Su Chen , Sohrab Amirghodsi , Zhe Lin
CPC classification number: G06T5/50 , G06N3/04 , G06N3/08 , G06T7/194 , G06T11/001 , G06T11/60 , G06T2207/20081 , G06T2207/20084 , G06T2207/20092 , G06T2207/20132 , G06T2207/20212
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating harmonized digital images utilizing a self-supervised image harmonization neural network. In particular, the disclosed systems can implement, and learn parameters for, a self-supervised image harmonization neural network to extract content from one digital image (disentangled from its appearance) and appearance from another from another digital image (disentangled from its content). For example, the disclosed systems can utilize a dual data augmentation method to generate diverse triplets for parameter learning (including input digital images, reference digital images, and pseudo ground truth digital images), via cropping a digital image with perturbations using three-dimensional color lookup tables (“LUTs”). Additionally, the disclosed systems can utilize the self-supervised image harmonization neural network to generate harmonized digital images that depict content from one digital image having the appearance of another digital image.
-
公开(公告)号:US11875510B2
公开(公告)日:2024-01-16
申请号:US17200525
申请日:2021-03-12
Applicant: Adobe Inc.
Inventor: Yilin Wang , Chenglin Yang , Jianming Zhang , He Zhang , Zhe Lin
CPC classification number: G06T7/11 , G06F18/213 , G06N3/044 , G06N3/08 , G06T3/4046 , G06T2207/20084
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilizes a neural network having a hierarchy of hierarchical point-wise refining blocks to generate refined segmentation masks for high-resolution digital visual media items. For example, in one or more embodiments, the disclosed systems utilize a segmentation refinement neural network having an encoder and a recursive decoder to generate the refined segmentation masks. The recursive decoder includes a deconvolution branch for generating feature maps and a refinement branch for generating and refining segmentation masks. In particular, in some cases, the refinement branch includes a hierarchy of hierarchical point-wise refining blocks that recursively refine a segmentation mask generated for a digital visual media item. In some cases, the disclosed systems utilize a segmentation refinement neural network that includes a low-resolution network and a high-resolution network, each including an encoder and a recursive decoder, to generate the refined segmentation masks.
-
-
-
-
-
-
-
-
-