-
1.
公开(公告)号:US20240331114A1
公开(公告)日:2024-10-03
申请号:US18743497
申请日:2024-06-14
申请人: Adobe Inc.
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately generating inpainted digital images utilizing a guided inpainting model guided by both plane panoptic segmentation and plane grouping. For example, the disclosed systems utilize a guided inpainting model to fill holes of missing pixels of a digital image as informed or guided by an appearance guide and a geometric guide. Specifically, the disclosed systems generate an appearance guide utilizing plane panoptic segmentation and generate a geometric guide by grouping plane panoptic segments. In some embodiments, the disclosed systems generate a modified digital image by implementing an inpainting model guided by both the appearance guide (e.g., a plane panoptic segmentation map) and the geometric guide (e.g., a plane grouping map).
-
公开(公告)号:US12079948B2
公开(公告)日:2024-09-03
申请号:US17942101
申请日:2022-09-09
申请人: ADOBE INC.
发明人: Taesung Park , Richard Zhang , Elya Shechtman
IPC分类号: G06T19/20 , G06F3/04847 , G06F40/284 , G06F40/289 , G06V10/774 , G06V10/776 , G06V10/82
CPC分类号: G06T19/20 , G06F3/04847 , G06F40/289 , G06V10/774 , G06V10/776 , G06V10/82 , G06F40/284 , G06T2200/24 , G06T2210/61
摘要: Various disclosed embodiments are directed to changing parameters of an input image or multidimensional representation of the input image based on a user request to change such parameters. An input image is first received. A multidimensional image that represents the input image in multiple dimensions is generated via a model. A request to change at least a first parameter to a second parameter is received via user input at a user device. Such request is a request to edit or generate the multidimensional image in some way. For instance, the request may be to change the light source position or camera position from a first set of coordinates to a second set of coordinates.
-
公开(公告)号:US12056857B2
公开(公告)日:2024-08-06
申请号:US17520249
申请日:2021-11-05
申请人: Adobe Inc.
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately generating inpainted digital images utilizing a guided inpainting model guided by both plane panoptic segmentation and plane grouping. For example, the disclosed systems utilize a guided inpainting model to fill holes of missing pixels of a digital image as informed or guided by an appearance guide and a geometric guide. Specifically, the disclosed systems generate an appearance guide utilizing plane panoptic segmentation and generate a geometric guide by grouping plane panoptic segments. In some embodiments, the disclosed systems generate a modified digital image by implementing an inpainting model guided by both the appearance guide (e.g., a plane panoptic segmentation map) and the geometric guide (e.g., a plane grouping map).
-
4.
公开(公告)号:US20240127411A1
公开(公告)日:2024-04-18
申请号:US17937706
申请日:2022-10-03
申请人: Adobe Inc.
发明人: Zhe Lin , Haitian Zheng , Elya Shechtman , Jianming Zhang , Jingwan Lu , Ning Xu , Qing Liu , Scott Cohen , Sohrab Amirghodsi
CPC分类号: G06T5/005 , G06T7/11 , G06T2200/24 , G06T2207/20081 , G06T2207/20084
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
-
公开(公告)号:US20240127410A1
公开(公告)日:2024-04-18
申请号:US17937695
申请日:2022-10-03
申请人: Adobe Inc.
发明人: Zhe Lin , Haitian Zheng , Elya Shechtman , Jianming Zhang , Jingwan Lu , Ning Xu , Qing Liu , Scott Cohen , Sohrab Amirghodsi
CPC分类号: G06T5/005 , G06T7/11 , G06T2207/20084
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for panoptically guiding digital image inpainting utilizing a panoptic inpainting neural network. In some embodiments, the disclosed systems utilize a panoptic inpainting neural network to generate an inpainted digital image according to panoptic segmentation map that defines pixel regions corresponding to different panoptic labels. In some cases, the disclosed systems train a neural network utilizing a semantic discriminator that facilitates generation of digital images that are realistic while also conforming to a semantic segmentation. The disclosed systems generate and provide a panoptic inpainting interface to facilitate user interaction for inpainting digital images. In certain embodiments, the disclosed systems iteratively update an inpainted digital image based on changes to a panoptic segmentation map.
-
公开(公告)号:US11915133B2
公开(公告)日:2024-02-27
申请号:US17468546
申请日:2021-09-07
申请人: Adobe Inc.
发明人: Ratheesh Kalarot , Kevin Wampler , Jingwan Lu , Jakub Fiser , Elya Shechtman , Aliakbar Darabi , Alexandru Vasile Costin
IPC分类号: G06K9/00 , G06N3/08 , G06F3/04845 , G06F3/04847 , G06T11/60 , G06N20/20 , G06T5/00 , G06T5/20 , G06T3/00 , G06T3/40 , G06T11/00 , G06F18/40 , G06F18/211 , G06F18/214 , G06F18/21 , G06N3/045
CPC分类号: G06N3/08 , G06F3/04845 , G06F3/04847 , G06F18/211 , G06F18/214 , G06F18/2163 , G06F18/40 , G06N3/045 , G06N20/20 , G06T3/0006 , G06T3/0093 , G06T3/40 , G06T3/4038 , G06T3/4046 , G06T5/005 , G06T5/20 , G06T11/001 , G06T11/60 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2210/22
摘要: Systems and methods seamlessly blend edited and unedited regions of an image. A computing system crops an input image around a region to be edited. The system applies an affine transformation to rotate the cropped input image. The system provides the rotated cropped input image as input to a machine learning model to generate a latent space representation of the rotated cropped input image. The system edits the latent space representation and provides the edited latent space representation to a generator neural network to generate a generated edited image. The system applies an inverse affine transformation to rotate the generated edited image and aligns an identified segment of the rotated generated edited image with an identified corresponding segment of the input image to produce an aligned rotated generated edited image. The system blends the aligned rotated generated edited image with the input image to generate an edited output image.
-
公开(公告)号:US11861762B2
公开(公告)日:2024-01-02
申请号:US17400474
申请日:2021-08-12
申请人: Adobe Inc.
发明人: Yuheng Li , Yijun Li , Jingwan Lu , Elya Shechtman , Krishna Kumar Singh
IPC分类号: G06T11/00
CPC分类号: G06T11/00 , G06T2210/12
摘要: This disclosure describes methods, non-transitory computer readable storage media, and systems that generate synthetized digital images using class-specific generators for objects of different classes. The disclosed system modifies a synthesized digital image by utilizing a plurality of class-specific generator neural networks to generate a plurality of synthesized objects according to object classes identified in the synthesized digital image. The disclosed system determines object classes in the synthesized digital image such as via a semantic label map corresponding to the synthesized digital image. The disclosed system selects class-specific generator neural networks corresponding to the classes of objects in the synthesized digital image. The disclosed system also generates a plurality of synthesized objects utilizing the class-specific generator neural networks based on contextual data associated with the identified objects. The disclosed system generates a modified synthesized digital image by replacing the identified objects in the synthesized digital images with the synthesized objects.
-
公开(公告)号:US11854244B2
公开(公告)日:2023-12-26
申请号:US18048311
申请日:2022-10-20
申请人: Adobe Inc.
发明人: Sohrab Amirghodsi , Zhe Lin , Yilin Wang , Tianshu Yu , Connelly Barnes , Elya Shechtman
IPC分类号: G06V10/75 , G06F17/18 , G06N3/08 , G06N20/00 , G06V10/82 , G06F18/214 , G06F18/22 , G06F18/211 , G06F18/213 , G06V10/74 , G06V10/771 , G06V10/774 , G06V20/70
CPC分类号: G06V10/757 , G06F17/18 , G06F18/211 , G06F18/213 , G06F18/214 , G06F18/22 , G06N3/08 , G06N20/00 , G06V10/761 , G06V10/771 , G06V10/774 , G06V10/82 , G06V20/70
摘要: A panoptic labeling system includes a modified panoptic labeling neural network (“modified PLNN”) that is trained to generate labels for pixels in an input image. The panoptic labeling system generates modified training images by combining training images with mask instances from annotated images. The modified PLNN determines a set of labels representing categories of objects depicted in the modified training images. The modified PLNN also determines a subset of the labels representing categories of objects depicted in the input image. For each mask pixel in a modified training image, the modified PLNN calculates a probability indicating whether the mask pixel has the same label as an object pixel. The modified PLNN generates a mask label for each mask pixel, based on the probability. The panoptic labeling system provides the mask label to, for example, a digital graphics editing system that uses the labels to complete an infill operation.
-
9.
公开(公告)号:US20230368339A1
公开(公告)日:2023-11-16
申请号:US17663317
申请日:2022-05-13
申请人: Adobe Inc.
发明人: Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Elya Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi
CPC分类号: G06T5/005 , G06T7/11 , G06N3/04 , G06T2207/20081 , G06T2207/20084
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media that generate inpainted digital images utilizing class-specific cascaded modulation inpainting neural network. For example, the disclosed systems utilize a class-specific cascaded modulation inpainting neural network that includes cascaded modulation decoder layers to generate replacement pixels portraying a particular target object class. To illustrate, in response to user selection of a replacement region and target object class, the disclosed systems utilize a class-specific cascaded modulation inpainting neural network corresponding to the target object class to generate an inpainted digital image that portrays an instance of the target object class within the replacement region. Moreover, in one or more embodiments the disclosed systems train class-specific cascaded modulation inpainting neural networks corresponding to a variety of target object classes, such as a sky object class, a water object class, a ground object class, or a human object class.
-
公开(公告)号:US11762951B2
公开(公告)日:2023-09-19
申请号:US16951782
申请日:2020-11-18
申请人: Adobe Inc.
发明人: Elya Shechtman , William Peebles , Richard Zhang , Jun-Yan Zhu , Alyosha Efros
IPC分类号: G06F18/21 , G06N3/08 , G06T3/00 , G06F18/214 , G06N3/045
CPC分类号: G06F18/217 , G06F18/214 , G06N3/045 , G06N3/08 , G06T3/0068
摘要: Embodiments are disclosed for generative image congealing which provides an unsupervised learning technique that learns transformations of real data to improve the image quality of GANs trained using that image data. In particular, in one or more embodiments, the disclosed systems and methods comprise generating, by a spatial transformer network, an aligned real image for a real image from an unaligned real dataset, providing, by the spatial transformer network, the aligned real image to an adversarial discrimination network to determine if the aligned real image resembles aligned synthetic images generated by a generator network, and training, by a training manager, the spatial transformer network to learn updated transformations based on the determination of the adversarial discrimination network.
-
-
-
-
-
-
-
-
-