-
公开(公告)号：US20200184697A1
公开(公告)日：2020-06-11
申请号：US16794908
申请日：2020-02-19
Applicant: Adobe Inc.
Inventor： Kalyan Krishna Sunkavalli , Nathan Aaron Carr , Michal Lukác , Elya Shechtman
Abstract: Image modification using detected symmetry is described. In example implementations, an image modification module detects multiple local symmetries in an original image by discovering repeated correspondences that are each related by a transformation. The transformation can include a translation, a rotation, a reflection, a scaling, or a combination thereof. Each repeated correspondence includes three patches that are similar to one another and are respectively defined by three pixels of the original image. The image modification module generates a global symmetry of the original image by analyzing an applicability to the multiple local symmetries of multiple candidate homographies contributed by the multiple local symmetries. The image modification module associates individual pixels of the original image with a global symmetry indicator to produce a global symmetry association map. The image modification module produces a manipulated image by manipulating the original image under global symmetry constraints imposed by the global symmetry association map.
-
公开(公告)号：US10453491B2
公开(公告)日：2019-10-22
申请号：US16273981
申请日：2019-02-12
Applicant: Adobe Inc.
Inventor： Geoffrey Oxholm , Elya Shechtman , Oliver Wang
Abstract: Provided are video processing architectures and techniques configured to generate looping video. The video processing architectures and techniques automatically produce a looping video from a fixed-length video clip. Embodiments of the video processing architectures and techniques determine a lower-resolution version of the fixed-length video clip, and detect a presence of edges within image frames in the lower-resolution version. A pair of image frames having similar edges is identified as a pair of candidates for a transition point (i.e., a start frame and an end frame) at which the looping video can repeat. Using start and end frames having similar edges mitigates teleporting of objects displayed in the looping video. In some cases, teleporting during repeating is eliminated.
-
公开(公告)号：US20190236753A1
公开(公告)日：2019-08-01
申请号：US16379496
申请日：2019-04-09
Applicant: Adobe Inc.
Inventor： Xue Bai , Elya Shechtman , Sylvain Philippe Paris
CPC classification number: G06T3/20 , G06T3/0012 , G06T3/40 , G06T3/4038 , G06T5/005 , G06T7/60
Abstract: Environmental map generation techniques and systems are described. A digital image is scaled to achieve a target aspect ratio using a content aware scaling technique. A canvas is generated that is dimensionally larger than the scaled digital image and the scaled digital image is inserted within the canvas thereby resulting in an unfilled portion of the canvas. An initially filled canvas is then generated by filling the unfilled portion using a content aware fill technique based on the inserted digital image. A plurality of polar coordinate canvases is formed by transforming original coordinates of the canvas into polar coordinates. The unfilled portions of the polar coordinate canvases are filled using a content-aware fill technique that is initialized based on the initially filled canvas. An environmental map of the digital image is generated by combining a plurality of original coordinate canvas portions formed from the polar coordinate canvases.
-
公开(公告)号：US10282815B2
公开(公告)日：2019-05-07
申请号：US15377875
申请日：2016-12-13
Applicant: Adobe Inc.
Inventor： Xue Bai , Elya Shechtman , Sylvain Philippe Paris
Abstract: Environmental map generation techniques and systems are described. A digital image is scaled to achieve a target aspect ratio using a content aware scaling technique. A canvas is generated that is dimensionally larger than the scaled digital image and the scaled digital image is inserted within the canvas thereby resulting in an unfilled portion of the canvas. An initially filled canvas is then generated by filling the unfilled portion using a content aware fill technique based on the inserted digital image. A plurality of polar coordinate canvases is formed by transforming original coordinates of the canvas into polar coordinates. The unfilled portions of the polar coordinate canvases are filled using a content-aware fill technique that is initialized based on the initially filled canvas. An environmental map of the digital image is generated by combining a plurality of original coordinate canvas portions formed from the polar coordinate canvases.
-
115.发明授权公开(公告)号：US12211178B2
公开(公告)日：2025-01-28
申请号：US17660090
申请日：2022-04-21
Applicant: Adobe Inc.
Inventor： Tobias Hinz , Shabnam Ghadar , Richard Zhang , Ratheesh Kalarot , Jingwan Lu , Elya Shechtman
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for combining digital images. In particular, in one or more embodiments, the disclosed systems combine latent codes of a source digital image and a target digital image utilizing a blending network to determine a combined latent encoding and generate a combined digital image from the combined latent encoding utilizing a generative neural network. In some embodiments, the disclosed systems determine an intersection face mask between the source digital image and the combined digital image utilizing a face segmentation network and combine the source digital image and the combined digital image utilizing the intersection face mask to generate a blended digital image.
-
Patent Agency Ranking
116.发明授权公开(公告)号：US12192593B2
公开(公告)日：2025-01-07
申请号：US18164348
申请日：2023-02-03
Applicant: Adobe Inc.
Inventor： Xiaojuan Wang , Richard Zhang , Taesung Park , Yang Zhou , Elya Shechtman
IPC: H04N21/234 , G06V10/771 , G06V10/82 , H04N21/81
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that utilize machine learning to generate a sequence of transition frames for a gap in a clipped digital video. For example, the disclosed system receives a clipped digital video that includes a pre-cut frame prior to a gap in the clipped digital video and a post-cut frame following the gap in the clipped digital video. Moreover, the disclosed system utilizes a natural motion sequence model to generates a sequence of transition keypoint maps between the pre-cut frame and the post-cut frame. Furthermore, using a generative neural network, the disclosed system generates a sequence of transition frames for the gap in the clipped digital video from the sequence of transition keypoint maps.
-
117.发明授权公开(公告)号：US12190484B2
公开(公告)日：2025-01-07
申请号：US17202019
申请日：2021-03-15
Applicant: Adobe Inc.
Inventor： Sohrab Amirghodsi , Lingzhi Zhang , Zhe Lin , Connelly Barnes , Elya Shechtman
IPC: G06T5/77 , G06N3/08 , G06T3/4053 , G06T7/11 , G06T7/50
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating modified digital images utilizing a guided inpainting approach that implements a patch match model informed by a deep visual guide. In particular, the disclosed systems can utilize a visual guide algorithm to automatically generate guidance maps to help identify replacement pixels for inpainting regions of digital images utilizing a patch match model. For example, the disclosed systems can generate guidance maps in the form of structure maps, depth maps, or segmentation maps that respectively indicate the structure, depth, or segmentation of different portions of digital images. Additionally, the disclosed systems can implement a patch match model to identify replacement pixels for filling regions of digital images according to the structure, depth, and/or segmentation of the digital images.
-
公开(公告)号：US12165295B2
公开(公告)日：2024-12-10
申请号：US17661985
申请日：2022-05-04
Applicant: Adobe Inc.
Inventor： Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Elya Shechtman , Connelly Barnes , Jianming Zhang , Ning Xu , Sohrab Amirghodsi
IPC: G06T5/77 , G06T3/4046 , G06V10/40
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that generate inpainted digital images utilizing a cascaded modulation inpainting neural network. For example, the disclosed systems utilize a cascaded modulation inpainting neural network that includes cascaded modulation decoder layers. For example, in one or more decoder layers, the disclosed systems start with global code modulation that captures the global-range image structures followed by an additional modulation that refines the global predictions. Accordingly, in one or more implementations, the image inpainting system provides a mechanism to correct distorted local details. Furthermore, in one or more implementations, the image inpainting system leverages fast Fourier convolutions block within different resolution layers of the encoder architecture to expand the receptive field of the encoder and to allow the network encoder to better capture global structure.
-
119.发明授权公开(公告)号：US12159380B2
公开(公告)日：2024-12-03
申请号：US17664991
申请日：2022-05-25
Applicant: Adobe Inc.
Inventor： Connelly Barnes , Elya Shechtman , Sohrab Amirghodsi , Zhe Lin
Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media that implement an inpainting framework having computer-implemented machine learning models to generate high-resolution inpainting results. For instance, in one or more embodiments, the disclosed systems generate an inpainted digital image utilizing a deep inpainting neural network from a digital image having a replacement region. The disclosed systems further generate, utilizing a visual guide algorithm, at least one deep visual guide from the inpainted digital image. Using a patch match model and the at least one deep visual guide, the disclosed systems generate a plurality of modified digital images from the digital image by replacing the region of pixels of the digital image with replacement pixels. Additionally, the disclosed systems select, utilizing an inpainting curation model, a modified digital image from the plurality of modified digital images to provide to a client device.
-
公开(公告)号：US20240331214A1
公开(公告)日：2024-10-03
申请号：US18610861
申请日：2024-03-20
Applicant: ADOBE INC.
Inventor： Yuqian Zhou , Elya Shechtman , Zhe Lin , Krishna Kumar Singh , Jingwan Lu , Connelly Stuart Barnes , Sohrab Amirghodsi
IPC: G06T11/00 , G06T3/4046 , G06T5/30
CPC classification number: G06T11/00 , G06T3/4046 , G06T5/30 , G06T2200/24 , G06T2207/20084
Abstract: Systems and methods for image processing (e.g., image extension or image uncropping) using neural networks are described. One or more aspects include obtaining an image (e.g., a source image, a user provided image, etc.) having an initial aspect ratio, and identifying a target aspect ratio (e.g., via user input) that is different from the initial aspect ratio. The image may be positioned in an image frame having the target aspect ratio, where the image frame includes an image region containing the image and one or more extended regions outside the boundaries of the image. An extended image may be generated (e.g., using a generative neural network), where the extended image includes the image in the image region as well as generated image portions in the extended regions and the one or more generated image portions comprise an extension of a scene element depicted in the image.
-
-
-
-
-
-
-
-
-
Search Results
198
records
(took 0.022 seconds)
