Generating neutral-pose transformations of self-portrait images

    公开(公告)号:US11024060B1

    公开(公告)日:2021-06-01

    申请号:US16812669

    申请日:2020-03-09

    申请人: Adobe Inc.

    摘要: Techniques are provided for converting a self-portrait image into a neutral-pose portrait image, including receiving a self-portrait input image, which contains at least one person who is the subject of the self-portrait. A nearest pose search selects a target neutral-pose image that closely matches or approximates the pose of the upper torso region of the subject in the self-portrait input image. Coordinate-based inpainting maps pixels from the upper torso region in the self-portrait input image to corresponding regions in the selected target neutral-pose image to produce a coarse result image. A neutral-pose composition refines the coarse result image by synthesizing details in the body region of the subject (which in some cases includes the subject's head, arms, and torso), and inpainting pixels into missing portions of the background. The refined image is composited with the original self-portrait input image to produce a neutral-pose result image.

    FEW-SHOT DIGITAL IMAGE GENERATION USING GAN-TO-GAN TRANSLATION

    公开(公告)号:US20220254071A1

    公开(公告)日:2022-08-11

    申请号:US17163284

    申请日:2021-01-29

    申请人: Adobe Inc.

    IPC分类号: G06T11/00 G06K9/62 G06N3/02

    摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and efficiently modifying a generative adversarial neural network using few-shot adaptation to generate digital images corresponding to a target domain while maintaining diversity of a source domain and realism of the target domain. In particular, the disclosed systems utilize a generative adversarial neural network with parameters learned from a large source domain. The disclosed systems preserve relative similarities and differences between digital images in the source domain using a cross-domain distance consistency loss. In addition, the disclosed systems utilize an anchor-based strategy to encourage different levels or measures of realism over digital images generated from latent vectors in different regions of a latent space.

    Generating modified digital images incorporating scene layout utilizing a swapping autoencoder

    公开(公告)号:US11625875B2

    公开(公告)日:2023-04-11

    申请号:US17091416

    申请日:2020-11-06

    申请人: Adobe Inc.

    摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating modified digital images utilizing a novel swapping autoencoder that incorporates scene layout. In particular, the disclosed systems can receive a scene layout map that indicates or defines locations for displaying specific digital content within a digital image. In addition, the disclosed systems can utilize the scene layout map to guide combining portions of digital image latent code to generate a modified digital image with a particular textural appearance and a particular geometric structure defined by the scene layout map. Additionally, the disclosed systems can utilize a scene layout map that defines a portion of a digital image to modify by, for instance, adding new digital content to the digital image, and can generate a modified digital image depicting the new digital content.

    GENERATING MODIFIED DIGITAL IMAGES INCORPORATING SCENE LAYOUT UTILIZING A SWAPPING AUTOENCODER

    公开(公告)号:US20220148241A1

    公开(公告)日:2022-05-12

    申请号:US17091416

    申请日:2020-11-06

    申请人: Adobe Inc.

    摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating modified digital images utilizing a novel swapping autoencoder that incorporates scene layout. In particular, the disclosed systems can receive a scene layout map that indicates or defines locations for displaying specific digital content within a digital image. In addition, the disclosed systems can utilize the scene layout map to guide combining portions of digital image latent code to generate a modified digital image with a particular textural appearance and a particular geometric structure defined by the scene layout map. Additionally, the disclosed systems can utilize a scene layout map that defines a portion of a digital image to modify by, for instance, adding new digital content to the digital image, and can generate a modified digital image depicting the new digital content.