公开(公告)号：US11763495B2

公开(公告)日：2023-09-19

申请号：US17163284

申请日：2021-01-29

Applicant: Adobe Inc.

Inventor： Utkarsh Ojha ,  Yijun Li ,  Richard Zhang ,  Jingwan Lu ,  Elya Shechtman ,  Alexei A. Efros

IPC: G06T11/00 ,  G06N3/02 ,  G06F18/22 ,  G06F18/214

CPC classification number: G06T11/00 ,  G06F18/214 ,  G06F18/22 ,  G06N3/02

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and efficiently modifying a generative adversarial neural network using few-shot adaptation to generate digital images corresponding to a target domain while maintaining diversity of a source domain and realism of the target domain. In particular, the disclosed systems utilize a generative adversarial neural network with parameters learned from a large source domain. The disclosed systems preserve relative similarities and differences between digital images in the source domain using a cross-domain distance consistency loss. In addition, the disclosed systems utilize an anchor-based strategy to encourage different levels or measures of realism over digital images generated from latent vectors in different regions of a latent space.

公开(公告)号：US20230245363A1

公开(公告)日：2023-08-03

申请号：US18298138

申请日：2023-04-10

Applicant: Adobe Inc.

Inventor： Taesung Park ,  Alexei A. Efros ,  Elya Shechtman ,  Richard Zhang ,  Junyan Zhu

IPC: G06T11/60 ,  G06N3/088 ,  G06T7/10 ,  G06N3/045

CPC classification number: G06T11/60 ,  G06N3/088 ,  G06T7/10 ,  G06N3/045

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating modified digital images utilizing a novel swapping autoencoder that incorporates scene layout. In particular, the disclosed systems can receive a scene layout map that indicates or defines locations for displaying specific digital content within a digital image. In addition, the disclosed systems can utilize the scene layout map to guide combining portions of digital image latent code to generate a modified digital image with a particular textural appearance and a particular geometric structure defined by the scene layout map. Additionally, the disclosed systems can utilize a scene layout map that defines a portion of a digital image to modify by, for instance, adding new digital content to the digital image, and can generate a modified digital image depicting the new digital content.

公开(公告)号：US11024060B1

公开(公告)日：2021-06-01

申请号：US16812669

申请日：2020-03-09

Applicant: Adobe Inc.

Inventor： Liqian Ma ,  Jingwan Lu ,  Zhe Lin ,  Connelly Barnes ,  Alexei A. Efros

IPC: G09G5/00 ,  G06T11/00 ,  G06K9/00 ,  G06T11/60 ,  G06T11/40 ,  G06K9/62

Abstract: Techniques are provided for converting a self-portrait image into a neutral-pose portrait image, including receiving a self-portrait input image, which contains at least one person who is the subject of the self-portrait. A nearest pose search selects a target neutral-pose image that closely matches or approximates the pose of the upper torso region of the subject in the self-portrait input image. Coordinate-based inpainting maps pixels from the upper torso region in the self-portrait input image to corresponding regions in the selected target neutral-pose image to produce a coarse result image. A neutral-pose composition refines the coarse result image by synthesizing details in the body region of the subject (which in some cases includes the subject's head, arms, and torso), and inpainting pixels into missing portions of the background. The refined image is composited with the original self-portrait input image to produce a neutral-pose result image.