公开(公告)号：US20240355022A1

公开(公告)日：2024-10-24

申请号：US18476504

申请日：2023-09-28

Applicant: ADOBE INC.

Inventor： Jing Shi ,  Wei Xiong ,  Zhe Lin ,  Hyun Joon Jung

IPC: G06T11/60 ,  G06T7/194 ,  G06T9/00

CPC classification number: G06T11/60 ,  G06T7/194 ,  G06T9/00 ,  G06T2207/20081

Abstract: One or more aspects of a method, apparatus, and non-transitory computer readable medium include obtaining an input description and an input image depicting a subject, encoding the input description using a text encoder of an image generation model to obtain a text embedding, and encoding the input image using a subject encoder of the image generation model to obtain a subject embedding. A guidance embedding is generated by combining the subject embedding and the text embedding, and then an output image is generated based on the guidance embedding using a diffusion model of the image generation model. The output image depicts aspects of the subject and the input description.

公开(公告)号：US20200327675A1

公开(公告)日：2020-10-15

申请号：US16384039

申请日：2019-04-15

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Wei Xiong ,  Connelly Barnes ,  Jimei Yang ,  Xin Lu

IPC: G06T7/149 ,  G06T7/13 ,  G06T5/00 ,  G06T7/194

Abstract: In some embodiments, an image manipulation application receives an incomplete image that includes a hole area lacking image content. The image manipulation application applies a contour detection operation to the incomplete image to detect an incomplete contour of a foreground object in the incomplete image. The hole area prevents the contour detection operation from detecting a completed contour of the foreground object. The image manipulation application further applies a contour completion model to the incomplete contour and the incomplete image to generate the completed contour for the foreground object. Based on the completed contour and the incomplete image, the image manipulation application generates image content for the hole area to generate a completed image.

公开(公告)号：US20210082124A1

公开(公告)日：2021-03-18

申请号：US17103119

申请日：2020-11-24

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Wei Xiong ,  Connelly Barnes ,  Jimei Yang ,  Xin Lu

IPC: G06T7/149 ,  G06T7/13 ,  G06T7/194 ,  G06T5/00

Abstract: In some embodiments, an image manipulation application receives an incomplete image that includes a hole area lacking image content. The image manipulation application applies a contour detection operation to the incomplete image to detect an incomplete contour of a foreground object in the incomplete image. The hole area prevents the contour detection operation from detecting a completed contour of the foreground object. The image manipulation application further applies a contour completion model to the incomplete contour and the incomplete image to generate the completed contour for the foreground object. Based on the completed contour and the incomplete image, the image manipulation application generates image content for the hole area to generate a completed image.

公开(公告)号：US11321847B2

公开(公告)日：2022-05-03

申请号：US17103119

申请日：2020-11-24

Applicant: Adobe Inc.

Inventor： Zhe Lin ,  Wei Xiong ,  Connelly Barnes ,  Jimei Yang ,  Xin Lu

IPC: G06T7/149 ,  G06T7/13 ,  G06T7/194 ,  G06T5/00

Abstract: In some embodiments, an image manipulation application receives an incomplete image that includes a hole area lacking image content. The image manipulation application applies a contour detection operation to the incomplete image to detect an incomplete contour of a foreground object in the incomplete image. The hole area prevents the contour detection operation from detecting a completed contour of the foreground object. The image manipulation application further applies a contour completion model to the incomplete contour and the incomplete image to generate the completed contour for the foreground object. Based on the completed contour and the incomplete image, the image manipulation application generates image content for the hole area to generate a completed image.