公开(公告)号：US20230037282A9

公开(公告)日：2023-02-02

申请号：US17232890

申请日：2021-04-16

Applicant: ADOBE INC

Inventor： Alan Erickson ,  Kalyan Sunkavalli ,  I-Ming Pao ,  Guotong Feng ,  Jianming Zhang ,  Frederick Mandia

IPC: G06T11/60 ,  G06T11/40 ,  G06N3/02

Abstract: Systems and methods for image editing are described. Embodiments of the present disclosure provide an image editing system for performing image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. According to some embodiments described herein, real-time color harmonization based on the visible sky region may be used to produce more natural colorization. In some examples, horizon-aware sky alignment and placement with advanced padding may also be used. For example, the horizons of the original image and the replacement image may be automatically detected and aligned, and color harmonization may be performed based on the aligned images.

公开(公告)号：US20230005197A9

公开(公告)日：2023-01-05

申请号：US17204638

申请日：2021-03-17

Applicant: ADOBE INC.

Inventor： JIANMING ZHANG ,  Alan Erickson ,  I-Ming Pao ,  Guotong Feng ,  Kalyan Sunkavalli ,  Frederick Mandia ,  Hyunghwan Byun ,  Betty Leong ,  Meredith Payne Stotzner ,  Yukie Takahashi ,  Quynn Megan Le ,  Sarah Kong

IPC: G06T11/60 ,  G06T11/00 ,  G06F3/0484

Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.

公开(公告)号：US11468614B2

公开(公告)日：2022-10-11

申请号：US17214918

申请日：2021-03-28

Applicant: Adobe Inc.

Inventor： Sarah Aye Kong ,  I-Ming Pao ,  Hyunghwan Byun

IPC: G06T11/60 ,  G06T7/11 ,  G06T7/194

Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.

公开(公告)号：US20220301243A1

公开(公告)日：2022-09-22

申请号：US17204638

申请日：2021-03-17

Applicant: ADOBE INC.

Inventor： JIANMING ZHANG ,  Alan Erickson ,  I-Ming Pao ,  Guotong Feng ,  Kalyan Sunkavalli ,  Frederick Mandia ,  Hyunghwan Byun ,  Betty Leong ,  Meredith Payne Stotzner ,  Yukie Takahashi ,  Quynn Megan Le ,  Sarah Kong

IPC: G06T11/60 ,  G06T11/00 ,  G06F3/0484

Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.

公开(公告)号：US11244195B2

公开(公告)日：2022-02-08

申请号：US15967928

申请日：2018-05-01

Applicant: Adobe Inc.

Inventor： I-Ming Pao ,  Zhe Lin ,  Sarah Stuckey ,  Jianming Zhang ,  Betty Leong

IPC: G06K9/46 ,  G06K9/62 ,  G06T3/40

Abstract: The present disclosure relates to systems, method, and computer readable media that iteratively apply a neural network to a digital image at a reduced resolution to automatically identify pixels of salient objects portrayed within the digital image. For example, the disclosed systems can generate a reduced-resolution digital image from an input digital image and apply a neural network to identify a region corresponding to a salient object. The disclosed systems can then iteratively apply the neural network to additional reduced-resolution digital images (based on the identified region) to generate one or more reduced-resolution segmentation maps that roughly indicate pixels of the salient object. In addition, the systems described herein can perform post-processing based on the reduced-resolution segmentation map(s) and the input digital image to accurately determine pixels that correspond to the salient object.

公开(公告)号：US11036915B2

公开(公告)日：2021-06-15

申请号：US15067108

申请日：2016-03-10

Applicant: ADOBE INC.

Inventor： I-Ming Pao ,  Zhaowen Wang ,  Hailin Jin ,  Alan Lee Erickson

IPC: G06F40/109 ,  G06N3/04

Abstract: Embodiments of the present invention are directed at providing a font similarity system. In one embodiment, a new font is detected on a computing device. In response to the detection of the new font, a pre-computed font list is checked to determine whether the new font is included therein. The pre-computed font list including feature representations, generated independently of the computing device, for corresponding fonts. In response to a determination that the new font is absent from the pre-computed font list, a feature representation for the new font is generated. The generated feature representation capable of being utilized for a similarity analysis of the new font. The feature representation is then stored in a supplemental font list to enable identification of one or more fonts installed on the computing device that are similar to the new font. Other embodiments may be described and/or claimed.

公开(公告)号：US20190295223A1

公开(公告)日：2019-09-26

申请号：US15928706

申请日：2018-03-22

Applicant: ADOBE INC.

Inventor： Xiaohui Shen ,  Zhe Lin ,  Xin Lu ,  Sarah Aye Kong ,  I-Ming Pao ,  Yingcong Chen

IPC: G06T5/00 ,  G06N3/08 ,  G06K9/62 ,  G06K9/66

Abstract: Methods and systems are provided for generating enhanced image. A neural network system is trained where the training includes training a first neural network that generates enhanced images conditioned on content of an image undergoing enhancement and training a second neural network that designates realism of the enhanced images generated by the first neural network. The neural network system is trained by determine loss and accordingly adjusting the appropriate neural network(s). The trained neural network system is used to generate an enhanced aesthetic image from a selected image where the output enhanced aesthetic image has increased aesthetics when compared to the selected image.

公开(公告)号：US20190164322A1

公开(公告)日：2019-05-30

申请号：US15826162

申请日：2017-11-29

Applicant: Adobe Inc.

Inventor： Sarah Aye Kong ,  I-Ming Pao ,  Hyunghwan Byun

IPC: G06T11/60 ,  G06T7/11 ,  G06T7/194

Abstract: Methods and systems are provided for presenting and using multiple masks based on a segmented image in editing the image. In particular, multiple masks can be presented to a user using a graphical user interface for easy selection and utilization in the editing of an image. The graphical user interface can include a display configured to display an image, a mask zone configured to display segmentations of the image using masks, and an edit zone configured to display edits to the image. Upon receiving segmentation for the image, the masks can be displayed in the mask zone where the masks are based on a selected segmentation detail level.

公开(公告)号：US20190096112A1

公开(公告)日：2019-03-28

申请号：US15712693

申请日：2017-09-22

Applicant: Adobe Inc.

Inventor： I-Ming Pao ,  Yuyan Song ,  Sarah Kong

IPC: G06T13/40 ,  H04N5/232 ,  G06F3/01

CPC classification number: G06T13/40 ,  G06K9/00248 ,  G06T7/00 ,  G06T17/00 ,  G06T19/00 ,  H04N5/23219

Abstract: The present disclosure is directed toward systems and methods for generating an interactive digital media item based on a two-dimensional “selfie.” For example, one or more embodiments described herein identifies a face in the two-dimensional “selfie,” then builds and displays a three-dimensional model based on the identified face. One or more embodiments described herein also track movement of a viewer of a computing device displaying the three-dimensional model such that one or more portions of the three-dimensional model appear to follow the person viewing the “selfie.”