公开(公告)号：US11776184B2

公开(公告)日：2023-10-03

申请号：US17204638

申请日：2021-03-17

Applicant: ADOBE INC.

Inventor： Jianming Zhang ,  Alan Erickson ,  I-Ming Pao ,  Guotong Feng ,  Kalyan Sunkavalli ,  Frederick Mandia ,  Hyunghwan Byun ,  Betty Leong ,  Meredith Payne Stotzner ,  Yukie Takahashi ,  Quynn Megan Le ,  Sarah Kong

IPC: G06T11/60 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/00

CPC classification number: G06T11/60 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/001

Abstract: The present disclosure provides systems and methods for image editing. Embodiments of the present disclosure provide an image editing system for perform image object replacement or image region replacement (e.g., an image editing system for replacing an object or region of an image with an object or region from another image). For example, the image editing system may replace a sky portion of an image with a more desirable sky portion from a different replacement image. The original image and the replacement image (e.g., the image including a desirable object or region) include layers of masks. A sky from the replacement image may replace the sky of the image to produce an aesthetically pleasing composite image.

公开(公告)号：US20190073093A1

公开(公告)日：2019-03-07

申请号：US16180956

申请日：2018-11-05

Applicant: Adobe Inc.

Inventor： Yuyan Song ,  Sarah Kong ,  Alan L. Erickson ,  Bradee R. Evans ,  Aseem O. Agarwala

IPC: G06F3/0481 ,  G06F3/0486 ,  G06F3/0484

Abstract: A mesh is a collection of multiple shapes referred to as elements, each of which can share an edge with one or more other elements of the mesh. The mesh is presented to the user on a display, and the user identifies a new element to be added to the mesh. User input is received to manipulate the new element (e.g., move the new element around the display). As the new element is manipulated, various conditions are applied to determine edges of elements existing in the mesh that the new element can be snapped to. Snapping a new element to an edge of an existing element in the mesh refers to adding the new element to the mesh so that the new element and the existing element share the edge. Indications of the edges of existing elements to which the new element can be snapped are provided to the user.

公开(公告)号：US20230128276A1

公开(公告)日：2023-04-27

申请号：US17584140

申请日：2022-01-25

Applicant: Adobe Inc.

Inventor： Alan L Erickson ,  Sarah Kong ,  Betty Leong

IPC: G06T1/00 ,  G06V10/82

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for determining whether a derived attribute from a request is stored at a derived attribute cache. In particular, in one or more embodiments, the disclosed systems obtain the derived attribute from artificial-intelligence models if the derived attribute is unavailable at the derived attribute cache. If the derived attribute is available at the derived attribute cache, the disclosed system returns the derived attribute in response to a request without having the artificial-intelligence models rederive the attribute.

公开(公告)号：US10366525B2

公开(公告)日：2019-07-30

申请号：US15712693

申请日：2017-09-22

Applicant: Adobe Inc.

Inventor： I-Ming Pao ,  Yuyan Song ,  Sarah Kong

IPC: G06T13/40 ,  G06T19/00 ,  G06T17/00 ,  H04N5/232

Abstract: The present disclosure is directed toward systems and methods for generating an interactive digital media item based on a two-dimensional “selfie.” For example, one or more embodiments described herein identifies a face in the two-dimensional “selfie,” then builds and displays a three-dimensional model based on the identified face. One or more embodiments described herein also track movement of a viewer of a computing device displaying the three-dimensional model such that one or more portions of the three-dimensional model appear to follow the person viewing the “selfie.”

公开(公告)号：US20230129341A1

公开(公告)日：2023-04-27

申请号：US17584233

申请日：2022-01-25

Applicant: Adobe Inc.

Inventor： Betty Leong ,  Hyunghwan Byun ,  Alan L Erickson ,  Chih-Yao Hsieh ,  Sarah Kong ,  Seyed Morteza Safdarnejad ,  Salil Tambe ,  Yilin Wang ,  Zijun Wei ,  Zhengyun Zhang

IPC: G06T7/10 ,  G06F3/04842 ,  G06T3/40

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generate preliminary object masks for objects in an image, surface the preliminary object masks as object mask previews, and on-demand converts preliminary object masks into refined object masks. Indeed, in one or more implementations, an object mask preview and on-demand generation system automatically detects objects in an image. For the detected objects, the object mask preview and on-demand generation system generates preliminary object masks for the detected objects of a first lower resolution. The object mask preview and on-demand generation system surfaces a given preliminary object mask in response to detecting a first input. The object mask preview and on-demand generation system also generates a refined object mask of a second higher resolution in response to detecting a second input.

公开(公告)号：US20220292654A1

公开(公告)日：2022-09-15

申请号：US17200338

申请日：2021-03-12

Applicant: Adobe Inc.

Inventor： He Zhang ,  Yifan Jiang ,  Yilin Wang ,  Jianming Zhang ,  Kalyan Sunkavalli ,  Sarah Kong ,  Su Chen ,  Sohrab Amirghodsi ,  Zhe Lin

IPC: G06T5/50 ,  G06T7/194 ,  G06T11/60 ,  G06T11/00 ,  G06N3/04 ,  G06N3/08

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating harmonized digital images utilizing a self-supervised image harmonization neural network. In particular, the disclosed systems can implement, and learn parameters for, a self-supervised image harmonization neural network to extract content from one digital image (disentangled from its appearance) and appearance from another from another digital image (disentangled from its content). For example, the disclosed systems can utilize a dual data augmentation method to generate diverse triplets for parameter learning (including input digital images, reference digital images, and pseudo ground truth digital images), via cropping a digital image with perturbations using three-dimensional color lookup tables (“LUTs”). Additionally, the disclosed systems can utilize the self-supervised image harmonization neural network to generate harmonized digital images that depict content from one digital image having the appearance of another digital image.

公开(公告)号：US11257491B2

公开(公告)日：2022-02-22

申请号：US16205126

申请日：2018-11-29

Applicant: Adobe Inc.

Inventor： Sarah Kong ,  Yinglan Ma ,  Hyunghwan Byun ,  Chih-Yao Hsieh

IPC: G10L15/22 ,  G06F3/16 ,  G06T11/60 ,  G06F3/0484 ,  G06F3/04845

Abstract: This application relates generally to modifying visual data based on audio commands and more specifically, to performing complex operations that modify visual data based on one or more audio commands. In some embodiments, a computer system may receive an audio input and identify an audio command based on the audio input. The audio command may be mapped to one or more operations capable of being performed by a multimedia editing application. The computer system may perform the one or more operations to edit to received multimedia data.

公开(公告)号：US20240185393A1

公开(公告)日：2024-06-06

申请号：US18440248

申请日：2024-02-13

Applicant: Adobe Inc.

Inventor： He Zhang ,  Yifan Jiang ,  Yilin Wang ,  Jianming Zhang ,  Kalyan Sunkavalli ,  Sarah Kong ,  Su Chen ,  Sohrab Amirghodsi ,  Zhe Lin

IPC: G06T5/50 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06T5/50 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20092 ,  G06T2207/20132 ,  G06T2207/20212

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating harmonized digital images utilizing a self-supervised image harmonization neural network. In particular, the disclosed systems can implement, and learn parameters for, a self-supervised image harmonization neural network to extract content from one digital image (disentangled from its appearance) and appearance from another from another digital image (disentangled from its content). For example, the disclosed systems can utilize a dual data augmentation method to generate diverse triplets for parameter learning (including input digital images, reference digital images, and pseudo ground truth digital images), via cropping a digital image with perturbations using three-dimensional color lookup tables (“LUTs”). Additionally, the disclosed systems can utilize the self-supervised image harmonization neural network to generate harmonized digital images that depict content from one digital image having the appearance of another digital image.

公开(公告)号：US11935217B2

公开(公告)日：2024-03-19

申请号：US17200338

申请日：2021-03-12

Applicant: Adobe Inc.

Inventor： He Zhang ,  Yifan Jiang ,  Yilin Wang ,  Jianming Zhang ,  Kalyan Sunkavalli ,  Sarah Kong ,  Su Chen ,  Sohrab Amirghodsi ,  Zhe Lin

IPC: G06T7/00 ,  G06N3/04 ,  G06N3/08 ,  G06T5/50 ,  G06T7/194 ,  G06T11/00 ,  G06T11/60

CPC classification number: G06T5/50 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194 ,  G06T11/001 ,  G06T11/60 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20092 ,  G06T2207/20132 ,  G06T2207/20212

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately, efficiently, and flexibly generating harmonized digital images utilizing a self-supervised image harmonization neural network. In particular, the disclosed systems can implement, and learn parameters for, a self-supervised image harmonization neural network to extract content from one digital image (disentangled from its appearance) and appearance from another from another digital image (disentangled from its content). For example, the disclosed systems can utilize a dual data augmentation method to generate diverse triplets for parameter learning (including input digital images, reference digital images, and pseudo ground truth digital images), via cropping a digital image with perturbations using three-dimensional color lookup tables (“LUTs”). Additionally, the disclosed systems can utilize the self-supervised image harmonization neural network to generate harmonized digital images that depict content from one digital image having the appearance of another digital image.

公开(公告)号：US20200175975A1

公开(公告)日：2020-06-04

申请号：US16205126

申请日：2018-11-29

Applicant: Adobe Inc.

Inventor： Sarah Kong ,  Yinglan Ma ,  Hyunghwan Byun ,  Chih-Yao Hsieh

IPC: G10L15/22 ,  G06F3/16 ,  G06F3/0484 ,  G06T11/60

Abstract: This application relates generally to modifying visual data based on audio commands and more specifically, to performing complex operations that modify visual data based on one or more audio commands. In some embodiments, a computer system may receive an audio input and identify an audio command based on the audio input. The audio command may be mapped to one or more operations capable of being performed by a multimedia editing application. The computer system may perform the one or more operations to edit to received multimedia data.