公开(公告)号：US10692265B2

公开(公告)日：2020-06-23

申请号：US16676733

申请日：2019-11-07

Applicant: Adobe Inc.

Inventor： Sunil Hadap ,  Elya Shechtman ,  Zhixin Shu ,  Kalyan Sunkavalli ,  Mehmet Yumer

IPC: G06K9/62 ,  G06T11/60 ,  G06T5/00 ,  G06N3/04 ,  G06N3/08

Abstract: Techniques are disclosed for performing manipulation of facial images using an artificial neural network. A facial rendering and generation network and method learns one or more compact, meaningful manifolds of facial appearance, by disentanglement of a facial image into intrinsic facial properties, and enables facial edits by traversing paths of such manifold(s). The facial rendering and generation network is able to handle a much wider range of manipulations including changes to, for example, viewpoint, lighting, expression, and even higher-level attributes like facial hair and age—aspects that cannot be represented using previous models.

公开(公告)号：US20200090389A1

公开(公告)日：2020-03-19

申请号：US16676733

申请日：2019-11-07

Applicant: Adobe Inc.

Inventor： Sunil Hadap ,  Elya Shechtman ,  Zhixin Shu ,  Kalyan Sunkavalli ,  Mehmet Yumer

IPC: G06T11/60 ,  G06N3/04 ,  G06N3/08 ,  G06T5/00

Abstract: Techniques are disclosed for performing manipulation of facial images using an artificial neural network. A facial rendering and generation network and method learns one or more compact, meaningful manifolds of facial appearance, by disentanglement of a facial image into intrinsic facial properties, and enables facial edits by traversing paths of such manifold(s). The facial rendering and generation network is able to handle a much wider range of manipulations including changes to, for example, viewpoint, lighting, expression, and even higher-level attributes like facial hair and age—aspects that cannot be represented using previous models.

公开(公告)号：US10546212B2

公开(公告)日：2020-01-28

申请号：US16148166

申请日：2018-10-01

Applicant: Adobe Inc.

Inventor： Nathan Carr ,  Kalyan Sunkavalli ,  Michal Lukac ,  Elya Shechtman

IPC: G06K9/62

Abstract: The present disclosure is directed toward systems and methods for image patch matching. In particular, the systems and methods described herein sample image patches to identify those image patches that match a target image patch. The systems and methods described herein probabilistically accept image patch proposals as potential matches based on an oracle. The oracle is computationally inexpensive to evaluate but more approximate than similarity heuristics. The systems and methods use the oracle to quickly guide the search to areas of the search space more likely to have a match. Once areas are identified that likely include a match, the systems and methods use a more accurate similarity function to identify patch matches.

公开(公告)号：US20190385346A1

公开(公告)日：2019-12-19

申请号：US16010110

申请日：2018-06-15

Applicant: Adobe Inc.

Inventor： Matthew David Fisher ,  Samaneh Azadi ,  Vladimir Kim ,  Elya Shechtman ,  Zhaowen Wang

IPC: G06T11/20

Abstract: Techniques are disclosed for the synthesis of a full set of slotted content, based upon only partial observations of the slotted content. With respect to a font, the slots may comprise particular letters or symbols or glyphs in an alphabet. Based upon partial observations of a subset of glyphs from a font, a full set of the glyphs corresponding to the font may be synthesized and may further be ornamented.

公开(公告)号：US10467777B2

公开(公告)日：2019-11-05

申请号：US15934629

申请日：2018-03-23

Applicant: Adobe Inc.

Inventor： Siying Liu ,  Kalyan Sunkavalli ,  Nathan A. Carr ,  Elya Shechtman

IPC: G06T11/00 ,  G06K9/52 ,  G06K9/62 ,  G06T7/49

Abstract: Texture modeling techniques for image data are described. In one or more implementations, texels in image data are discovered by one or more computing devices, each texel representing an element that repeats to form a texture pattern in the image data. Regularity of the texels in the image data is modeled by the one or more computing devices to define translations and at least one other transformation of texels in relation to each other.

公开(公告)号：US10417833B2

公开(公告)日：2019-09-17

申请号：US15804908

申请日：2017-11-06

Applicant: ADOBE INC.

Inventor： Jonathan Eisenmann ,  Geoffrey Alan Oxholm ,  Elya Shechtman ,  Bryan Russell

IPC: G06T19/20 ,  G06T15/20

Abstract: Embodiments disclosed herein provide systems, methods, and computer storage media for automatically aligning a 3D camera with a 2D background image. An automated image analysis can be performed on the 2D background image, and a classifier can predict whether the automated image analysis is accurate within a selected confidence level. As such, a feature can be enabled that allows a user to automatically align the 3D camera with the 2D background image. For example, where the automated analysis detects a horizon and one or more vanishing points from the background image, the 3D camera can be automatically transformed to align with the detected horizon and to point at a detected horizon-located vanishing point. In some embodiments, 3D objects in a 3D scene can be pivoted and the 3D camera dollied forward or backwards to reduce changes to the framing of the 3D composition resulting from the 3D camera transformation.

公开(公告)号：US20190050961A1

公开(公告)日：2019-02-14

申请号：US16160855

申请日：2018-10-15

Applicant: ADOBE INC.

Inventor： Sohrab Amirghodsi ,  Aliakbar Darabi ,  Elya Shechtman

IPC: G06T3/40 ,  G06T7/73

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media directed at image synthesis utilizing sampling of patch correspondence information between iterations at different scales. A patch synthesis technique can be performed to synthesize a target region at a first image scale based on portions of a source region that are identified by the patch synthesis technique. The image can then be sampled to generate an image at a second image scale. The sampling can include generating patch correspondence information for the image at the second image scale. Invalid patch assignments in the patch correspondence information at the second image scale can then be identified, and valid patches can be assigned to the pixels having invalid patch assignments. Other embodiments may be described and/or claimed.

公开(公告)号：US10204656B1

公开(公告)日：2019-02-12

申请号：US15661546

申请日：2017-07-27

Applicant: ADOBE INC.

Inventor： Geoffrey Oxholm ,  Elya Shechtman ,  Oliver Wang

IPC: G06K9/00 ,  G06K9/46 ,  H04N7/01 ,  G11B27/00

Abstract: Provided are video processing architectures and techniques configured to generate looping video. The video processing architectures and techniques automatically produce a looping video from a fixed-length video clip. Embodiments of the video processing architectures and techniques determine a lower-resolution version of the fixed-length video clip, and detect a presence of edges within image frames in the lower-resolution version. A pair of image frames having similar edges is identified as a pair of candidates for a transition point (i.e., a start frame and an end frame) at which the looping video can repeat. Using start and end frames having similar edges mitigates teleporting of objects displayed in the looping video. In some cases, teleporting during repeating is eliminated.