公开(公告)号：US11847159B2

公开(公告)日：2023-12-19

申请号：US17812341

申请日：2022-07-13

Applicant: Adobe Inc.

Inventor： Praveen Kumar Dhanuka ,  Matthew Fisher ,  Arushi Jain

IPC: G06F16/56 ,  G06V30/182 ,  G06F16/901 ,  G06V30/262 ,  G06V30/10 ,  G06V30/19

CPC classification number: G06F16/56 ,  G06F16/9014 ,  G06V30/1823 ,  G06V30/262 ,  G06V30/10 ,  G06V30/19027

Abstract: Systems, methods, and non-transitory computer-readable media are disclosed for determining a glyph and a font from a vector outline by applying various combinations of hash-based querying, path-descriptor matching, or anchor-point matching. For example, the disclosed systems can select a subset of candidate glyphs for a vector outline based on (i) comparing hash keys of candidate glyphs with a point-order-agnostic hash key corresponding to the vector outline and (ii) comparing a path descriptor for a primary path of the vector outline to path descriptors corresponding to candidate glyphs. By further comparing anchor points between the vector outline and the subset of candidate glyphs, the disclosed systems can select both a glyph and a font matching the vector outline.

公开(公告)号：US20230196630A1

公开(公告)日：2023-06-22

申请号：US17556716

申请日：2021-12-20

Applicant: Adobe Inc.

Inventor： Aaron Phillip Hertzmann ,  Manuel Rodriguez Ladron de Guevara ,  Matthew Fisher

IPC: G06T11/00 ,  G06V10/40 ,  G06N3/04 ,  G06N3/08

CPC classification number: G06T11/00 ,  G06V10/40 ,  G06N3/0454 ,  G06N3/084 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing a multi-stroke neural network for modifying a digital image via a plurality of generated stroke parameters in a single pass of the neural network. Specifically, the disclosed system utilizes an encoder neural network to generate an encoding of a digital image. The disclosed system then utilizes a decoder neural network that generates a sequence of stroke parameters for digital drawing strokes from the encoding in a single pass of the encoder neural network and decoder neural network. Additionally, the disclosed system utilizes a renderer neural network to render the digital drawing strokes on a digital canvas according to the sequence of stroke parameters. In additional embodiments, the disclosed system utilizes a balance of loss functions to learn parameters of the multi-stroke neural network to generate stroke parameters according to various rendering styles.

公开(公告)号：US20230109732A1

公开(公告)日：2023-04-13

申请号：US17452568

申请日：2021-10-27

Applicant: Adobe Inc. ,  University of Massachusetts

Inventor： Aaron Hertzmann ,  Matthew Fisher ,  Difan Liu ,  Evangelos Kalogerakis

IPC: G06T11/00 ,  G06T11/20 ,  G06N3/04

Abstract: Techniques for generating a stylized drawing of three-dimensional (3D) shapes using neural networks are disclosed. A processing device generates a set of vector curve paths from a viewpoint of a 3D shape; extracts, using a first neural network of a plurality of neural networks of a machine learning model, surface geometry features of the 3D shape based on geometric properties of surface points of the 3D shape; determines, using a second neural network of the plurality of neural networks of the machine learning model, a set of at least one predicted stroke attribute based on the surface geometry features and a predetermined drawing style; generates, based on the at least one predicted stroke attribute, a set of vector stroke paths corresponding to the set of vector curve paths; and outputs a two-dimensional (2D) stylized stroke drawing of the 3D shape based at least on the set of vector stroke paths.

公开(公告)号：US20220414314A1

公开(公告)日：2022-12-29

申请号：US17362031

申请日：2021-06-29

Applicant: Adobe Inc.

Inventor： Zhifei Zhang ,  Zhaowen Wang ,  Hailin Jin ,  Matthew Fisher

IPC: G06F40/109 ,  G06T11/20 ,  G06N3/04

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for accurately and flexibly generating scalable and semantically editable font representations utilizing a machine learning approach. For example, the disclosed systems generate a font representation code from a glyph utilizing a particular neural network architecture. For example, the disclosed systems utilize a glyph appearance propagation model and perform an iterative process to generate a font representation code from an initial glyph. Additionally, using a glyph appearance propagation model, the disclosed systems automatically propagate the appearance of the initial glyph from the font representation code to generate additional glyphs corresponding to respective glyph labels. In some embodiments, the disclosed systems propagate edits or other changes in appearance of a glyph to other glyphs within a glyph set (e.g., to match the appearance of the edited glyph).

公开(公告)号：US11335042B2

公开(公告)日：2022-05-17

申请号：US16933334

申请日：2020-07-20

Applicant: Adobe Inc.

Inventor： Vineet Batra ,  Ankit Phogat ,  Matthew Fisher

IPC: G06T11/20 ,  G06T11/00 ,  G06T11/60

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing enhanced curve primitives to modify color gradients in vector-based graphics. To illustrate, the disclosed system can receive an input of a curve to insert into a portion of a vector-based graphic including a mesh for a color gradient. The disclosed system can then insert a discontinuity into the mesh by adding a plurality of vertices to the mesh defining two unconnected edges at the position of the curve within the portion of the vector-based graphic. After inserting the discontinuity into the mesh, the disclosed system can determine colors for the edges of the discontinuity based on one or more user-selected colors and/or one or more colors associated with the color gradient. The disclosed system can then update the color gradient in response to determining the colors for the edges of the discontinuity.

公开(公告)号：US20210383056A1

公开(公告)日：2021-12-09

申请号：US16892795

申请日：2020-06-04

Applicant: Adobe Inc.

Inventor： Arushi Jain ,  Vijit Saxena ,  Praveen Kumar Dhanuka ,  Matthew Fisher

IPC: G06F40/109 ,  G06F40/126 ,  G06F40/166

Abstract: Techniques described herein take character glyphs as input and generate a text-on-a-path text object that includes the character glyphs arranged in a determined order along a path. For instance, a method described herein includes accessing character glyphs in input data. The method further includes determining an order for the character glyphs based on relative positions and orientations of the character glyphs in the input data. The method further includes generating a path for the character glyphs, based on the order, and associating the path with the character glyphs. Further, the method includes generating a text object that includes the set of character glyphs arranged in the order along the path.

公开(公告)号：US20210358170A1

公开(公告)日：2021-11-18

申请号：US17387207

申请日：2021-07-28

Applicant: Adobe Inc.

Inventor： Jonathan Eisenmann ,  Wenqi Xian ,  Matthew Fisher ,  Geoffrey Oxholm ,  Elya Shechtman

IPC: G06T7/80 ,  G06T7/12 ,  G06T7/13

Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods for utilizing a critical edge detection neural network and a geometric model to determine camera parameters from a single digital image. In particular, in one or more embodiments, the disclosed systems can train and utilize a critical edge detection neural network to generate a vanishing edge map indicating vanishing lines from the digital image. The system can then utilize the vanishing edge map to more accurately and efficiently determine camera parameters by applying a geometric model to the vanishing edge map. Further, the system can generate ground truth vanishing line data from a set of training digital images for training the critical edge detection neural network.

公开(公告)号：US20210357574A1

公开(公告)日：2021-11-18

申请号：US17388744

申请日：2021-07-29

Applicant: Adobe Inc.

Inventor： Praveen Kumar Dhanuka ,  Arushi Jain ,  Matthew Fisher

IPC: G06F40/109 ,  G06T11/20 ,  G06F40/166

Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that merge separate digital point text objects into a single merged digital text object while preserving the properties and original visual appearance associated with the digital text included therein. For example, the disclosed systems can determine point text character properties associated with the separate digital point text objects (e.g., rotations, baseline shifts, etc.). The disclosed systems can merge the separate digital point text objects into a single merged digital point text object and modify associated font character properties to reflect the determined point text character properties. Further, the disclosed systems can generate an area text object based on the merged digital point text object where the area text object includes the digital text and the font character properties.

公开(公告)号：US20210287007A1

公开(公告)日：2021-09-16

申请号：US16817100

申请日：2020-03-12

Applicant: Adobe Inc.

Inventor： Oliver Wang ,  Matthew Fisher ,  John Nelson ,  Geoffrey Oxholm ,  Elya Shechtman ,  Wenqi Xian

IPC: G06K9/00 ,  G06N20/00 ,  G06K9/46

Abstract: Certain aspects involve video inpainting in which content is propagated from a user-provided reference frame to other video frames depicting a scene. For example, a computing system accesses a set of video frames with annotations identifying a target region to be modified. The computing system determines a motion of the target region's boundary across the set of video frames, and also interpolates pixel motion within the target region across the set of video frames. The computing system also inserts, responsive to user input, a reference frame into the set of video frames. The reference frame can include reference color data from a user-specified modification to the target region. The computing system can use the reference color data and the interpolated motion to update color data in the target region across set of video frames.

公开(公告)号：US10997752B1

公开(公告)日：2021-05-04

申请号：US16813050

申请日：2020-03-09

Applicant: Adobe Inc.

Inventor： Seungjoo Yoo ,  Richard Zhang ,  Matthew Fisher ,  Jingwan Lu

IPC: G06T7/13 ,  G06T11/00 ,  G06T7/90

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing an edge prediction neural network and edge-guided colorization neural network to transform grayscale digital images into colorized digital images. In one or more embodiments, the disclosed systems apply a color edge prediction neural network to a grayscale image to generate a color edge map indicating predicted chrominance edges. The disclosed systems can present the color edge map to a user via a colorization graphical user interface and receive user color points and color edge modifications. The disclosed systems can apply a second neural network, an edge-guided colorization neural network, to the color edge map or a modified edge map, user color points, and the grayscale image to generate an edge-constrained colorized digital image.