Generation of stylized drawing of three-dimensional shapes using neural networks

    公开(公告)号:US11880913B2

    公开(公告)日:2024-01-23

    申请号:US17452568

    申请日:2021-10-27

    CPC classification number: G06T11/001 G06N3/045 G06T11/203 G06T2200/04

    Abstract: Techniques for generating a stylized drawing of three-dimensional (3D) shapes using neural networks are disclosed. A processing device generates a set of vector curve paths from a viewpoint of a 3D shape; extracts, using a first neural network of a plurality of neural networks of a machine learning model, surface geometry features of the 3D shape based on geometric properties of surface points of the 3D shape; determines, using a second neural network of the plurality of neural networks of the machine learning model, a set of at least one predicted stroke attribute based on the surface geometry features and a predetermined drawing style; generates, based on the at least one predicted stroke attribute, a set of vector stroke paths corresponding to the set of vector curve paths; and outputs a two-dimensional (2D) stylized stroke drawing of the 3D shape based at least on the set of vector stroke paths.

    GENERATING SCALABLE FONTS UTILIZING MULTI-IMPLICIT NEURAL FONT REPRESENTATIONS

    公开(公告)号:US20230110114A1

    公开(公告)日:2023-04-13

    申请号:US17499611

    申请日:2021-10-12

    Applicant: Adobe Inc.

    Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for accurately and flexibly generating scalable fonts utilizing multi-implicit neural font representations. For instance, the disclosed systems combine deep learning with differentiable rasterization to generate a multi-implicit neural font representation of a glyph. For example, the disclosed systems utilize an implicit differentiable font neural network to determine a font style code for an input glyph as well as distance values for locations of the glyph to be rendered based on a glyph label and the font style code. Further, the disclosed systems rasterize the distance values utilizing a differentiable rasterization model and combines the rasterized distance values to generate a permutation-invariant version of the glyph corresponding glyph set.

    GENERATION OF OBJECT HIERARCHIES FOR LOGICAL SELECTION OF GROUPS OF OBJECTS IN VECTOR DESIGNS

    公开(公告)号:US20220148233A1

    公开(公告)日:2022-05-12

    申请号:US17091783

    申请日:2020-11-06

    Applicant: Adobe Inc.

    Abstract: This disclosure involves applying an edit to objects in a vector design corresponding to a selected level of an object hierarchy. A system accesses a vector design comprising first, second, and third objects, each of the objects having a respective axis coordinate. The system assigns the first object and the second object to or within a common level in an object hierarchy based on determining that a similarity score comparing the two objects exceeds a threshold and that a modification causing the axis coordinates of the two objects to be adjacent maintains an overlap between the third object and the two objects. The system receives a user input selecting the first object and expands the selection to the second object based on the second object being assigned to the common level. The system applies an edit to the first and second objects based on the expansion of the selection.

    Constructing a path for character glyphs

    公开(公告)号:US11314924B2

    公开(公告)日:2022-04-26

    申请号:US16892795

    申请日:2020-06-04

    Applicant: Adobe Inc.

    Abstract: Techniques described herein take character glyphs as input and generate a text-on-a-path text object that includes the character glyphs arranged in a determined order along a path. For instance, a method described herein includes accessing character glyphs in input data. The method further includes determining an order for the character glyphs based on relative positions and orientations of the character glyphs in the input data. The method further includes generating a path for the character glyphs, based on the order, and associating the path with the character glyphs. Further, the method includes generating a text object that includes the set of character glyphs arranged in the order along the path.

    Reconstructing three-dimensional scenes in a target coordinate system from multiple views

    公开(公告)号:US11257298B2

    公开(公告)日:2022-02-22

    申请号:US16822819

    申请日:2020-03-18

    Applicant: Adobe Inc.

    Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for reconstructing three-dimensional meshes from two-dimensional images of objects with automatic coordinate system alignment. For example, the disclosed system can generate feature vectors for a plurality of images having different views of an object. The disclosed system can process the feature vectors to generate coordinate-aligned feature vectors aligned with a coordinate system associated with an image. The disclosed system can generate a combined feature vector from the feature vectors aligned to the coordinate system. Additionally, the disclosed system can then generate a three-dimensional mesh representing the object from the combined feature vector.

    3D object reconstruction using photometric mesh representation

    公开(公告)号:US11189094B2

    公开(公告)日:2021-11-30

    申请号:US16985402

    申请日:2020-08-05

    Applicant: Adobe, Inc.

    Abstract: Techniques are disclosed for 3D object reconstruction using photometric mesh representations. A decoder is pretrained to transform points sampled from 2D patches of representative objects into 3D polygonal meshes. An image frame of the object is fed into an encoder to get an initial latent code vector. For each frame and camera pair from the sequence, a polygonal mesh is rendered at the given viewpoints. The mesh is optimized by creating a virtual viewpoint, rasterized to obtain a depth map. The 3D mesh projections are aligned by projecting the coordinates corresponding to the polygonal face vertices of the rasterized mesh to both selected viewpoints. The photometric error is determined from RGB pixel intensities sampled from both frames. Gradients from the photometric error are backpropagated into the vertices of the assigned polygonal indices by relating the barycentric coordinates of each image to update the latent code vector.

    ENVIRONMENT MAP GENERATION AND HOLE FILLING
    28.
    发明申请

    公开(公告)号:US20200302579A1

    公开(公告)日:2020-09-24

    申请号:US16893505

    申请日:2020-06-05

    Applicant: Adobe Inc.

    Abstract: In some embodiments, an image manipulation application receives a two-dimensional background image and projects the background image onto a sphere to generate a sphere image. Based on the sphere image, an unfilled environment map containing a hole area lacking image content can be generated. A portion of the unfilled environment map can be projected to an unfilled projection image using a map projection. The unfilled projection image contains the hole area. A hole filling model is applied to the unfilled projection image to generate a filled projection image containing image content for the hole area. A filled environment map can be generated by applying an inverse projection of the map projection on the filled projection image and by combining the unfilled environment map with the generated image content for the hole area of the environment map.

    IDENTIFICATION AND MODIFICATION OF SIMILAR OBJECTS IN VECTOR IMAGES

    公开(公告)号:US20200118313A1

    公开(公告)日:2020-04-16

    申请号:US16159181

    申请日:2018-10-12

    Applicant: Adobe Inc.

    Abstract: A selection of a key path of a vector image displayed using a graphical user interface (GUI) may be received, via the GUI. At least one candidate path of the vector image is identified. A pairwise comparison of the key path with the at least one candidate path is executed, the pairwise comparison including characterization of a translation, scaling, and rotation of the at least one candidate path with respect to the key path. Based on the pairwise comparison, it is determined that the at least one candidate path is within a similarity threshold defined with respect to the key path. A visual indicator of the at least one candidate path within the GUI, identifying the at least one candidate path as being within the similarity threshold, may be provided.

    GENERATION OF STYLIZED DRAWING OF THREE-DIMENSIONAL SHAPES USING NEURAL NETWORKS

    公开(公告)号:US20240161355A1

    公开(公告)日:2024-05-16

    申请号:US18419287

    申请日:2024-01-22

    CPC classification number: G06T11/001 G06N3/045 G06T11/203 G06T2200/04

    Abstract: Techniques for generating a stylized drawing of three-dimensional (3D) shapes using neural networks are disclosed. A processing device generates a set of vector curve paths from a viewpoint of a 3D shape; extracts, using a first neural network of a plurality of neural networks of a machine learning model, surface geometry features of the 3D shape based on geometric properties of surface points of the 3D shape; determines, using a second neural network of the plurality of neural networks of the machine learning model, a set of at least one predicted stroke attribute based on the surface geometry features and a predetermined drawing style; generates, based on the at least one predicted stroke attribute, a set of vector stroke paths corresponding to the set of vector curve paths; and outputs a two-dimensional (2D) stylized stroke drawing of the 3D shape based at least on the set of vector stroke paths.

Patent Agency Ranking