-
公开(公告)号:US11880913B2
公开(公告)日:2024-01-23
申请号:US17452568
申请日:2021-10-27
Applicant: Adobe Inc. , University of Massachusetts
Inventor: Aaron Hertzmann , Matthew Fisher , Difan Liu , Evangelos Kalogerakis
CPC classification number: G06T11/001 , G06N3/045 , G06T11/203 , G06T2200/04
Abstract: Techniques for generating a stylized drawing of three-dimensional (3D) shapes using neural networks are disclosed. A processing device generates a set of vector curve paths from a viewpoint of a 3D shape; extracts, using a first neural network of a plurality of neural networks of a machine learning model, surface geometry features of the 3D shape based on geometric properties of surface points of the 3D shape; determines, using a second neural network of the plurality of neural networks of the machine learning model, a set of at least one predicted stroke attribute based on the surface geometry features and a predetermined drawing style; generates, based on the at least one predicted stroke attribute, a set of vector stroke paths corresponding to the set of vector curve paths; and outputs a two-dimensional (2D) stylized stroke drawing of the 3D shape based at least on the set of vector stroke paths.
-
公开(公告)号:US11756210B2
公开(公告)日:2023-09-12
申请号:US16817100
申请日:2020-03-12
Applicant: Adobe Inc.
Inventor: Oliver Wang , Matthew Fisher , John Nelson , Geoffrey Oxholm , Elya Shechtman , Wenqi Xian
Abstract: Certain aspects involve video inpainting in which content is propagated from a user-provided reference frame to other video frames depicting a scene. For example, a computing system accesses a set of video frames with annotations identifying a target region to be modified. The computing system determines a motion of the target region's boundary across the set of video frames, and also interpolates pixel motion within the target region across the set of video frames. The computing system also inserts, responsive to user input, a reference frame into the set of video frames. The reference frame can include reference color data from a user-specified modification to the target region. The computing system can use the reference color data and the interpolated motion to update color data in the target region across set of video frames.
-
公开(公告)号:US20230110114A1
公开(公告)日:2023-04-13
申请号:US17499611
申请日:2021-10-12
Applicant: Adobe Inc.
Inventor: Chinthala Pradyumna Reddy , Zhifei Zhang , Matthew Fisher , Hailin Jin , Zhaowen Wang , Niloy J Mitra
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media for accurately and flexibly generating scalable fonts utilizing multi-implicit neural font representations. For instance, the disclosed systems combine deep learning with differentiable rasterization to generate a multi-implicit neural font representation of a glyph. For example, the disclosed systems utilize an implicit differentiable font neural network to determine a font style code for an input glyph as well as distance values for locations of the glyph to be rendered based on a glyph label and the font style code. Further, the disclosed systems rasterize the distance values utilizing a differentiable rasterization model and combines the rasterized distance values to generate a permutation-invariant version of the glyph corresponding glyph set.
-
24.
公开(公告)号:US20220148233A1
公开(公告)日:2022-05-12
申请号:US17091783
申请日:2020-11-06
Applicant: Adobe Inc.
Inventor: Vineet Agarwal , Tarun Beri , Matthew Fisher
Abstract: This disclosure involves applying an edit to objects in a vector design corresponding to a selected level of an object hierarchy. A system accesses a vector design comprising first, second, and third objects, each of the objects having a respective axis coordinate. The system assigns the first object and the second object to or within a common level in an object hierarchy based on determining that a similarity score comparing the two objects exceeds a threshold and that a modification causing the axis coordinates of the two objects to be adjacent maintains an overlap between the third object and the two objects. The system receives a user input selecting the first object and expands the selection to the second object based on the second object being assigned to the common level. The system applies an edit to the first and second objects based on the expansion of the selection.
-
公开(公告)号:US11314924B2
公开(公告)日:2022-04-26
申请号:US16892795
申请日:2020-06-04
Applicant: Adobe Inc.
Inventor: Arushi Jain , Vijit Saxena , Praveen Kumar Dhanuka , Matthew Fisher
IPC: G06F40/109 , G06F40/166 , G06F40/126 , G06K9/00
Abstract: Techniques described herein take character glyphs as input and generate a text-on-a-path text object that includes the character glyphs arranged in a determined order along a path. For instance, a method described herein includes accessing character glyphs in input data. The method further includes determining an order for the character glyphs based on relative positions and orientations of the character glyphs in the input data. The method further includes generating a path for the character glyphs, based on the order, and associating the path with the character glyphs. Further, the method includes generating a text object that includes the set of character glyphs arranged in the order along the path.
-
26.
公开(公告)号:US11257298B2
公开(公告)日:2022-02-22
申请号:US16822819
申请日:2020-03-18
Applicant: Adobe Inc.
Inventor: Vladimir Kim , Pierre-alain Langlois , Oliver Wang , Matthew Fisher , Bryan Russell
Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for reconstructing three-dimensional meshes from two-dimensional images of objects with automatic coordinate system alignment. For example, the disclosed system can generate feature vectors for a plurality of images having different views of an object. The disclosed system can process the feature vectors to generate coordinate-aligned feature vectors aligned with a coordinate system associated with an image. The disclosed system can generate a combined feature vector from the feature vectors aligned to the coordinate system. Additionally, the disclosed system can then generate a three-dimensional mesh representing the object from the combined feature vector.
-
公开(公告)号:US11189094B2
公开(公告)日:2021-11-30
申请号:US16985402
申请日:2020-08-05
Applicant: Adobe, Inc.
Inventor: Oliver Wang , Vladimir Kim , Matthew Fisher , Elya Shechtman , Chen-Hsuan Lin , Bryan Russell
Abstract: Techniques are disclosed for 3D object reconstruction using photometric mesh representations. A decoder is pretrained to transform points sampled from 2D patches of representative objects into 3D polygonal meshes. An image frame of the object is fed into an encoder to get an initial latent code vector. For each frame and camera pair from the sequence, a polygonal mesh is rendered at the given viewpoints. The mesh is optimized by creating a virtual viewpoint, rasterized to obtain a depth map. The 3D mesh projections are aligned by projecting the coordinates corresponding to the polygonal face vertices of the rasterized mesh to both selected viewpoints. The photometric error is determined from RGB pixel intensities sampled from both frames. Gradients from the photometric error are backpropagated into the vertices of the assigned polygonal indices by relating the barycentric coordinates of each image to update the latent code vector.
-
公开(公告)号:US20200302579A1
公开(公告)日:2020-09-24
申请号:US16893505
申请日:2020-06-05
Applicant: Adobe Inc.
Inventor: Jonathan Eisenmann , Zhe Lin , Matthew Fisher
Abstract: In some embodiments, an image manipulation application receives a two-dimensional background image and projects the background image onto a sphere to generate a sphere image. Based on the sphere image, an unfilled environment map containing a hole area lacking image content can be generated. A portion of the unfilled environment map can be projected to an unfilled projection image using a map projection. The unfilled projection image contains the hole area. A hole filling model is applied to the unfilled projection image to generate a filled projection image containing image content for the hole area. A filled environment map can be generated by applying an inverse projection of the map projection on the filled projection image and by combining the unfilled environment map with the generated image content for the hole area of the environment map.
-
公开(公告)号:US20200118313A1
公开(公告)日:2020-04-16
申请号:US16159181
申请日:2018-10-12
Applicant: Adobe Inc.
Inventor: Ankit Phogat , Vineet Batra , Mridul Kavidayal , Matthew Fisher
IPC: G06T11/60 , G06F3/0484 , G06F17/16
Abstract: A selection of a key path of a vector image displayed using a graphical user interface (GUI) may be received, via the GUI. At least one candidate path of the vector image is identified. A pairwise comparison of the key path with the at least one candidate path is executed, the pairwise comparison including characterization of a translation, scaling, and rotation of the at least one candidate path with respect to the key path. Based on the pairwise comparison, it is determined that the at least one candidate path is within a similarity threshold defined with respect to the key path. A visual indicator of the at least one candidate path within the GUI, identifying the at least one candidate path as being within the similarity threshold, may be provided.
-
公开(公告)号:US20240161355A1
公开(公告)日:2024-05-16
申请号:US18419287
申请日:2024-01-22
Applicant: Adobe Inc. , University of Massachusetts
Inventor: Aaron Hertzmann , Matthew Fisher , Difan Liu , Evangelos Kalogerakis
CPC classification number: G06T11/001 , G06N3/045 , G06T11/203 , G06T2200/04
Abstract: Techniques for generating a stylized drawing of three-dimensional (3D) shapes using neural networks are disclosed. A processing device generates a set of vector curve paths from a viewpoint of a 3D shape; extracts, using a first neural network of a plurality of neural networks of a machine learning model, surface geometry features of the 3D shape based on geometric properties of surface points of the 3D shape; determines, using a second neural network of the plurality of neural networks of the machine learning model, a set of at least one predicted stroke attribute based on the surface geometry features and a predetermined drawing style; generates, based on the at least one predicted stroke attribute, a set of vector stroke paths corresponding to the set of vector curve paths; and outputs a two-dimensional (2D) stylized stroke drawing of the 3D shape based at least on the set of vector stroke paths.
-
-
-
-
-
-
-
-
-