公开(公告)号：US20190286892A1

公开(公告)日：2019-09-19

申请号：US15920027

申请日：2018-03-13

Applicant: Adobe Inc.

Inventor： Zimo Li ,  Vladimir Kim ,  Mehmet Ersin Yumer

IPC: G06K9/00 ,  G06K9/46 ,  G06T7/70 ,  G06N5/04

Abstract: Certain embodiments detect human-object interactions in image content. For example, human-object interaction metadata is applied to an input image, thereby identifying contact between a part of a depicted human and a part of a depicted object. Applying the human-object interaction metadata involves computing a joint-location heat map by applying a pose estimation subnet to the input image and a contact-point heat map by applying an object contact subnet to the to the input image. The human-object interaction metadata is generated by applying an interaction-detection subnet to the joint-location heat map and the contact-point heat map. The interaction-detection subnet is trained to identify an interaction based on joint-object contact pairs, where a joint-object contact pair includes a relationship between a human joint location and a contact point. An image search system or other computing system is provided with access to the input image having the human-object interaction metadata.

公开(公告)号：US20190259216A1

公开(公告)日：2019-08-22

申请号：US15900864

申请日：2018-02-21

Applicant: Adobe Inc.

Inventor： Emiliano Gambaretto ,  Vladimir Kim ,  Qingnan Zhou ,  Mehmet Ersin Yumer

IPC: G06T19/20 ,  G06T17/20

Abstract: Certain embodiments involve refining local parameterizations that apply two-dimensional (“2D”) images to three-dimensional (“3D”) models. For instance, a particular parameterization-initialization process is select based on one or more features of a target mesh region. An initial local parameterization for a 2D image is generated from this parameterization-initialization process. A quality metric for the initial local parameterization is computed, and the local parameterization is modified to improve the quality metric. The 3D model is modified by applying image points from the 2D image to the target mesh region in accordance with the modified local parameterization.

公开(公告)号：US10380317B2

公开(公告)日：2019-08-13

申请号：US15063183

申请日：2016-03-07

Applicant: Adobe Inc.

Inventor： Duygu Ceylan ,  Byungmoon Kim ,  Aron Monszpart ,  Vladimir Kim ,  Niloy Mitra

IPC: G06F17/50

Abstract: Methods and systems for generating digital models from objects. In particular, one or more embodiments determine a plurality of correspondences for first and second components of an object. One or more embodiments estimate a joint connecting the first and second components based on the correspondences. One or more embodiments jointly determine a global transformation and one or more joint parameters that map the plurality of components of the object from the first digital scan to the second digital scan. One or more embodiments also updating the correspondences based on the determined global transformation and parameter(s). One or more embodiments re-estimate the joint based on the updated correspondences. One or more embodiments select a candidate joint with a lowest error estimate from a plurality of candidate joints according to determined global transformations and joint parameter(s) for the candidate joints.

公开(公告)号：US12254589B2

公开(公告)日：2025-03-18

申请号：US18055716

申请日：2022-11-15

Applicant: Adobe Inc.

Inventor： Mohammad Reza Karimi Dastjerdi ,  Yannick Hold-Geoffroy ,  Vladimir Kim ,  Jonathan Eisenmann ,  Jean-François Lalonde

IPC: G06T3/04 ,  G06T3/18 ,  G06T3/4023 ,  G06T3/4046 ,  G06T7/00 ,  G06V10/774 ,  G06V10/776

Abstract: Embodiments are disclosed for generating 360-degree panoramas from input narrow field of view images. A method of generating 360-degree panoramas may include obtaining an input image and guide, generating a panoramic projection of the input image, and generating, by a panorama generator, a 360-degree panorama based on the panoramic projection and the guide, wherein the panorama generator is a guided co-modulation generator network trained to generate a 360-degree panorama from the input image based on the guide.

公开(公告)号：US11823391B2

公开(公告)日：2023-11-21

申请号：US17655226

申请日：2022-03-17

Applicant: Adobe Inc.

Inventor： Vladimir Kim ,  Aaron Hertzmann ,  Mehmet Yumer

IPC: G06T7/143 ,  G06T7/11 ,  G06V10/26 ,  G06V20/64 ,  G06V30/24

CPC classification number: G06T7/143 ,  G06T7/11 ,  G06V10/26 ,  G06V20/64 ,  G06V30/248 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20081

Abstract: The present disclosure includes methods and systems for identifying and manipulating a segment of a three-dimensional digital model based on soft classification of the three-dimensional digital model. In particular, one or more embodiments of the disclosed systems and methods identify a soft classification of a digital model and utilize the soft classification to tune segmentation algorithms. For example, the disclosed systems and methods can utilize a soft classification to select a segmentation algorithm from a plurality of segmentation algorithms, to combine segmentation parameters from a plurality of segmentation algorithms, and/or to identify input parameters for a segmentation algorithm. The disclosed systems and methods can utilize the tuned segmentation algorithms to accurately and efficiently identify a segment of a three-dimensional digital model.

公开(公告)号：US11694416B2

公开(公告)日：2023-07-04

申请号：US17208627

申请日：2021-03-22

Applicant: ADOBE INC.

Inventor： Duygu Ceylan Aksit ,  Vladimir Kim ,  Siddhartha Chaudhuri ,  Radomir Mech ,  Noam Aigerman ,  Kevin Wampler ,  Jonathan Eisenmann ,  Giorgio Gori ,  Emiliano Gambaretto

IPC: G06T15/00 ,  G06T19/20 ,  G06F3/04815 ,  G06F3/04845

CPC classification number: G06T19/20 ,  G06F3/04815 ,  G06F3/04845 ,  G06T2200/24 ,  G06T2219/2016

Abstract: Embodiments of the present invention are directed towards intuitive editing of three-dimensional models. In embodiments, salient geometric features associated with a three-dimensional model defining an object are identified. Thereafter, feature attributes associated with the salient geometric features are identified. A feature set including a plurality of salient geometric features related to one another is generated based on the determined feature attributes (e.g., properties, relationships, distances). An editing handle can then be generated and displayed for the feature set enabling each of the salient geometric features within the feature set to be edited in accordance with a manipulation of the editing handle. The editing handle can be displayed in association with one of the salient geometric features of the feature set.

公开(公告)号：US11257290B2

公开(公告)日：2022-02-22

申请号：US16863099

申请日：2020-04-30

Applicant: Adobe Inc.

Inventor： Vladimir Kim ,  Siddhartha Chaudhuri ,  Noam Aigerman ,  Hsueh-ti Liu ,  Alec Jacobson

IPC: G06T17/20 ,  G06T9/00

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

公开(公告)号：US20210343082A1

公开(公告)日：2021-11-04

申请号：US16863099

申请日：2020-04-30

Applicant: Adobe Inc.

Inventor： Vladimir Kim ,  Siddhartha Chaudhuri ,  Noam Aigerman ,  Hsueh-ti Liu ,  Alec Jacobson

IPC: G06T17/20 ,  G06T9/00

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for iteratively decimating a three-dimensional mesh utilizing successive self-parameterization. For example, the disclosed system can self-parameterize local geometries of a three-dimensional mesh using surface mappings within a two-dimensional surface mapping space. The disclosed system can collapse edges in the three-dimensional mesh to create new vertices from the collapsed edges. The disclosed system can parameterize the collapsed edges based on the surface mappings to collapse corresponding edges within the surface mapping space. The disclosed system can thus generate a decimated three-dimensional mesh by collapsing edges in the three-dimensional mesh while providing a bijective map between points in the decimated three-dimensional mesh and corresponding points in the three-dimensional mesh.

公开(公告)号：US20210343080A1

公开(公告)日：2021-11-04

申请号：US16863189

申请日：2020-04-30

Applicant: Adobe Inc.

Inventor： Vladimir Kim ,  Siddhartha Chaudhuri ,  Noam Aigerman ,  Hsueh-ti Liu ,  Alec Jacobson

IPC: G06T17/20 ,  G06T7/13 ,  G06N3/08

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing one or more neural networks to recursively subdivide a three-dimensional mesh according to local geometries of vertices in the three-dimensional mesh. For example, the disclosed system can determine a local geometry (e.g., a one-ring neighborhood of half-flaps) for each vertex in a three-dimensional mesh. For each subdivision iteration, the disclosed system can then utilize a neural network to determine displacement coordinates for existing vertices in the three-dimensional mesh and coordinates for new vertices added to edges between the existing vertices in the three-dimensional mesh in accordance with the local geometries of the existing vertices. Furthermore, the disclosed system can generate a subdivided three-dimensional mesh based on the determined displacement coordinates for the existing vertices and the determined coordinates for the new vertices.

公开(公告)号：US20210295606A1

公开(公告)日：2021-09-23

申请号：US16822819

申请日：2020-03-18

Applicant: Adobe Inc.

Inventor： Vladimir Kim ,  Pierre-alain Langlois ,  Oliver Wang ,  Matthew Fisher ,  Bryan Russell

IPC: G06T19/20 ,  G06T9/00 ,  G06T17/20

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for reconstructing three-dimensional meshes from two-dimensional images of objects with automatic coordinate system alignment. For example, the disclosed system can generate feature vectors for a plurality of images having different views of an object. The disclosed system can process the feature vectors to generate coordinate-aligned feature vectors aligned with a coordinate system associated with an image. The disclosed system can generate a combined feature vector from the feature vectors aligned to the coordinate system. Additionally, the disclosed system can then generate a three-dimensional mesh representing the object from the combined feature vector.