EXTRACTING 3D SHAPES FROM LARGE-SCALE UNANNOTATED IMAGE DATASETS

    公开(公告)号:US20250061660A1

    公开(公告)日:2025-02-20

    申请号:US18451961

    申请日:2023-08-18

    Applicant: ADOBE INC.

    Abstract: Systems and methods for extracting 3D shapes from unstructured and unannotated datasets are described. Embodiments are configured to obtain a first image and a second image, where the first image depicts an object and the second image includes a corresponding object of a same object category as the object. Embodiments are further configured to generate, using an image encoder, image features for portions of the first image and for portions of the second image; identify a keypoint correspondence between a first keypoint in the first image and a second keypoint in the second image by clustering the image features corresponding to the portions of the first image and the portions of the second image; and generate, using an occupancy network, a 3D model of the object based on the keypoint correspondence.

    VIEWPOINTS DETERMINATION FOR THREE-DIMENSIONAL OBJECTS

    公开(公告)号:US20250078408A1

    公开(公告)日:2025-03-06

    申请号:US18458032

    申请日:2023-08-29

    Applicant: Adobe Inc.

    Abstract: Implementations of systems and methods for determining viewpoints suitable for performing one or more digital operations on a three-dimensional object are disclosed. Accordingly, a set of candidate viewpoints is established. The subset of candidate viewpoints provides views of an outer surface of a three-dimensional object and those views provide overlapping surface data. A subset of activated viewpoints is determined from the set of candidate viewpoints, the subset of activated viewpoints providing less of the overlapping surface data. The subset of activated viewpoints is used to perform one or more digital operation on the three-dimensional object.

    MULTIMODAL THREE-DIMENSIONAL ASSET SEARCH TECHNIQUES

    公开(公告)号:US20250111610A1

    公开(公告)日:2025-04-03

    申请号:US18477429

    申请日:2023-09-28

    Applicant: Adobe Inc.

    Abstract: A computing system receives a query for a three-dimensional representation of a target object. The query comprises input in the form of text describing the target object, a two-dimensional image of the target object, or a three-dimensional model of the target object. The computing system encodes the input using a machine learning model to generate an encoded representation of the input. The computing system searches a search space using nearest neighbors to identify a three-dimensional representation of the target object. The search space comprises encoded representations of multiple views of a plurality of sample three-dimensional object representations. The computing system outputs the identified three-dimensional representation of the target object.

    GENERATING TILE-ABLE IMAGES UTILIZING A DIFFERENTIABLE MESH GENERATION AND RENDERING PIPELINE

    公开(公告)号:US20250078339A1

    公开(公告)日:2025-03-06

    申请号:US18457762

    申请日:2023-08-29

    Applicant: Adobe Inc.

    Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media that provide a differentiable tiling system that generates aesthetically plausible, periodic, and tile-able non-square imagery using machine learning and a text-guided, fully automatic generative approach. Namely, given a textual description of the object and a symmetry pattern of the 2D plane, the system produces a textured 2D mesh which visually resembles the textual description, adheres to the geometric rules which ensure it can be used to tile the plane, and contains only the foreground object. Indeed, the disclosed systems generate a plausible textured 2D triangular mesh that visually matches the textual input and optimizes both the texture and the shape of the mesh and satisfy an overlap condition and a tile-able condition. Using the described methods, the differentiable tiling system generates the mesh such that the edges and the vertices align between repeatable instances of the mesh.

    MODELING SHAPES USING DIFFERENTIABLE SIGNED DISTANCE FUNCTIONS

    公开(公告)号:US20230274040A1

    公开(公告)日:2023-08-31

    申请号:US17683188

    申请日:2022-02-28

    Applicant: Adobe Inc.

    CPC classification number: G06F30/12 G06T19/20 G06T2219/2021

    Abstract: Certain aspects and features of this disclosure relate to modeling shapes using differentiable, signed distance functions. 3D modeling software can edit a 3D model represented using the differentiable, signed distance functions while displaying the model in a manner that is computing resource efficient and fast. Further, such 3D modeling software can automatically create such an editable 3D model from a reference representation that can be obtained in various ways and stored in a variety of formats. For example, a real-world object can be scanned using LiDAR and a reference representation can be produced from the LiDAR data. Candidate procedural models from a library of curated procedural models are optimized to obtain the best procedural model for editing. A selected procedural model provides an editable, reconstructed shape based on the reference representation of the object.

Patent Agency Ranking