公开(公告)号：US20230196676A1

公开(公告)日：2023-06-22

申请号：US18172847

申请日：2023-02-22

Applicant: Adobe Inc. ,  Institut Mines Telecom

Inventor： Thibaud Lambert ,  Tamy Boubekeur ,  Anthony Salvi

IPC: G06T17/20 ,  G06T15/04

CPC classification number: G06T17/20 ,  G06T15/04

Abstract: The disclosure describes one or more embodiments of systems, methods, and non-transitory computer-readable media that modify vertex positions of a 3D-object mesh to align the vertices with discontinuities indicated by a sharpness map for a displacement map. For example, the disclosed systems access a sharpness map that encodes discontinuities of a displacement map to preserve sharp features. During sharp tessellation, for a given vertex of the 3D-object mesh, the disclosed systems iterate over neighboring vertices to search for a nearest intersection between one of the incident edges of the vertex and neighboring vertices and a discontinuity line from the sharpness map. Then, the vertex is moved within a threshold distance of the nearest discontinuity line intersection along the incident edge. The disclosed systems similarly reposition other vertices of the 3D-object mesh to generate a modified 3D-object mesh that includes vertices that align with discontinuities present in a displacement map.

公开(公告)号：US11600044B2

公开(公告)日：2023-03-07

申请号：US17590702

申请日：2022-02-01

Applicant: Adobe Inc. ,  Institut Mines Telecom

Inventor： Thibaud Lambert ,  Tamy Boubekeur ,  Anthony Salvi

IPC: G06T17/20 ,  G06T3/40 ,  G06T5/00 ,  G06T11/00

Abstract: The disclosure describes one or more embodiments of systems, methods, and non-transitory computer-readable media that utilize a sharpness map that includes information on how to filter a displacement map on a per-texel basis to preserve sharp features while sampling a displacement map. For instance, the disclosed systems utilize a sharpness map that encodes combinable patterns to represent discontinuities of features within a displacement map. In some embodiments, the disclosed systems generate a sharpness map having texels encoded with discontinuity configurations that are referenced to control filtering (e.g., via interpolation) of a displacement map such that sharp features within the displacement map are not lost (due to smoothing during interpolation). For example, the disclosed systems filter feature values of a displacement map using discontinuities identified within a sharpness map to interpolate when the feature value(s) and a sampling point are identified as being on the same side of a discontinuity.

公开(公告)号：US11423607B2

公开(公告)日：2022-08-23

申请号：US16953708

申请日：2020-11-20

Applicant: Adobe Inc. ,  Institut Mines Telecom

Inventor： Christophe Lino ,  Tamy Boubekeur ,  Anthony Salvi ,  Sébastien Deguy

IPC: G06T15/50

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating enriched light sources by utilizing surface-centric representations of three-dimensional surfaces. Specifically, the disclosed system utilizes a surface-centric re-parameterization that combines geometric and algebraic components of a sphere to model different light source types in a continuous range of lighting configurations. The disclosed systems utilize a set of intuitive parameters to determine a shape and emission parameters for generating an enriched light source. Additionally, the disclosed system provides a set of interactive light source controls to modify a position, orientation, shape, emittance, and lighting attenuation over distance of a light source within a three-dimensional environment. The disclosed system determines the light source controls based on sets of three-dimensional interaction primitives to control one or more parameters of the light source. The disclosed system provides the light source controls for consistently modifying various light source types within the three-dimensional environment.

公开(公告)号：US11189060B2

公开(公告)日：2021-11-30

申请号：US16863540

申请日：2020-04-30

Applicant: Adobe Inc.

Inventor： Milos Hasan ,  Liang Shi ,  Tamy Boubekeur ,  Kalyan Sunkavalli ,  Radomir Mech

IPC: G06T11/00 ,  G06T11/40 ,  G06T15/04 ,  G06N3/08

Abstract: The present disclosure relates to using end-to-end differentiable pipeline for optimizing parameters of a base procedural material to generate a procedural material corresponding to a target physical material. For example, the disclosed systems can receive a digital image of a target physical material. In response, the disclosed systems can retrieve a differentiable procedural material for use as a base procedural material in response. The disclosed systems can compare a digital image of the base procedural material with the digital image of the target physical material using a loss function, such as a style loss function that compares visual appearance. Based on the determined loss, the disclosed systems can modify the parameters of the base procedural material to determine procedural material parameters for the target physical material. The disclosed systems can generate a procedural material corresponding to the base procedural material using the determined procedural material parameters.

公开(公告)号：US12277671B2

公开(公告)日：2025-04-15

申请号：US17454434

申请日：2021-11-10

Applicant: ADOBE INC.

Inventor： Shouchang Guo ,  Arthur Jules Martin Roullier ,  Tamy Boubekeur ,  Valentin Deschaintre ,  Jerome Derel ,  Paul Parneix

IPC: G06T3/4046 ,  G06T5/77 ,  G06T7/11 ,  G06T7/40

Abstract: Systems and methods for image processing are described. Embodiments of the present disclosure include an image processing apparatus configured to efficiently perform texture synthesis (e.g., increase the size of, or extend, texture in an input image while preserving a natural appearance of the synthesized texture pattern in the modified output image). In some aspects, the image processing apparatus implements an attention mechanism with a multi-stage attention model where different stages (e.g., different transformer blocks) progressively refine image feature patch mapping at different scales, while utilizing repetitive patterns in texture images to enable network generalization. One or more embodiments of the disclosure include skip connections and convolutional layers (e.g., between transformer block stages) that combine high-frequency and low-frequency features from different transformer stages and unify attention to micro-structures, meso-structures and macro-structures. In some aspects, the skip connections enable information propagation in the transformer network.

公开(公告)号：US11961188B2

公开(公告)日：2024-04-16

申请号：US17835754

申请日：2022-06-08

Applicant: Adobe Inc.

Inventor： Robin Faury ,  Tamy Boubekeur ,  Jeremy Levallois ,  Alban Gauthier ,  Theo Thonat

IPC: G06T17/30 ,  G06T7/00 ,  G06T15/04

CPC classification number: G06T17/30 ,  G06T7/97 ,  G06T15/04 ,  G06T2200/04 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: An appearance-responsive material map generation system generates a set of material maps based on the appearance of a material depicted in the source material data. A neural network included in the appearance-responsive material map generation system is trained to identify features of particular source material data, such as features that contribute to a highly realistic appearance of a graphical object rendered with the material depicted in the source material data. In some cases, the trained neural network receives source material data that includes at least one source material map. Based on the features that are identified for the particular source material data, the appearance-responsive material map generation system creates a respective set of appearance-responsive material maps for the particular source material data. In some cases, the appearance-responsive rendering map set is arranged as an inconsistent pyramid of material maps.

公开(公告)号：US11875446B2

公开(公告)日：2024-01-16

申请号：US17662287

申请日：2022-05-06

Applicant: ADOBE INC.

Inventor： Paul Augusto Guerrero ,  Milos Hasan ,  Kalyan K. Sunkavalli ,  Radomir Mech ,  Tamy Boubekeur ,  Niloy Jyoti Mitra

IPC: G06T15/04 ,  G06T17/00 ,  G06V10/776 ,  G06V10/426 ,  G06V10/774 ,  G06V10/44

CPC classification number: G06T15/04 ,  G06T17/00 ,  G06V10/426 ,  G06V10/44 ,  G06V10/776 ,  G06V10/7747

Abstract: Aspects of a system and method for procedural media generation include generating a sequence of operator types using a node generation network; generating a sequence of operator parameters for each operator type of the sequence of operator types using a parameter generation network; generating a sequence of directed edges based on the sequence of operator types using an edge generation network; combining the sequence of operator types, the sequence of operator parameters, and the sequence of directed edges to obtain a procedural media generator, wherein each node of the procedural media generator comprises an operator that includes an operator type from the sequence of operator types, a corresponding sequence of operator parameters, and an input connection or an output connection from the sequence of directed edges that connects the node to another node of the procedural media generator; and generating a media asset using the procedural media generator.

公开(公告)号：US20230401793A1

公开(公告)日：2023-12-14

申请号：US17835754

申请日：2022-06-08

Applicant: Adobe Inc.

Inventor： Robin Faury ,  Tamy Boubekeur ,  Jeremy Levallois ,  Alban Gauthier ,  Theo Thonat

IPC: G06T17/30 ,  G06T15/04 ,  G06T7/00

CPC classification number: G06T17/30 ,  G06T15/04 ,  G06T7/97 ,  G06T2200/04 ,  G06T2207/20084 ,  G06T2207/20081

Abstract: An appearance-responsive material map generation system generates a set of material maps based on the appearance of a material depicted in the source material data. A neural network included in the appearance-responsive material map generation system is trained to identify features of particular source material data, such as features that contribute to a highly realistic appearance of a graphical object rendered with the material depicted in the source material data. In some cases, the trained neural network receives source material data that includes at least one source material map. Based on the features that are identified for the particular source material data, the appearance-responsive material map generation system creates a respective set of appearance-responsive material maps for the particular source material data. In some cases, the appearance-responsive rendering map set is arranged as an inconsistent pyramid of material maps.

公开(公告)号：US11615586B2

公开(公告)日：2023-03-28

申请号：US17091313

申请日：2020-11-06

Applicant: Adobe Inc. ,  Institut Mines Telecom

Inventor： Tamy Boubekeur ,  Christophe Lino ,  Sébastien Deguy ,  Anthony Salvi

IPC: G06T15/50 ,  G06F3/04847 ,  G06F3/04815

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating enriched light sources by utilizing surface-centric representations of three-dimensional surfaces. Specifically, the disclosed system utilizes a surface-centric re-parameterization that combines geometric and algebraic components of a sphere to model different light source types in a continuous range of lighting configurations. The disclosed systems utilize a set of intuitive parameters to determine a shape and emission parameters for generating an enriched light source. Additionally, the disclosed system provides a set of interactive light source controls to modify a position, orientation, shape, emittance, and lighting attenuation over distance of a light source within a three-dimensional environment. The disclosed system determines the light source controls based on sets of three-dimensional interaction primitives to control one or more parameters of the light source. The disclosed system provides the light source controls for consistently modifying various light source types within the three-dimensional environment.

公开(公告)号：US20230017659A1

公开(公告)日：2023-01-19

申请号：US17365043

申请日：2021-07-01

Applicant: Adobe Inc.

Inventor： Theo Thonat ,  Xin Sun ,  Tamy Boubekeur ,  Nathan Carr ,  Francois Beaune

IPC: G06T15/04 ,  G06T17/20 ,  G06T15/06

Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.