-
11.发明申请公开(公告)号：US20190266438A1
公开(公告)日：2019-08-29
申请号：US15906783
申请日：2018-02-27
Applicant: Adobe Inc.
Inventor： Xin Sun , Sohrab Amirghodsi , Nathan Carr , Michal Lukac
Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
-
公开(公告)号：US20240338888A1
公开(公告)日：2024-10-10
申请号：US18132714
申请日：2023-04-10
Applicant: Adobe Inc.
Inventor： Krishna Bhargava Mullia Lakshminarayana , Valentin Deschaintre , Nathan Carr , Milos Hasan , Bailey Miller
Abstract: Certain aspects and features of this disclosure relate to rendering images by training a neural material and applying the material map to a coarse geometry to provide high-fidelity asset encoding. For example, training can involve sampling for a set of lighting and camera configurations arranged to render an image of a target asset. A value for a loss function comparing the target asset with the neural material can be optimized to train the neural material to encode a high-fidelity model of the target asset. This technique restricts the application of the neural material to a specific predetermined geometry, resulting in a reproducible asset that can be used efficiently. Such an asset can be deployed, as examples, to mobile devices or to the web, where the computational budget is limited, and nevertheless produce highly detailed images.
-
13.发明公开公开(公告)号：US20240144586A1
公开(公告)日：2024-05-02
申请号：US18304179
申请日：2023-04-20
Applicant: Adobe Inc.
Inventor： Yannick Hold-Geoffroy , Vojtech Krs , Radomir Mech , Nathan Carr , Matheus Gadelha
IPC: G06T15/60
CPC classification number: G06T15/60 , G06T2215/12
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.
-
公开(公告)号：US11908063B2
公开(公告)日：2024-02-20
申请号：US17365043
申请日：2021-07-01
Applicant: Adobe Inc.
Inventor： Theo Thonat , Xin Sun , Tamy Boubekeur , Nathan Carr , Francois Beaune
Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
-
公开(公告)号：US20200302658A1
公开(公告)日：2020-09-24
申请号：US16584591
申请日：2019-09-26
Applicant: Adobe Inc.
Inventor： Gwendal Simon , Viswanathan Swaminathan , Nathan Carr , Stefano Petrangeli
IPC: G06T11/00 , G06T3/40 , H04N19/182 , H04N19/176
Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
-
Patent Agency Ranking
公开(公告)号：US20240185503A1
公开(公告)日：2024-06-06
申请号：US18439182
申请日：2024-02-12
Applicant: Adobe Inc.
Inventor： Theo Thonat , Xin Sun , Tamy Boubekeur , Nathan Carr , Francois Beaune
Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
-
17.发明公开公开(公告)号：US20240161366A1
公开(公告)日：2024-05-16
申请号：US18055584
申请日：2022-11-15
Applicant: Adobe Inc.
Inventor： Radomir Mech , Nathan Carr , Matheus Gadelha
CPC classification number: G06T11/60 , G06T7/70 , G06T17/20 , G06T19/20 , G06T2219/2004
Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating three-dimensional meshes representing two-dimensional images for editing the two-dimensional images. The disclosed system utilizes a first neural network to determine density values of pixels of a two-dimensional image based on estimated disparity. The disclosed system samples points in the two-dimensional image according to the density values and generates a tessellation based on the sampled points. The disclosed system utilizes a second neural network to estimate camera parameters and modify the three-dimensional mesh based on the estimated camera parameters of the pixels of the two-dimensional image. In one or more additional embodiments, the disclosed system generates a three-dimensional mesh to modify a two-dimensional image according to a displacement input. Specifically, the disclosed system maps the three-dimensional mesh to the two-dimensional image, modifies the three-dimensional mesh in response to a displacement input, and updates the two-dimensional image.
-
公开(公告)号：US11580675B2
公开(公告)日：2023-02-14
申请号：US17331186
申请日：2021-05-26
Applicant: Adobe Inc.
Inventor： Gwendal Simon , Viswanathan Swaminathan , Nathan Carr , Stefano Petrangeli
IPC: G06T11/00 , G06T3/40 , H04N19/176 , H04N19/182
Abstract: Techniques and systems are provided for generating a video from texture images, and for reconstructing the texture images from the video. For example, a texture image can be divided into a number of tiles, and the number of tiles can be sorted into a sequence of ordered tiles. The sequence of ordered tiles can be provided to a video coder for generating a coded video. The number of tiles can be encoded based on the sequence of ordered tiles. The encoded video including the encoded sequence of ordered tiles can be decoded. At least a portion of the decoded video can include the number of tiles sorted into a sequence of ordered tiles. A data file associated with at least the portion of the decoded video can be used to reconstruct the texture image using the tiles.
-
公开(公告)号：US20220122305A1
公开(公告)日：2022-04-21
申请号：US17384273
申请日：2021-07-23
Applicant: Adobe Inc.
Inventor： Cameron Smith , Ratheesh Kalarot , Wei-An Lin , Richard Zhang , Niloy Mitra , Elya Shechtman , Shabnam Ghadar , Zhixin Shu , Yannick Hold-Geoffrey , Nathan Carr , Jingwan Lu , Oliver Wang , Jun-Yan Zhu
Abstract: An improved system architecture uses a pipeline including an encoder and a Generative Adversarial Network (GAN) including a generator neural network to generate edited images with improved speed, realism, and identity preservation. The encoder produces an initial latent space representation of an input image by encoding the input image. The generator neural network generates an initial output image by processing the initial latent space representation of the input image. The system generates an optimized latent space representation of the input image using a loss minimization technique that minimizes a loss between the input image and the initial output image. The loss is based on target perceptual features extracted from the input image and initial perceptual features extracted from the initial output image. The system outputs the optimized latent space representation of the input image for downstream use.
-
公开(公告)号：US20220122222A1
公开(公告)日：2022-04-21
申请号：US17384283
申请日：2021-07-23
Applicant: Adobe Inc.
Inventor： Cameron Smith , Ratheesh Kalarot , Wei-An Lin , Richard Zhang , Niloy Mitra , Elya Shechtman , Shabnam Ghadar , Zhixin Shu , Yannick Hold-Geoffrey , Nathan Carr , Jingwan Lu , Oliver Wang , Jun-Yan Zhu
Abstract: An improved system architecture uses a Generative Adversarial Network (GAN) including a specialized generator neural network to generate multiple resolution output images. The system produces a latent space representation of an input image. The system generates a first output image at a first resolution by providing the latent space representation of the input image as input to a generator neural network comprising an input layer, an output layer, and a plurality of intermediate layers and taking the first output image from an intermediate layer, of the plurality of intermediate layers of the generator neural network. The system generates a second output image at a second resolution different from the first resolution by providing the latent space representation of the input image as input to the generator neural network and taking the second output image from the output layer of the generator neural network.
-
-
-
-
-
-
-
-
-
Search Results
34
records
(took 0.019 seconds)
