-
公开(公告)号:US20230098115A1
公开(公告)日:2023-03-30
申请号:US18062460
申请日:2022-12-06
申请人: Adobe Inc. , Université Laval
发明人: Kalyan Sunkavalli , Yannick Hold-Geoffroy , Christian Gagne , Marc-Andre Gardner , Jean-Francois Lalonde
摘要: This disclosure relates to methods, non-transitory computer readable media, and systems that can render a virtual object in a digital image by using a source-specific-lighting-estimation-neural network to generate three-dimensional (“3D”) lighting parameters specific to a light source illuminating the digital image. To generate such source-specific-lighting parameters, for instance, the disclosed systems utilize a compact source-specific-lighting-estimation-neural network comprising both common network layers and network layers specific to different lighting parameters. In some embodiments, the disclosed systems further train such a source-specific-lighting-estimation-neural network to accurately estimate spatially varying lighting in a digital image based on comparisons of predicted environment maps from a differentiable-projection layer with ground-truth-environment maps.
-
2.
公开(公告)号:US20210065440A1
公开(公告)日:2021-03-04
申请号:US16558975
申请日:2019-09-03
申请人: Adobe Inc. , Université Laval
发明人: Kalyan Sunkavalli , Yannick Hold-Geoffroy , Christian Gagne , Marc-Andre Gardner , Jean-Francois Lalonde
摘要: This disclosure relates to methods, non-transitory computer readable media, and systems that can render a virtual object in a digital image by using a source-specific-lighting-estimation-neural network to generate three-dimensional (“3D”) lighting parameters specific to a light source illuminating the digital image. To generate such source-specific-lighting parameters, for instance, the disclosed systems utilize a compact source-specific-lighting-estimation-neural network comprising both common network layers and network layers specific to different lighting parameters. In some embodiments, the disclosed systems further train such a source-specific-lighting-estimation-neural network to accurately estimate spatially varying lighting in a digital image based on comparisons of predicted environment maps from a differentiable-projection layer with ground-truth-environment maps.
-
公开(公告)号:US12008710B2
公开(公告)日:2024-06-11
申请号:US18062460
申请日:2022-12-06
申请人: Adobe Inc. , Université Laval
发明人: Kalyan Sunkavalli , Yannick Hold-Geoffroy , Christian Gagne , Marc-Andre Gardner , Jean-Francois Lalonde
CPC分类号: G06T15/506 , G06N3/08 , G06T7/50 , G06T7/60 , G06T7/70 , G06T7/90 , G06T2200/24 , G06T2207/20081 , G06T2207/20084
摘要: This disclosure relates to methods, non-transitory computer readable media, and systems that can render a virtual object in a digital image by using a source-specific-lighting-estimation-neural network to generate three-dimensional (“3D”) lighting parameters specific to a light source illuminating the digital image. To generate such source-specific-lighting parameters, for instance, the disclosed systems utilize a compact source-specific-lighting-estimation-neural network comprising both common network layers and network layers specific to different lighting parameters. In some embodiments, the disclosed systems further train such a source-specific-lighting-estimation-neural network to accurately estimate spatially varying lighting in a digital image based on comparisons of predicted environment maps from a differentiable-projection layer with ground-truth-environment maps.
-
4.
公开(公告)号:US11538216B2
公开(公告)日:2022-12-27
申请号:US16558975
申请日:2019-09-03
申请人: Adobe Inc. , Université Laval
发明人: Kalyan Sunkavalli , Yannick Hold-Geoffroy , Christian Gagne , Marc-Andre Gardner , Jean-Francois Lalonde
摘要: This disclosure relates to methods, non-transitory computer readable media, and systems that can render a virtual object in a digital image by using a source-specific-lighting-estimation-neural network to generate three-dimensional (“3D”) lighting parameters specific to a light source illuminating the digital image. To generate such source-specific-lighting parameters, for instance, the disclosed systems utilize a compact source-specific-lighting-estimation-neural network comprising both common network layers and network layers specific to different lighting parameters. In some embodiments, the disclosed systems further train such a source-specific-lighting-estimation-neural network to accurately estimate spatially varying lighting in a digital image based on comparisons of predicted environment maps from a differentiable-projection layer with ground-truth-environment maps.
-
公开(公告)号:US11887241B2
公开(公告)日:2024-01-30
申请号:US17559867
申请日:2021-12-22
申请人: Adobe Inc.
摘要: Embodiments are disclosed for neural texture mapping. In some embodiments, a method of neural texture mapping includes obtaining a plurality of images of an object, determining volumetric representation of a scene of the object using a first neural network, mapping 3D points of the scene to a 2D texture space using a second neural network, and determining radiance values for each 2D point in the 2D texture space from a plurality of viewpoints using a second neural network to generate a 3D appearance representation of the object.
-
6.
公开(公告)号:US11157773B2
公开(公告)日:2021-10-26
申请号:US16802243
申请日:2020-02-26
申请人: ADOBE INC.
摘要: Images can be edited to include features similar to a different target image. An unconditional generative adversarial network (GAN) is employed to edit features of an initial image based on a constraint determined from a target image. The constraint used by the GAN is determined from keypoints or segmentation masks of the target image, and edits are made to features of the initial image based on keypoints or segmentation masks of the initial image corresponding to those of the constraint from the target image. The GAN modifies the initial image based on a loss function having a variable for the constraint. The result of this optimization process is a modified initial image having features similar to the target image subject to the constraint determined from the identified keypoints or segmentation masks.
-
公开(公告)号:US20210319532A1
公开(公告)日:2021-10-14
申请号:US16848741
申请日:2020-04-14
申请人: Adobe Inc.
发明人: Julia Gong , Yannick Hold-Geoffroy , Jingwan Lu
摘要: Techniques and systems are provided for configuring neural networks to perform warping of an object represented in an image to create a caricature of the object. For instance, in response to obtaining an image of an object, a warped image generator generates a warping field using the image as input. The warping field is generated using a model trained with pairings of training images and known warped images using supervised learning techniques and one or more losses. The warped image generator determines, based on the warping field, a set of displacements associated with pixels of the input image. These displacements indicate pixel displacement directions for the pixels of the input image. These displacements are applied to the digital image to generate a warped image of the object.
-
公开(公告)号:US10979640B2
公开(公告)日:2021-04-13
申请号:US16789195
申请日:2020-02-12
申请人: Adobe Inc.
IPC分类号: G06T5/00 , H04N5/232 , G06K9/46 , G06T15/50 , G06N3/08 , H04N5/235 , G06K9/00 , G06K9/62 , G06N3/04
摘要: The present disclosure is directed toward systems and methods for predicting lighting conditions. In particular, the systems and methods described herein analyze a single low-dynamic range digital image to estimate a set of high-dynamic range lighting conditions associated with the single low-dynamic range lighting digital image. Additionally, the systems and methods described herein train a convolutional neural network to extrapolate lighting conditions from a digital image. The systems and methods also augment low-dynamic range information from the single low-dynamic range digital image by using a sky model algorithm to predict high-dynamic range lighting conditions.
-
公开(公告)号:US10957026B1
公开(公告)日:2021-03-23
申请号:US16564398
申请日:2019-09-09
申请人: ADOBE INC.
发明人: Jinsong Zhang , Kalyan K. Sunkavalli , Yannick Hold-Geoffroy , Sunil Hadap , Jonathan Eisenmann , Jean-Francois Lalonde
摘要: Methods and systems are provided for determining high-dynamic range lighting parameters for input low-dynamic range images. A neural network system can be trained to estimate high-dynamic range lighting parameters for input low-dynamic range images. The high-dynamic range lighting parameters can be based on sky color, sky turbidity, sun color, sun shape, and sun position. Such input low-dynamic range images can be low-dynamic range panorama images or low-dynamic range standard images. Such a neural network system can apply the estimates high-dynamic range lighting parameters to objects added to the low-dynamic range images.
-
公开(公告)号:US20240143835A1
公开(公告)日:2024-05-02
申请号:US18052121
申请日:2022-11-02
申请人: Adobe Inc.
IPC分类号: G06F21/62 , G06N3/0455 , G06N3/0475
CPC分类号: G06F21/6254 , G06N3/0455 , G06N3/0475
摘要: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating anonymized digital images utilizing a face anonymization neural network. In some embodiments, the disclosed systems utilize a face anonymization neural network to extract or encode a face anonymization guide that encodes face attribute features, such as gender, ethnicity, age, and expression. In some cases, the disclosed systems utilize the face anonymization guide to inform the face anonymization neural network in generating synthetic face pixels for anonymizing a digital image while retaining attributes, such as gender, ethnicity, age, and expression. The disclosed systems learn parameters for a face anonymization neural network for preserving face attributes, accounting for multiple faces in digital images, and generating synthetic face pixels for faces in profile poses.
-
-
-
-
-
-
-
-
-