-
1.发明公开公开(公告)号：US20240273813A1
公开(公告)日：2024-08-15
申请号：US18168995
申请日：2023-02-14
Applicant: Adobe Inc.
Inventor： Jianming Zhang , Yichen Sheng , Julien Philip , Yannick Hold-Geoffroy , Xin Sun , He Zhang
CPC classification number: G06T15/60 , G06T7/60 , G06V10/60 , G06V10/761 , G06V10/82
Abstract: The present disclosure relates to systems, methods, and non-transitory computer-readable media that generates object shadows for digital images utilizing corresponding geometry-aware buffer channels. For instance, in one or more embodiments, the disclosed systems generate, utilizing a height prediction neural network, an object height map for a digital object portrayed in a digital image and a background height map for a background portrayed in the digital image. The disclosed systems also generate, from the digital image, a plurality of geometry-aware buffer channels using the object height map and the background height map. Further, the disclosed systems modify the digital image to include a soft object shadow for the digital object using the plurality of geometry-aware buffer channels.
-
公开(公告)号：US11978144B2
公开(公告)日：2024-05-07
申请号：US17875081
申请日：2022-07-27
Applicant: Adobe Inc.
Inventor： Yi Zhou , Yangtuanfeng Wang , Xin Sun , Qingyang Tan , Duygu Ceylan Aksit
CPC classification number: G06T13/40 , G06T2210/16 , G06T2210/21
Abstract: Embodiments are disclosed for using machine learning models to perform three-dimensional garment deformation due to character body motion with collision handling. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input, the input including character body shape parameters and character body pose parameters defining a character body, and garment parameters. The disclosed systems and methods further comprise generating, by a first neural network, a first set of garment vertices defining deformations of a garment with the character body based on the input. The disclosed systems and methods further comprise determining, by a second neural network, that the first set of garment vertices includes a second set of garment vertices penetrating the character body. The disclosed systems and methods further comprise modifying, by a third neural network, each garment vertex in the second set of garment vertices to positions outside the character body.
-
3.发明公开公开(公告)号：US20230360320A1
公开(公告)日：2023-11-09
申请号：US18354619
申请日：2023-07-18
Applicant: Adobe Inc.
Inventor： Ruben Villegas , Yunseok Jang , Duygu Ceylan Aksit , Jimei Yang , Xin Sun
Abstract: This disclosure describes methods, non-transitory computer readable storage media, and systems that generate realistic shading for three-dimensional objects inserted into digital images. The disclosed system utilizes a light encoder neural network to generate a representation embedding of lighting in a digital image. Additionally, the disclosed system determines points of the three-dimensional object visible within a camera view. The disclosed system generates a self-occlusion map for the digital three-dimensional object by determining whether fixed sets of rays uniformly sampled from the points intersects with the digital three-dimensional object. The disclosed system utilizes a generator neural network to determine a shading map for the digital three-dimensional object based on the representation embedding of lighting in the digital image and the self-occlusion map. Additionally, the disclosed system generates a modified digital image with the three-dimensional object inserted into the digital image with consistent lighting of the three-dimensional object and the digital image.
-
公开(公告)号：US11657546B2
公开(公告)日：2023-05-23
申请号：US17664800
申请日：2022-05-24
Applicant: Adobe Inc.
Inventor： Xin Sun , Ruben Villegas , Manuel Lagunas Arto , Jimei Yang , Jianming Zhang
CPC classification number: G06T11/001 , G06T7/11 , G06T7/194 , G06T7/90 , G06T2207/20084 , G06T2207/30196
Abstract: Introduced here are techniques for relighting an image by automatically segmenting a human object in an image. The segmented image is input to an encoder that transforms it into a feature space. The feature space is concatenated with coefficients of a target illumination for the image and input to an albedo decoder and a light transport detector to predict an albedo map and a light transport matrix, respectively. In addition, the output of the encoder is concatenated with outputs of residual parts of each decoder and fed to a light coefficients block, which predicts coefficients of the illumination for the image. The light transport matrix and predicted illumination coefficients are multiplied to obtain a shading map that can sharpen details of the image. Scaling the resulting image by the albedo map to produce the relight image. The relight image can be refined to denoise the relight image.
-
公开(公告)号：US20220335677A1
公开(公告)日：2022-10-20
申请号：US17233910
申请日：2021-04-19
Applicant: Adobe Inc.
Inventor： Xin Sun , Milos Hasan , Nathan Carr
Abstract: The present disclosure relates to systems, non-transitory computer-readable media, and methods that utilize hemispherical clamping for importance sampling of an image-based light (IBL) to generate a digital image of a virtual environment. For example, the disclosed systems identify a hemispherical portion of an IBL image that corresponds to a reflective surface location on a virtual object. The disclosed systems can then clamp the IBL image using one or more importance sampling algorithms to exclude portions of the IBL image outside of the hemispherical portion that do not contribute direct lighting onto the reflective surface location. The disclosed systems can further utilize the one or more importance sampling algorithms to efficiently sample a ray direction between the reflective surface location and the hemispherical portion of the IBL image. In certain embodiments, the disclosed systems use the sampled ray direction to generate a digital image rendering portraying the virtual object.
-
Patent Agency Ranking
公开(公告)号：US11238560B2
公开(公告)日：2022-02-01
申请号：US16918649
申请日：2020-07-01
Applicant: Adobe Inc.
Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.
-
公开(公告)号：US11037019B2
公开(公告)日：2021-06-15
申请号：US15906783
申请日：2018-02-27
Applicant: Adobe Inc.
Inventor： Xin Sun , Sohrab Amirghodsi , Nathan Carr , Michal Lukac
Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
-
公开(公告)号：US10964100B2
公开(公告)日：2021-03-30
申请号：US16126552
申请日：2018-09-10
Applicant: Adobe Inc.
Inventor： Xin Sun , Zhili Chen , Nathan Carr , Julio Marco Murria , Jimei Yang
Abstract: According to one general aspect, systems and techniques for rendering a painting stroke of a three-dimensional digital painting include receiving a painting stroke input on a canvas, where the painting stroke includes a plurality of pixels. For each of the pixels in the plurality of pixels, a neighborhood patch of pixels is selected and input into a neural network and a shading function is output from the neural network. The painting stroke is rendered on the canvas using the shading function.
-
9.发明申请公开(公告)号：US20190266438A1
公开(公告)日：2019-08-29
申请号：US15906783
申请日：2018-02-27
Applicant: Adobe Inc.
Inventor： Xin Sun , Sohrab Amirghodsi , Nathan Carr , Michal Lukac
Abstract: The present disclosure is directed toward systems, methods, and non-transitory computer readable media for generating a modified digital image by identifying patch matches within a digital image utilizing a Gaussian mixture model. For example, the systems described herein can identify sample patches and corresponding matching portions within a digital image. The systems can also identify transformations between the sample patches and the corresponding matching portions. Based on the transformations, the systems can generate a Gaussian mixture model, and the systems can modify a digital image by replacing a target region with target matching portions identified in accordance with the Gaussian mixture model.
-
公开(公告)号：US20240185503A1
公开(公告)日：2024-06-06
申请号：US18439182
申请日：2024-02-12
Applicant: Adobe Inc.
Inventor： Theo Thonat , Xin Sun , Tamy Boubekeur , Nathan Carr , Francois Beaune
Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
-
-
-
-
-
-
-
-
-
Search Results
38
records
(took 0.025 seconds)
