-
公开(公告)号:US10902665B2
公开(公告)日:2021-01-26
申请号:US16368548
申请日:2019-03-28
Applicant: ADOBE INC.
Inventor: Xin Sun , Nathan Aaron Carr , Alexandr Kuznetsov
Abstract: Images are rendered from deeply learned raytracing parameters. Active learning, via a machine learning (ML) model (e.g., implemented by a deep neural network), is used to automatically determine, infer, and/or predict optimized, or at least somewhat optimized, values for parameters used in raytracing methods. Utilizing deep learning to determine optimized, or at least somewhat optimized, values for raytracing parameters is in contrast to conventional methods, which require users to rely of heuristics for parameter value setting. In various embodiments, one or more parameters regarding the termination and splitting of traced light paths in stochastic-based (e.g., Monte Carlo) raytracing are determined via active learning. In some embodiments, one or more parameters regarding the sampling rate of shadow rays are also determined.
-
公开(公告)号:US20200334791A1
公开(公告)日:2020-10-22
申请号:US16918649
申请日:2020-07-01
Applicant: Adobe Inc.
Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.
-
公开(公告)号:US10748248B2
公开(公告)日:2020-08-18
申请号:US15980367
申请日:2018-05-15
Applicant: Adobe Inc.
Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.
-
公开(公告)号:US10445926B2
公开(公告)日:2019-10-15
申请号:US15403903
申请日:2017-01-11
Applicant: Adobe Inc.
Inventor: Xin Sun , Weilun Sun , Nathan Aaron Carr
Abstract: Techniques and systems are described that support light path correlation in digital image rendering of a digital scene. In one example, a plurality of light paths between a light source and the digital image to be rendered of a digital scene are identified by a computing device. Each light path of the plurality of light paths includes a primary vertex and a secondary vertex between respective segments of the light path. A plurality of correlated samples is then generated by the computing device from the light paths. Each correlated sample of the plurality of correlated samples is based at least in part on similarity of the secondary vertex of respective said light paths to each other, e.g., on location, geometric normal, or surface material properties. The digital image of the digital scene is then rendered by the computing device based at least in part on the plurality of correlated samples.
-
公开(公告)号:US11941747B2
公开(公告)日:2024-03-26
申请号:US17515079
申请日:2021-10-29
Applicant: Adobe Inc.
Inventor: Qi Sun , Xin Sun , Stefano Petrangeli , Shaoyu Chen , Li-Yi Wei , Jose Ignacio Echevarria Vallespi
CPC classification number: G06T15/20 , G06F3/013 , G06N20/00 , G06T7/70 , G06T2210/36
Abstract: A method includes accessing a first object in a virtual environment, the first object representing a first asset at a first level of detail (LoD). A second object is generated to represent the first asset at a second LoD having decreased complexity. The method further includes determining a first importance value for the first asset and, based on the first importance value, selecting the first object to represent the first asset. Additionally, the method includes accessing a third object representing the second asset at the first LoD and generating a fourth object representing the second asset at the second LoD. The method further includes determining a second importance value, lower than the first importance value, for the second asset and selecting the fourth object to represent the second asset. The method further includes causing a client device to update a display of the virtual environment by transmitting the selected objects.
-
公开(公告)号:US11908063B2
公开(公告)日:2024-02-20
申请号:US17365043
申请日:2021-07-01
Applicant: Adobe Inc.
Inventor: Theo Thonat , Xin Sun , Tamy Boubekeur , Nathan Carr , Francois Beaune
Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
-
公开(公告)号:US11321889B1
公开(公告)日:2022-05-03
申请号:US17082378
申请日:2020-10-28
Applicant: Adobe Inc.
Inventor: Xin Sun , Vineet Batra , Sumit Dhingra , Nathan Aaron Carr , Ankit Phogat
Abstract: A multi-layer light source includes an emissive layer and a textured lighting gel layer, the lighting gel layer being situated between the emissive layer and a 2D canvas or a 3D object. User inputs controlling the multi-layer light source are received, these user inputs being provided with the user interacting with the 2D canvas without switching to editing in 3D space. The multi-layer light source is configured based on the user inputs and, based on the configuration, emission of light rays from the multi-layer light source is determined. Areas of shadows cast by 3D objects are also determined. An image generation system determines, a color of a location (e.g., a pixel) on the 2D canvas or the 3D object that a light ray intersects based on the color that is in the lighting gel layer that the light ray passes through.
-
公开(公告)号:US10600239B2
公开(公告)日:2020-03-24
申请号:US15877142
申请日:2018-01-22
Applicant: ADOBE INC.
Inventor: Jeong Joon Park , Zhili Chen , Xin Sun , Vladimir Kim , Kalyan Krishna Sunkavalli , Duygu Ceylan Aksit
Abstract: Matching an illumination of an embedded virtual object (VO) with current environment illumination conditions provides an enhanced immersive experience to a user. To match the VO and environment illuminations, illumination basis functions are determined based on preprocessing image data, captured as a first combination of intensities of direct illumination sources illuminates the environment. Each basis function corresponds to one of the direct illumination sources. During the capture of runtime image data, a second combination of intensities illuminates the environment. An illumination-weighting vector is determined based on the runtime image data. The determination of the weighting vector accounts for indirect illumination sources, such as surface reflections. The weighting vector encodes a superposition of the basis functions that corresponds to the second combination of intensities. The method illuminates the VO based on the weighting vector. The resulting illumination of the VO matches the second combination of the intensities and surface reflections.
-
-
-
-
-
-
-