Rendering images from deeply learned raytracing parameters

    公开(公告)号:US10902665B2

    公开(公告)日:2021-01-26

    申请号:US16368548

    申请日:2019-03-28

    Applicant: ADOBE INC.

    Abstract: Images are rendered from deeply learned raytracing parameters. Active learning, via a machine learning (ML) model (e.g., implemented by a deep neural network), is used to automatically determine, infer, and/or predict optimized, or at least somewhat optimized, values for parameters used in raytracing methods. Utilizing deep learning to determine optimized, or at least somewhat optimized, values for raytracing parameters is in contrast to conventional methods, which require users to rely of heuristics for parameter value setting. In various embodiments, one or more parameters regarding the termination and splitting of traced light paths in stochastic-based (e.g., Monte Carlo) raytracing are determined via active learning. In some embodiments, one or more parameters regarding the sampling rate of shadow rays are also determined.

    IMAGE DOWN-SCALING WITH PIXEL SETS SELECTED VIA BLUE NOISE SAMPLING

    公开(公告)号:US20200334791A1

    公开(公告)日:2020-10-22

    申请号:US16918649

    申请日:2020-07-01

    Applicant: Adobe Inc.

    Inventor: Li-Yi Wei Xin Sun

    Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.

    Image down-scaling with pixel sets selected via blue noise sampling

    公开(公告)号:US10748248B2

    公开(公告)日:2020-08-18

    申请号:US15980367

    申请日:2018-05-15

    Applicant: Adobe Inc.

    Inventor: Li-Yi Wei Xin Sun

    Abstract: In some embodiments, a computing device uses a blue noise sampling operation to identify source pixels from an input image defining respective pixel sets. Each pixel set is associated with a respective weight matrix for a down-scaling operation. The blue noise sampling operation causes an overlap region between first and second pixel sets. The computing device assigns an overlap pixel in the overlap region to the first weight matrix based on the overlap pixel being closer to the first source pixel. The computing device modifies the second weight matrix to exclude the overlap pixel from a portion of the down-scaling operation involving the second weight matrix. The computing device performs the down-scaling operation on the input image by combining the first pixel set into a first target pixel with the first weight matrix and combining the second pixel set into a second target with the modified second weight matrix.

    Light path correlation in digital image rendering of a digital scene

    公开(公告)号:US10445926B2

    公开(公告)日:2019-10-15

    申请号:US15403903

    申请日:2017-01-11

    Applicant: Adobe Inc.

    Abstract: Techniques and systems are described that support light path correlation in digital image rendering of a digital scene. In one example, a plurality of light paths between a light source and the digital image to be rendered of a digital scene are identified by a computing device. Each light path of the plurality of light paths includes a primary vertex and a secondary vertex between respective segments of the light path. A plurality of correlated samples is then generated by the computing device from the light paths. Each correlated sample of the plurality of correlated samples is based at least in part on similarity of the secondary vertex of respective said light paths to each other, e.g., on location, geometric normal, or surface material properties. The digital image of the digital scene is then rendered by the computing device based at least in part on the plurality of correlated samples.

    Delivering a virtual environment with dynamic level of detail per object

    公开(公告)号:US11941747B2

    公开(公告)日:2024-03-26

    申请号:US17515079

    申请日:2021-10-29

    Applicant: Adobe Inc.

    CPC classification number: G06T15/20 G06F3/013 G06N20/00 G06T7/70 G06T2210/36

    Abstract: A method includes accessing a first object in a virtual environment, the first object representing a first asset at a first level of detail (LoD). A second object is generated to represent the first asset at a second LoD having decreased complexity. The method further includes determining a first importance value for the first asset and, based on the first importance value, selecting the first object to represent the first asset. Additionally, the method includes accessing a third object representing the second asset at the first LoD and generating a fourth object representing the second asset at the second LoD. The method further includes determining a second importance value, lower than the first importance value, for the second asset and selecting the fourth object to represent the second asset. The method further includes causing a client device to update a display of the virtual environment by transmitting the selected objects.

    Displacement-centric acceleration for ray tracing

    公开(公告)号:US11908063B2

    公开(公告)日:2024-02-20

    申请号:US17365043

    申请日:2021-07-01

    Applicant: Adobe Inc.

    CPC classification number: G06T15/04 G06T15/06 G06T17/20

    Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.

    Multi-layer lighting source with textured lighting gel layer

    公开(公告)号:US11321889B1

    公开(公告)日:2022-05-03

    申请号:US17082378

    申请日:2020-10-28

    Applicant: Adobe Inc.

    Abstract: A multi-layer light source includes an emissive layer and a textured lighting gel layer, the lighting gel layer being situated between the emissive layer and a 2D canvas or a 3D object. User inputs controlling the multi-layer light source are received, these user inputs being provided with the user interacting with the 2D canvas without switching to editing in 3D space. The multi-layer light source is configured based on the user inputs and, based on the configuration, emission of light rays from the multi-layer light source is determined. Areas of shadows cast by 3D objects are also determined. An image generation system determines, a color of a location (e.g., a pixel) on the 2D canvas or the 3D object that a light ray intersects based on the color that is in the lighting gel layer that the light ray passes through.

    Realistically illuminated virtual objects embedded within immersive environments

    公开(公告)号:US10600239B2

    公开(公告)日:2020-03-24

    申请号:US15877142

    申请日:2018-01-22

    Applicant: ADOBE INC.

    Abstract: Matching an illumination of an embedded virtual object (VO) with current environment illumination conditions provides an enhanced immersive experience to a user. To match the VO and environment illuminations, illumination basis functions are determined based on preprocessing image data, captured as a first combination of intensities of direct illumination sources illuminates the environment. Each basis function corresponds to one of the direct illumination sources. During the capture of runtime image data, a second combination of intensities illuminates the environment. An illumination-weighting vector is determined based on the runtime image data. The determination of the weighting vector accounts for indirect illumination sources, such as surface reflections. The weighting vector encodes a superposition of the basis functions that corresponds to the second combination of intensities. The method illuminates the VO based on the weighting vector. The resulting illumination of the VO matches the second combination of the intensities and surface reflections.

Patent Agency Ranking