ILLUMINATION RENDERING METHOD AND APPARATUS, STORAGE MEDIUM, AND ELECTRONIC DEVICE

    公开(公告)号:US20230186553A1

    公开(公告)日:2023-06-15

    申请号:US18164385

    申请日:2023-02-03

    发明人: Zhi Xiao WEI

    IPC分类号: G06T15/50 G06T15/04 G06T15/20

    摘要: An illumination rendering method and apparatus includes obtaining a first picture at a target viewing angle from a virtual three-dimensional (3D) scene. The first picture includes a virtual object to be subject to illumination rendering in the virtual 3D scene at the target viewing angle. A target virtual light source point set is determined that performs illumination rendering on the virtual object in the first picture. Illumination rendering is performed on the virtual object in the first picture by using the target virtual light source point set. This illumination rendering improves efficiency in rendering on the virtual object in the virtual 3D scene.

    IMAGE PROCESSING METHOD AND APPARATUS WITH INTEGRATED OPTIMIZATION FRAMEWORK OF HETEROGENEOUS FEATURES

    公开(公告)号:US20230169722A1

    公开(公告)日:2023-06-01

    申请号:US17838414

    申请日:2022-06-13

    发明人: INWOO HA

    摘要: An image processing method and apparatus with an integrated framework of heterogeneous features is provided. The method includes generating first feature frames including first features corresponding to a first density level by sensing a target space; generating second feature frames including second features corresponding to a second density level by sensing the target space; estimating sensor poses corresponding to at least a portion of the generated first feature frames and the generated second feature frames; calculating each of a first reprojection error of the first features and a second reprojection error of the second features based on the estimated sensor poses; and acquiring an optimization result by adjusting at least a portion of the sensor poses, the first features, the second features, reprojection features of the first features, and reprojection features of the second features to decrease an integration error including the first reprojection error and the second reprojection error.

    Generating physically-based material maps

    公开(公告)号:US11663775B2

    公开(公告)日:2023-05-30

    申请号:US17233861

    申请日:2021-04-19

    申请人: ADOBE INC.

    摘要: Methods, system, and computer storage media are provided for generating physical-based materials for rendering digital objects with an appearance of a real-world material. Images depicted the real-world material, including diffuse component images and specular component images, are captured using different lighting patterns, which may include area lights. From the captured images, approximations of one or more material maps are determined using a photometric stereo technique. Based on the approximations and the captured images, a neural network system generates a set of material maps, such as a diffuse albedo material map, a normal material map, a specular albedo material map, and a roughness material map. The material maps from the neural network may be optimized based on a comparison of the input images of the real-world material and images rendered from the material maps.

    PHOTOGRAMMETRY
    106.
    发明公开
    PHOTOGRAMMETRY 审中-公开

    公开(公告)号:US20230162431A1

    公开(公告)日:2023-05-25

    申请号:US17919773

    申请日:2021-05-18

    发明人: Stuart TAYLOR

    IPC分类号: G06T15/08 G06T15/50

    CPC分类号: G06T15/08 G06T15/50

    摘要: Measures, including a method, system, and computer program, for performing in-mission photogrammetry while an imaging platform is surveying a target environment. A plurality of images of the target environment are captured by the imaging platform. At the imaging platform, a representative subset of images is identified from the captured plurality of images. The imaging platform transmits the identified representative subset to a processing node. At the processing node, the transmitted representative subset is processed to generate a virtual model of the target environment.

    High resolution neural rendering
    108.
    发明授权

    公开(公告)号:US11640690B2

    公开(公告)日:2023-05-02

    申请号:US17321655

    申请日:2021-05-17

    摘要: Methods and systems are provided for training a machine learning model to generate density values and radiance components based on positional data, along with a weighting scheme associated with a particular view direction based on directional data to compute a final RGB value for each point along a plurality of camera rays. The positional data and directional data are extracted from set of training images of a particular static scene. The radiance components, density values, and weighting schemes are cached for efficient image data processing to perform volume rendering for each point sampled. A novel viewpoint of a static scene is generated based on the volume rendering for each point sampled.

    INTERACTIVE IMAGE GENERATION
    109.
    发明申请

    公开(公告)号:US20230119071A1

    公开(公告)日:2023-04-20

    申请号:US17966349

    申请日:2022-10-14

    申请人: Outward, Inc.

    IPC分类号: G06T17/20 G06T7/50 G06T15/50

    摘要: A content generation platform is generally described herein. More specifically, interactive image generation and techniques and features thereof are disclosed herein. One or more sets of images of a scene are captured in an imaging studio. The captured one or more sets of images of the scene are processed using one or more machine learning based networks to generate an interactive image of the scene comprising a plurality of interactive features. One or more of the plurality of interactive features of the generated interactive image may be modified or edited according to user preferences.

    Picture Rendering Method, Apparatus, Electronic Device, and Storage Medium

    公开(公告)号:US20230113571A1

    公开(公告)日:2023-04-13

    申请号:US17769226

    申请日:2020-10-09

    摘要: A picture rendering method includes obtaining first picture data of a current frame (201); comparing the first picture data with currently recorded second picture data of a previous frame to determine a first part in the first picture datathat does not change with respect to the second picture data and a second part is in the first picture datathat changes with respect to the second picture data and rendering the second part in the current frame, including reusing a rendering result of the first part in the previous frame, to obtain and display a rendering result of the current frame