METHOD AND DEVICE FOR REPRESENTING RENDERED SCENES

    公开(公告)号:US20240054716A1

    公开(公告)日:2024-02-15

    申请号:US18096972

    申请日:2023-01-13

    CPC classification number: G06T15/08 G06N3/08 G06T15/06

    Abstract: Disclosed are a method and device for representing rendered scenes. A data processing method of training a neural network model includes obtaining spatial information of sampling data, obtaining one or more volume-rendering parameters by inputting the spatial information of the sampling data to the neural network model, obtaining a regularization term based on a distribution of the volume-rendering parameters, performing volume rendering based on the volume-rendering parameters, and training the neural network model to minimize a loss function determined based on the regularization term and based on a difference between a ground truth image and an image that is estimated according to the volume rendering.

    METHOD AND APPARATUS WITH GLOBAL LOCALIZATION

    公开(公告)号:US20230114734A1

    公开(公告)日:2023-04-13

    申请号:US17699657

    申请日:2022-03-21

    Abstract: A method with global localization includes: extracting a feature by applying an input image to a first network; estimating a coordinate map corresponding to the input image by applying the extracted feature to a second network; and estimating a pose corresponding to the input image based on the estimated coordinate map, wherein either one or both of the first network and the second network is trained based on either one or both of: a first generative adversarial network (GAN) loss determined based on a first feature extracted by the first network based on a synthetic image determined by three-dimensional (3D) map data and a second feature extracted by the first network based on a real image; and a second GAN loss determined based on a first coordinate map estimated by the second network based on the first feature and a second coordinate map estimated by the second network based on the second feature.

Patent Agency Ranking