Dataset generation method for self-supervised learning scene point cloud completion based on panoramas

    公开(公告)号:US11875583B2

    公开(公告)日:2024-01-16

    申请号:US17533878

    申请日:2021-11-23

    CPC classification number: G06V20/647 G06T3/0062 G06T7/50 G06T2207/10028

    Abstract: The present invention belongs to the technical field of 3D reconstruction in the field of computer vision, and provides a dataset generation method for self-supervised learning scene point cloud completion based on panoramas. Pairs of incomplete point cloud and target point cloud with RGB information and normal information can be generated by taking RGB panoramas, depth panoramas and normal panoramas in the same view as input for constructing a self-supervised learning dataset for training of the scene point cloud completion network. The key points of the present invention are occlusion prediction and equirectangular projection based on view conversion, and processing of the stripe problem and point-to-point occlusion problem during conversion. The method of the present invention includes simplification of the collection mode of the point cloud data in a real scene; occlusion prediction idea of view conversion; and design of view selection strategy.

Patent Agency Ranking