Self-Supervised Pretraining Framework for Extracting Global Structures From Building Point Clouds via Completion

被引:0
|
作者
Yang, Hongxin [1 ]
Wang, Ruisheng [1 ,2 ]
机构
[1] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[2] Shenzhen Univ, Sch Architecture & Urban Planning, Shenzhen 518060, Peoples R China
关键词
Point cloud compression; Buildings; Feature extraction; Three-dimensional displays; Transformers; Image reconstruction; Semantics; Labeling; Geoscience and remote sensing; Decoding; Building point cloud completion (PCC) subnetwork; edge point identification; light detection and ranging (LiDAR) point cloud; self-supervised learning (SSL); NETWORK;
D O I
10.1109/TGRS.2024.3477423
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The exterior structural information of buildings are crucial for advancing smart city initiatives and reconstructing 3-D edifices. However, practical obstacles, such as sparse or incomplete building point clouds-stemming from various scanning angles or sensor limitations-present significant challenges. To mitigate the high costs and labor demands associated with data labeling, we introduce an innovative pretraining framework with self-supervised learning (SSL) that incorporates a modified point cloud completion (PCC) subnetwork to extract building structures. Specifically, the modified PCC subnetwork completes the original partial building point clouds by capturing both fine-grained and high-level semantic information of 3-D shapes. Following this, self-supervised feature extractor using a masked autoencoder (MAE) and a multiscale feature mechanism generates pointwise features from the completed building point clouds. We evaluate the effectiveness of the proposed integrated framework in extracting global structures using both established wireframe construction methods and our newly proposed edge point identification that incorporates a novel edge point regression loss. Extensive experimental results demonstrate that our modified PCC network reaches a 93.5% convergence rate that is higher than the results from competing methods. Our self-supervised pretraining framework extracts more accurate global structures with better loss convergence than traditional edge point identification loss designs. Finally, our combined framework improves performance for subsequent processes (such as wireframe construction and edge point identification) when using completed datasets instead of the original partial datasets.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Self-Supervised Pretraining for Large-Scale Point Clouds
    Zhang, Zaiwei
    Bai, Min
    Li, Erran
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [2] A Self-Supervised Pretraining Framework for Context-Aware Building Edge Extraction From 3-D Point Clouds
    Yang, Hongxin
    Xu, Shanshan
    Xu, Sheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
  • [3] Structured Self-Supervised Pretraining for Commonsense Knowledge Graph Completion
    Huang, Jiayuan
    Du, Yangkai
    Tao, Shuting
    Xu, Kun
    Xie, Pengtao
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 : 1268 - 1284
  • [4] Self-Supervised Learning of Point Clouds via Orientation Estimation
    Poursaeed, Omid
    Jiang, Tianxing
    Qiao, Han
    Xu, Nayun
    Kim, Vladimir G.
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 1018 - 1028
  • [5] P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds
    Cui, Ruikai
    Qiu, Shi
    Anwar, Saeed
    Liu, Jiawei
    Xing, Chaoyue
    Zhang, Jing
    Barnes, Nick
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14305 - 14314
  • [6] Self-supervised domain adaptation on point clouds via homomorphic augmentation ☆
    Yang, Jiming
    Da, Feipeng
    Hong, Ru
    COMPUTERS & GRAPHICS-UK, 2024, 121
  • [7] Self-Supervised Feature Learning from Partial Point Clouds via Pose Disentanglement
    Tsai, Meng-Shiun
    Chiang, Pei-Ze
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1031 - 1038
  • [8] Self-Supervised Pretraining for Point Cloud Object Detection in Autonomous Driving
    Shi, Weijing
    Rajkumar, Ragunathan
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 4341 - 4348
  • [9] Masked Discrimination for Self-supervised Learning on Point Clouds
    Liu, Haotian
    Cai, Mu
    Lee, Yong Jae
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 657 - 675
  • [10] Spatiotemporal Self-supervised Learning for Point Clouds in the Wild
    Wu, Yanhao
    Zhang, Tong
    Ke, Wei
    Susstrunk, Sabine
    Salzmann, Mathieu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5251 - 5260