Self-Supervised Pretraining Framework for Extracting Global Structures From Building Point Clouds via Completion

被引:0
|
作者
Yang, Hongxin [1 ]
Wang, Ruisheng [1 ,2 ]
机构
[1] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[2] Shenzhen Univ, Sch Architecture & Urban Planning, Shenzhen 518060, Peoples R China
关键词
Point cloud compression; Buildings; Feature extraction; Three-dimensional displays; Transformers; Image reconstruction; Semantics; Labeling; Geoscience and remote sensing; Decoding; Building point cloud completion (PCC) subnetwork; edge point identification; light detection and ranging (LiDAR) point cloud; self-supervised learning (SSL); NETWORK;
D O I
10.1109/TGRS.2024.3477423
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The exterior structural information of buildings are crucial for advancing smart city initiatives and reconstructing 3-D edifices. However, practical obstacles, such as sparse or incomplete building point clouds-stemming from various scanning angles or sensor limitations-present significant challenges. To mitigate the high costs and labor demands associated with data labeling, we introduce an innovative pretraining framework with self-supervised learning (SSL) that incorporates a modified point cloud completion (PCC) subnetwork to extract building structures. Specifically, the modified PCC subnetwork completes the original partial building point clouds by capturing both fine-grained and high-level semantic information of 3-D shapes. Following this, self-supervised feature extractor using a masked autoencoder (MAE) and a multiscale feature mechanism generates pointwise features from the completed building point clouds. We evaluate the effectiveness of the proposed integrated framework in extracting global structures using both established wireframe construction methods and our newly proposed edge point identification that incorporates a novel edge point regression loss. Extensive experimental results demonstrate that our modified PCC network reaches a 93.5% convergence rate that is higher than the results from competing methods. Our self-supervised pretraining framework extracts more accurate global structures with better loss convergence than traditional edge point identification loss designs. Finally, our combined framework improves performance for subsequent processes (such as wireframe construction and edge point identification) when using completed datasets instead of the original partial datasets.
引用
收藏
页数:17
相关论文
共 50 条
  • [11] Self-Supervised Learning for Domain Adaptation on Point Clouds
    Achituve, Idan
    Maron, Haggai
    Chechik, Gal
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 123 - 133
  • [12] Self-Supervised Pretraining via Multimodality Images With Transformer for Change Detection
    Zhang, Yuxiang
    Zhao, Yang
    Dong, Yanni
    Du, Bo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [13] Self-Supervised Pretraining Vision Transformer With Masked Autoencoders for Building Subsurface Model
    Li, Yuanyuan
    Alkhalifah, Tariq
    Huang, Jianping
    Li, Zhenchun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [14] Self-supervised indoor scene point cloud completion from a single panorama
    Li, Tong
    Zhang, Zhaoxuan
    Wang, Yuxin
    Cui, Yan
    Li, Yuqi
    Zhou, Dongsheng
    Yin, Baocai
    Yang, Xin
    VISUAL COMPUTER, 2025, 41 (03): : 1891 - 1905
  • [15] Self-Supervised Pretraining Vision Transformer With Masked Autoencoders for Building Subsurface Model
    Li, Yuanyuan
    Alkhalifah, Tariq
    Huang, Jianping
    Li, Zhenchun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [16] From Image Collections to Point Clouds with Self-supervised Shape and Pose Networks
    Navaneet, K. L.
    Mathew, Ansu
    Kashyap, Shashank
    Hung, Wei-Chih
    Jampani, Varun
    Babu, R. Venkatesh
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1129 - 1137
  • [17] Self-Supervised Deep Learning on Point Clouds by Reconstructing Space
    Sauder, Jonathan
    Sievers, Bjarne
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [18] Self-Supervised Few-Shot Learning on Point Clouds
    Sharma, Charu
    Kaul, Manohar
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [19] A Self-Supervised Decision Fusion Framework for Building Detection
    Senaras, Caglar
    Vural, Fatos T. Yarman
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2016, 9 (05) : 1780 - 1791
  • [20] Point2Vec for Self-supervised Representation Learning on Point Clouds
    Abou Zeid, Karim
    Schult, Jonas
    Hermans, Alexander
    Leibe, Bastian
    PATTERN RECOGNITION, DAGM GCPR 2023, 2024, 14264 : 131 - 146