Self-Supervised Pre-Training for 3-D Roof Reconstruction on LiDAR Data

被引:0
|
作者
Yang, Hongxin [1 ]
Huang, Shangfeng [1 ]
Wang, Ruisheng [1 ,2 ]
Wang, Xin [1 ]
机构
[1] Univ Calgary, Dept Geomatics Engn, Calgary, AB T2N 1N4, Canada
[2] Shenzhen Univ, Sch Architecture & Urban Planning, Shenzhen 518060, Peoples R China
关键词
Corner detection; Training; Task analysis; edge prediction; roof reconstruction; self-supervised learning;
D O I
10.1109/LGRS.2024.3362733
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Reconstructing building roofs from light detection and ranging (LiDAR) point clouds from aerial perspectives is significantly important in photogrammetry domains. This letter proposes a novel approach for 3-D real-world building roof reconstruction in Estonia, employing a two-stage self-supervised pre-training architecture to transform 3-D roof point clouds into wireframe models. We utilize a self-supervised pre-training framework that incorporates a purpose-designed and efficient self-attention mechanism to generate point-wise features. Subsequently, we develop modules for corner detection and edge prediction to classify and regress the coordinates of corner points and determine optimal edge selections, respectively, to construct the final wireframe model. The effectiveness of our approach is evaluated on real-world roof datasets, achieving corner and edge precision accuracies of 83% and 78%, respectively. In addition, fine-tuning our self-supervised pre-training method with varying ratios of labeled data, particularly with only 50% partially labeled data, attains superior performance, achieving 84% and 85% corner and edge precision, respectively.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 50 条
  • [41] GUIDED CONTRASTIVE SELF-SUPERVISED PRE-TRAINING FOR AUTOMATIC SPEECH RECOGNITION
    Khare, Aparna
    Wu, Minhua
    Bhati, Saurabhchand
    Droppo, Jasha
    Maas, Roland
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 174 - 181
  • [42] Self-supervised Heterogeneous Graph Pre-training Based on Structural Clustering
    Yang, Yaming
    Guan, Ziyu
    Wang, Zhe
    Zhao, Wei
    Xu, Cai
    Lu, Weigang
    Huang, Jianbin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [43] DenseCL: A simple framework for self-supervised dense visual pre-training
    Wang, Xinlong
    Zhang, Rufeng
    Shen, Chunhua
    Kong, Tao
    VISUAL INFORMATICS, 2023, 7 (01) : 30 - 40
  • [44] Feature-Suppressed Contrast for Self-Supervised Food Pre-training
    Liu, Xinda
    Zhu, Yaohui
    Liu, Linhu
    Tian, Jiang
    Wang, Lili
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4359 - 4367
  • [45] Self-supervised Pre-training and Semi-supervised Learning for Extractive Dialog Summarization
    Zhuang, Yingying
    Song, Jiecheng
    Sadagopan, Narayanan
    Beniwal, Anurag
    COMPANION OF THE WORLD WIDE WEB CONFERENCE, WWW 2023, 2023, : 1069 - 1076
  • [46] Self-Supervised Underwater Image Generation for Underwater Domain Pre-Training
    Wu, Zhiheng
    Wu, Zhengxing
    Chen, Xingyu
    Lu, Yue
    Yu, Junzhi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 14
  • [47] COMPARISON OF SELF-SUPERVISED SPEECH PRE-TRAINING METHODS ON FLEMISH DUTCH
    Poncelet, Jakob
    Hamme, Hugo Van
    2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, : 169 - 176
  • [48] Self-supervised Pre-training with Acoustic Configurations for Replay Spoofing Detection
    Shim, Hye-jin
    Heo, Hee-Soo
    Jung, Jee-weon
    Yu, Ha-Jin
    INTERSPEECH 2020, 2020, : 1091 - 1095
  • [49] MULTI-TASK SELF-SUPERVISED PRE-TRAINING FOR MUSIC CLASSIFICATION
    Wu, Ho-Hsiang
    Kao, Chieh-Chi
    Tang, Qingming
    Sun, Ming
    McFee, Brian
    Bello, Juan Pablo
    Wang, Chao
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 556 - 560
  • [50] PreTraM: Self-supervised Pre-training via Connecting Trajectory and Map
    Xu, Chenfeng
    Li, Tian
    Tang, Chen
    Sun, Lingfeng
    Keutzer, Kurt
    Tomizuka, Masayoshi
    Fathi, Alireza
    Zhan, Wei
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 34 - 50