Remote Sensing LiDAR and Hyperspectral Classification with Multi-Scale Graph Encoder-Decoder Network

被引:2
|
作者
Wang, Fang [1 ]
Du, Xingqian [2 ]
Zhang, Weiguang [1 ]
Nie, Liang [1 ]
Wang, Hu [1 ,3 ,4 ,5 ]
Zhou, Shun [1 ]
Ma, Jun [6 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] China Acad Space Technol Xian, Xian 710100, Peoples R China
[3] Xian Inst Opt & Precis Mech CAS, Xian 710119, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Xian Space Sensor Opt Technol Engn Res Ctr, Xian 710119, Peoples R China
[6] Xian Technol Univ, Inst Interdisciplinary & Innovat Res, Xian 710021, Peoples R China
关键词
LiDAR; hyperspectral image; multi-modal data fusion; graph model; deep learning;
D O I
10.3390/rs16203912
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The rapid development of sensor technology has made multi-modal remote sensing data valuable for land cover classification due to its diverse and complementary information. Many feature extraction methods for multi-modal data, combining light detection and ranging (LiDAR) and hyperspectral imaging (HSI), have recognized the importance of incorporating multiple spatial scales. However, effectively capturing both long-range global correlations and short-range local features simultaneously on different scales remains a challenge, particularly in large-scale, complex ground scenes. To address this limitation, we propose a multi-scale graph encoder-decoder network (MGEN) for multi-modal data classification. The MGEN adopts a graph model that maintains global sample correlations to fuse multi-scale features, enabling simultaneous extraction of local and global information. The graph encoder maps multi-modal data from different scales to the graph space and completes feature extraction in the graph space. The graph decoder maps the features of multiple scales back to the original data space and completes multi-scale feature fusion and classification. Experimental results on three HSI-LiDAR datasets demonstrate that the proposed MGEN achieves considerable classification accuracies and outperforms state-of-the-art methods.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] HYPERSPECTRAL IMAGE CLASSIFICATION VIA MULTI-SCALE ENCODER-DECODER NETWORK
    Ma, Jingjing
    Wu, Linlin
    Tang, Xu
    Zhang, Xiangrong
    Zhu, Cheng
    Ma, Junyong
    Jiao, Licheng
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 1283 - 1286
  • [2] Semantic Segmentation of Remote Sensing Image Based on Multi-Scale Semantic Encoder-Decoder Network
    Liang Y.
    Yi C.-X.
    Wang G.-Y.
    Hu Y.-H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (11): : 3199 - 3214
  • [3] Multi-scale Recurrent Encoder-Decoder Network for Dense Temporal Classification
    Choo, Sungkwon
    Seo, Wonkyo
    Jeong, Dong-Ju
    Cho, Nam Ik
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 103 - 108
  • [4] An Encoder-Decoder with a Residual Network for Fusing Hyperspectral and Panchromatic Remote Sensing Images
    Zhao, Rui
    Du, Shihong
    REMOTE SENSING, 2022, 14 (09)
  • [5] Multi-scale deep encoder-decoder network for salient object detection
    Ren, Qinghua
    Hu, Renjie
    NEUROCOMPUTING, 2018, 316 : 95 - 104
  • [6] Multi-scale Supervised Attentive Encoder-Decoder Network for Crowd Counting
    Zhang, Anran
    Jiang, Xiaolong
    Zhang, Baochang
    Cao, Xianbin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
  • [7] Multi-Scale Attention and Encoder-Decoder Network for Video Saliency Object Detection
    Hongbo Bi
    Huihui Zhu
    Lina Yang
    Ranwan Wu
    Pattern Recognition and Image Analysis, 2022, 32 : 340 - 350
  • [8] Building Extraction of Aerial Images by a Global and Multi-Scale Encoder-Decoder Network
    Ma, Jingjing
    Wu, Linlin
    Tang, Xu
    Liu, Fang
    Zhang, Xiangrong
    Jiao, Licheng
    REMOTE SENSING, 2020, 12 (15)
  • [9] An encoder-decoder network for crowd counting based on multi-scale attention mechanism
    Chuang H.-H.
    Chen Y.-C.
    Lin C.H.
    Multimedia Tools and Applications, 2025, 84 (03) : 1187 - 1210
  • [10] Multi-Scale Attention and Encoder-Decoder Network for Video Saliency Object Detection
    Bi, Hongbo
    Zhu, Huihui
    Yang, Lina
    Wu, Ranwan
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2022, 32 (02) : 340 - 350