Remote Sensing LiDAR and Hyperspectral Classification with Multi-Scale Graph Encoder-Decoder Network

被引:2
|
作者
Wang, Fang [1 ]
Du, Xingqian [2 ]
Zhang, Weiguang [1 ]
Nie, Liang [1 ]
Wang, Hu [1 ,3 ,4 ,5 ]
Zhou, Shun [1 ]
Ma, Jun [6 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] China Acad Space Technol Xian, Xian 710100, Peoples R China
[3] Xian Inst Opt & Precis Mech CAS, Xian 710119, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Xian Space Sensor Opt Technol Engn Res Ctr, Xian 710119, Peoples R China
[6] Xian Technol Univ, Inst Interdisciplinary & Innovat Res, Xian 710021, Peoples R China
关键词
LiDAR; hyperspectral image; multi-modal data fusion; graph model; deep learning;
D O I
10.3390/rs16203912
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The rapid development of sensor technology has made multi-modal remote sensing data valuable for land cover classification due to its diverse and complementary information. Many feature extraction methods for multi-modal data, combining light detection and ranging (LiDAR) and hyperspectral imaging (HSI), have recognized the importance of incorporating multiple spatial scales. However, effectively capturing both long-range global correlations and short-range local features simultaneously on different scales remains a challenge, particularly in large-scale, complex ground scenes. To address this limitation, we propose a multi-scale graph encoder-decoder network (MGEN) for multi-modal data classification. The MGEN adopts a graph model that maintains global sample correlations to fuse multi-scale features, enabling simultaneous extraction of local and global information. The graph encoder maps multi-modal data from different scales to the graph space and completes feature extraction in the graph space. The graph decoder maps the features of multiple scales back to the original data space and completes multi-scale feature fusion and classification. Experimental results on three HSI-LiDAR datasets demonstrate that the proposed MGEN achieves considerable classification accuracies and outperforms state-of-the-art methods.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] Multi-label classification of arrhythmia using dynamic graph convolutional network based on encoder-decoder framework
    Cheng, Yuhao
    Zhu, Wenliang
    Li, Deyin
    Wang, Lirong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 95
  • [32] Building Precision: Efficient Encoder-Decoder Networks for Remote Sensing Based on Aerial RGB and LiDAR Data
    Sulaiman, Muhammad
    Finnesand, Erik
    Farmanbar, Mina
    Belbachir, Ahmed Nabil
    Rong, Chunming
    IEEE ACCESS, 2024, 12 : 60329 - 60346
  • [33] SISR of Hyperspectral Remote Sensing Imagery Using 3D Encoder-Decoder RUNet Architecture
    Aburaed, Nour
    Alkhatib, Mohammed Q.
    Marshall, Stephen
    Zabalza, Jaime
    Al Ahmad, Hussain
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1516 - 1519
  • [34] Multi-scale fusion residual encoder-decoder approach for low illumination image enhancement
    Pan Xiaoying
    Wei Miao
    Wang Hao
    Jia Fengzhu
    TheJournalofChinaUniversitiesofPostsandTelecommunications, 2022, 29 (02) : 63 - 72
  • [35] Encoder-Decoder Networks for Retinal Vessel Segmentation Using Large Multi-scale Patches
    Browatzki, Bjoern
    Lies, Joern-Philipp
    Wallraven, Christian
    OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2020, 2020, 12069 : 42 - 52
  • [36] A Traffic Surveillance Multi-Scale Vehicle Detection Object Method Base on Encoder-Decoder
    Hong, Feng
    Lu, Chang-Hua
    Liu, Chun
    Liu, Ru-Ru
    Wei, Ju
    IEEE ACCESS, 2020, 8 : 47664 - 47674
  • [37] An Encoder-Decoder Convolution Network With Fine-Grained Spatial Information for Hyperspectral Images Classification
    Li, Zhongwei
    Guo, Fangming
    Li, Qi
    Ren, Guangbo
    Wang, Leiquan
    IEEE ACCESS, 2020, 8 : 33600 - 33608
  • [38] Learning compact graph representations via an encoder-decoder network
    John Boaz Lee
    Xiangnan Kong
    Applied Network Science, 4
  • [39] Multi-scale fusion residual encoder-decoder approach for low illumination image enhancement
    Xiaoying P.
    Miao W.
    Hao W.
    Fengzhü J.
    Journal of China Universities of Posts and Telecommunications, 2022, 29 (02): : 63 - 72
  • [40] A Multi-Scale Fusion Residual Encoder-Decoder Approach for Low Illumination Image Enhancement
    Pan X.
    Wei M.
    Wang H.
    Jia F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (01): : 104 - 112