Remote Sensing LiDAR and Hyperspectral Classification with Multi-Scale Graph Encoder-Decoder Network

被引:2
|
作者
Wang, Fang [1 ]
Du, Xingqian [2 ]
Zhang, Weiguang [1 ]
Nie, Liang [1 ]
Wang, Hu [1 ,3 ,4 ,5 ]
Zhou, Shun [1 ]
Ma, Jun [6 ]
机构
[1] Xian Technol Univ, Sch Optoelect Engn, Xian 710021, Peoples R China
[2] China Acad Space Technol Xian, Xian 710100, Peoples R China
[3] Xian Inst Opt & Precis Mech CAS, Xian 710119, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[5] Xian Space Sensor Opt Technol Engn Res Ctr, Xian 710119, Peoples R China
[6] Xian Technol Univ, Inst Interdisciplinary & Innovat Res, Xian 710021, Peoples R China
关键词
LiDAR; hyperspectral image; multi-modal data fusion; graph model; deep learning;
D O I
10.3390/rs16203912
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The rapid development of sensor technology has made multi-modal remote sensing data valuable for land cover classification due to its diverse and complementary information. Many feature extraction methods for multi-modal data, combining light detection and ranging (LiDAR) and hyperspectral imaging (HSI), have recognized the importance of incorporating multiple spatial scales. However, effectively capturing both long-range global correlations and short-range local features simultaneously on different scales remains a challenge, particularly in large-scale, complex ground scenes. To address this limitation, we propose a multi-scale graph encoder-decoder network (MGEN) for multi-modal data classification. The MGEN adopts a graph model that maintains global sample correlations to fuse multi-scale features, enabling simultaneous extraction of local and global information. The graph encoder maps multi-modal data from different scales to the graph space and completes feature extraction in the graph space. The graph decoder maps the features of multiple scales back to the original data space and completes multi-scale feature fusion and classification. Experimental results on three HSI-LiDAR datasets demonstrate that the proposed MGEN achieves considerable classification accuracies and outperforms state-of-the-art methods.
引用
收藏
页数:22
相关论文
共 50 条
  • [21] Multi-Scale Dense Networks for Hyperspectral Remote Sensing Image Classification
    Zhang, Chunju
    Li, Guandong
    Du, Shihong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11): : 9201 - 9222
  • [22] Dual Encoder-Decoder Network for Land Cover Segmentation of Remote Sensing Image
    Wang, Zhongchen
    Xia, Min
    Weng, Liguo
    Hu, Kai
    Lin, Haifeng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2372 - 2385
  • [23] An road extraction method for remote sensing image based on Encoder-Decoder network
    He H.
    Wang S.
    Yang D.
    Wang S.
    Liu X.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2019, 48 (03): : 330 - 338
  • [24] Auto Graph Encoder-Decoder for Neural Network Pruning
    Yu, Sixing
    Mazaheri, Arya
    Jannesari, Ali
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6342 - 6352
  • [25] DHA-Net: An encoder-decoder network fusing multi-scale features for optic disc segmentation
    Zheng, Xuan
    He, Yi
    Yuan, Huaqing
    Jiang, Yanglin
    Xu, Yanbin
    2023 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC, 2023,
  • [26] A graph encoder-decoder network for unsupervised anomaly detection
    Mesgaran, Mahsa
    Ben Hamza, A.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (32): : 23521 - 23535
  • [27] PMED-Net: Pyramid Based Multi-Scale Encoder-Decoder Network for Medical Image Segmentation
    Khan, Abbas
    Kim, Hyongsuk
    Chua, Leon
    IEEE ACCESS, 2021, 9 : 55988 - 55998
  • [28] An Attention Encoder-Decoder Network Based on Generative Adversarial Network for Remote Sensing Image Dehazing
    Zhao, Liquan
    Zhang, Yupeng
    Cui, Ying
    IEEE SENSORS JOURNAL, 2022, 22 (11) : 10890 - 10900
  • [29] MAENet: Multiple Attention Encoder-Decoder Network for Farmland Segmentation of Remote Sensing Images
    Huan, Hai
    Liu, Yuan
    Xie, Yaqin
    Wang, Chao
    Xu, Dongdong
    Zhang, Yi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [30] Semantic Segmentation of Remote Sensing Image Based on Encoder-Decoder Convolutional Neural Network
    Zhang Zhehan
    Fang Wei
    Du Lili
    Qiao Yanli
    Zhang Dongying
    Ding Guoshen
    ACTA OPTICA SINICA, 2020, 40 (03)