Local aggregation and global attention network for hyperspectral image classification with spectral-induced aligned superpixel segmentation

被引:33
|
作者
Chen, Zhonghao [1 ]
Wu, Guoyong [1 ]
Gao, Hongmin [1 ]
Ding, Yao [2 ]
Hong, Danfeng [3 ]
Zhang, Bing [4 ,5 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
[2] Xian Res Inst High Technol, Xian 710025, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[4] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[5] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Hyperspectral (HS) image; Graph neural networks; Classification; Superpixel segmentation; Transformer; FRAMEWORK; CNN;
D O I
10.1016/j.eswa.2023.120828
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, graph neural networks (GNNs) have been demonstrated to be a promising framework in investigating non-Euclidean dependency in hyperspectral (HS) images. Since the extraction of inter-pixel relationships using GNNs is computationally intensive, the mainstream GNN-based HS image classification (HSIC) methods often segment original images into superpixels as nodes for further graph propagation. Nevertheless, the low representation of raw spectral signatures limits the segmentation accuracy. Moreover, the preexisting GNN-based approaches have failed to consider the importance between long-range nodes. In this article, we firstly propose a novel superpixel generate strategy, called spectral-induced aligned superpixel segmentation, which can utilize the segmentation results of HS image with raw and deep abstract spectral feature simultaneously. More specifically, the deep spectral feature is excavated by a deep autoencoder. Intuitively, two fusion strategies: minimum and maximum fusion are further explored to integrate above segmentation results. Furthermore, we propose a local aggregation and global attention block (LAGAB) by incorporating graph sample and aggregate strategy and graph transformer to hierarchically explore local and global spatial features. Note that due to the aggregation of node information in the local neighborhood, the further used graph transformer can adaptively model intra-neighbor information. Consequently, a network formed by LAGABs is developed for HSIC. Comprehensive experiments conducted on four highly regarded HS data sets reveal that the proposed method exhibits promising classification performance.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Spectral-Spatial Hyperspectral Image Classification via SVM and Superpixel Segmentation
    He, Zhi
    Shen, Yue
    Zhang, Miao
    Wang, Qiang
    Wang, Yan
    Yu, Renlong
    [J]. 2014 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC) PROCEEDINGS, 2014, : 422 - 427
  • [2] Local and Global Spectral Features for Hyperspectral Image Classification
    Xu, Zeyu
    Su, Cheng
    Wang, Shirou
    Zhang, Xiaocan
    [J]. REMOTE SENSING, 2023, 15 (07)
  • [3] Multilayer Global Spectral-Spatial Attention Network for Wetland Hyperspectral Image Classification
    Xie, Zhuojun
    Hu, Jianwen
    Kang, Xudong
    Duan, Puhong
    Li, Shutao
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Spectral and Spatial Global Context Attention for Hyperspectral Image Classification
    Li, Zhongwei
    Cui, Xingshuai
    Wang, Leiquan
    Zhang, Hao
    Zhu, Xue
    Zhang, Yajing
    [J]. REMOTE SENSING, 2021, 13 (04) : 1 - 24
  • [5] Spectral-Spatial Attention Network for Hyperspectral Image Classification
    Sun, Hao
    Zheng, Xiangtao
    Lu, Xiaoqiang
    Wu, Siyuan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3232 - 3245
  • [6] Global-Local Channel Attention for Hyperspectral Image Classification
    Yan, Peilin
    Qin, Haolin
    Wang, Jihui
    Xu, Tingfa
    Song, Liqiang
    Li, Hui
    Li, Jianan
    [J]. INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1633 - 1638
  • [7] A spectral-spatial attention aggregation network for hyperspectral imagery classification
    Kuang, Wenlan
    Tu, Bing
    He, Wangquan
    Zhang, Guoyun
    Peng, Yishu
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (19) : 7551 - 7580
  • [8] Classification of Hyperspectral image based on superpixel segmentation and DPC algorithm
    Chen, Nian
    Zhou, Hao
    [J]. 2020 19TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2020), 2020, : 138 - 141
  • [9] DEEP CONVOLUTIONAL NETWORKS WITH SUPERPIXEL SEGMENTATION FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Cao, Jiayan
    Chen, Zhao
    Wang, Bin
    [J]. 2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 3310 - 3313
  • [10] Hyperspectral Image Classification Based on Global Spectral Projection and Space Aggregation
    Chen, Dong
    Zhang, Junping
    Guo, Qingle
    Wang, Linlin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20