Deep hybrid: Multi-graph neural network collaboration for hyperspectral image classification

被引:88
|
作者
Yao, Ding [1 ]
Zhang, Zhi-li [1 ]
Zhao, Xiao-feng [1 ]
Wei, Cai [1 ]
Fang, He [1 ]
Cai, Yao-ming [2 ]
Cai, Wei-Wei [1 ,3 ]
机构
[1] Xian Res Inst High Technol, Xian 710025, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[3] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Peoples R China
关键词
Graph neural network; Hyperspectral image classification; Deep hybrid network;
D O I
10.1016/j.dt.2022.02.007
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With limited number of labeled samples, hyperspectral image (HSI) classification is a difficult Problem in current research. The graph neural network (GNN) has emerged as an approach to semi-supervised classification, and the application of GNN to hyperspectral images has attracted much attention. However, in the existing GNN-based methods a single graph neural network or graph filter is mainly used to extract HSI features, which does not take full advantage of various graph neural networks (graph filters). Moreover, the traditional GNNs have the problem of oversmoothing. To alleviate these shortcomings, we introduce a deep hybrid multi-graph neural network (DHMG), where two different graph filters, i.e., the spectral filter and the autoregressive moving average (ARMA) filter, are utilized in two branches. The former can well extract the spectral features of the nodes, and the latter has a good suppression effect on graph noise. The network realizes information interaction between the two branches and takes good advantage of different graph filters. In addition, to address the problem of oversmoothing, a dense network is proposed, where the local graph features are preserved. The dense structure satisfies the needs of different classification targets presenting different features. Finally, we introduce a GraphSAGEbased network to refine the graph features produced by the deep hybrid network. Extensive experiments on three public HSI datasets strongly demonstrate that the DHMG dramatically outperforms the state-ofthe-art models. (c) 2022 China Ordnance Society. Publishing services by Elsevier B.V. on behalf of KeAi Communications Co. Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:164 / 176
页数:13
相关论文
共 50 条
  • [31] MULTI-SCALE 3D DEEP CONVOLUTIONAL NEURAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    He, Mingyi
    Li, Bo
    Chen, Huahui
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3904 - 3908
  • [32] Graph-in-Graph Convolutional Network for Hyperspectral Image Classification
    Jia, Sen
    Jiang, Shuguo
    Zhang, Shuyu
    Xu, Meng
    Jia, Xiuping
    [J]. IEEE Transactions on Neural Networks and Learning Systems, 2024, 35 (01) : 1157 - 1171
  • [33] Hybrid network model based on 3D convolutional neural network and scalable graph convolutional network for hyperspectral image classification
    Wang, Xili
    Liang, Zhengyin
    [J]. IET IMAGE PROCESSING, 2023, 17 (01) : 256 - 273
  • [34] Feature extraction of hyperspectral image with semi-supervised multi-graph embedding
    Huang, Hong
    Tang, Yu-Xiao
    Duan, Yu-Le
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2020, 28 (02): : 443 - 456
  • [35] Deep Temporal Multi-Graph Convolutional Network for Crime Prediction
    Wang, Yaqian
    Ge, Liang
    Li, Siyu
    Chang, Feng
    [J]. CONCEPTUAL MODELING, ER 2020, 2020, 12400 : 525 - 538
  • [36] Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification
    Dong, Yanni
    Liu, Quanwei
    Du, Bo
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1559 - 1572
  • [37] Image emotion multi-label classification based on multi-graph learning
    Wang, Meixia
    Zhao, Yuhai
    Wang, Yejiang
    Xu, Tongze
    Sun, Yiming
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [38] Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification
    Xi, Jiangbo
    Ersoy, Okan K.
    Cong, Ming
    Zhao, Chaoying
    Qu, Wei
    Wu, Tianjun
    [J]. REMOTE SENSING, 2022, 14 (12)
  • [39] Deep convolution neural network with automatic attribute profiles for hyperspectral image classification
    Arundhati Das
    Kaushal Bhardwaj
    Swarnajyoti Patra
    [J]. Multimedia Tools and Applications, 2021, 80 : 35365 - 35385
  • [40] Deep-Growing Neural Network With Manifold Constraints for Hyperspectral Image Classification
    Shi, Jiao
    Wu, Tiancheng
    Qin, A. K.
    Shao, Tao
    Lei, Yu
    Jeon, Gwanggil
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 12