Hyperspectral image classification based on hybrid convolution with three-dimensional attention mechanism

被引:1
|
作者
Zhao X. [1 ,2 ]
Niu J. [1 ,2 ]
Liu C. [1 ,2 ]
Xia Y. [1 ,2 ]
机构
[1] Missile Engineering College, Rocket Force Engineering University, Xi'an
[2] Armament Launch Theory and Technology Key Discipline Laboratory of China, Xi'an
关键词
hybrid convolution; hyperspectral image classification; spatial-spectral feature extraction; three-dimensional attention mechanism;
D O I
10.12305/j.issn.1001-506X.2023.09.04
中图分类号
学科分类号
摘要
Aiming at the lack of effective attention in the process of feature extraction in existing hyperspectral image classification models, a classification model based on hybrid convolution and three-dimensional attention mechanism is proposed. The method realizes the extraction of spatial-spectral features of hyperspectral images by tandem three-dimensioal (3D) convolution and two-dimensional (2D) convolution. An attention mechanism in the 3D convolution stage is designed, and the attention mechanism is implemented in the 3D convolution stage to realize the attention and activation of the effective spatial-spectral features of hyperspectral images while the model is extracting the underlying features. Compared with the traditional 3D convolution-based model, the classification model proposed in this paper reduces the complexity of operations, improves the model's ability to suppress interference noise, and enhances the classification effect. Ablation experiments against the method demonstrate the effectiveness of the proposed 3D convolution attention mechanism, and the optimal classification accuracy is achieved in comparison experiments with five other classification models on two publicly available datasets, Indian Pines and Pavia University. © 2023 Chinese Institute of Electronics. All rights reserved.
引用
收藏
页码:2673 / 2680
页数:7
相关论文
共 32 条
  • [1] GHAMISI P, RASTI B, YOKOYA N, Et al., Multisource and multitemporal data fusion in remote sensing: a comprehensive review of the state of the art, IEEE Geoscience and Remote Sensing Magazine, 7, 1, pp. 6-39, (2019)
  • [2] ZHU Q Q, DENG W H, ZHENG Z, Et al., A spectral-spatial-dependent global learning framework for insufficient and imbalanced hyperspectral image classification, IEEE Trans.on Cybernetics, 52, 11, pp. 11709-11723, (2021)
  • [3] AHMAD M, SHABBIR S, RAZA R A, Et al., Hyperspectral image classification: artifacts of dimension reduction on hybrid CNN, Proc. of the Computer Vision and Pattern Recognition Conference, (2021)
  • [4] ZHANG C Y, CHENG H F, CHEN C H, Et al., The development of hyperspectral remote sensing and its threatening to military equipments, Electro-optic Technology Application, 1, pp. 10-12, (2008)
  • [5] YANG X G, YU Y., Estimating soil salinity under various moisture conditions: an experimental study, IEEE Trans.on Geoscience and Remote Sensing, 55, 5, pp. 2525-2533, (2017)
  • [6] GOVENDER M, CHETTY K, BULCOCK H., A review of hyperspectral remote sensing and its application in vegetation and water resource studies, Water SA, 33, 2, pp. 145-151, (2007)
  • [7] MOLERO J M, GARZON E M, GARCIA I, Et al., Efficient implementation of hyperspectral anomaly detection techniques on GPUs and multicore processors, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 6, pp. 2256-2266, (2014)
  • [8] SUMARSONO A, DU Q., Low-rank subspace representation for estimating the number of signal subspaces in hyperspectral imagery, IEEE Trans.on Geoscience and Remote Sensing, 53, 11, pp. 6286-6292, (2015)
  • [9] CAMPSVALLS G, GOMEZCHOVA L, MUNOZMARI J, Et al., Composite kernels for hyperspectral image classification, IEEE Geoscience Remote Sensing Letters, 105, 1, pp. 23-33, (2006)
  • [10] LI J, HUANG X, GAMBA P, Et al., Multiple feature learning for hyperspectral image classification, IEEE Trans.on Geoscience and Remote Sensing, 53, 3, pp. 1592-1606, (2015)