Lightweight Self-Attention Residual Network for Hyperspectral Classification

被引:13
|
作者
Xia, Jinbiao [1 ,2 ]
Cui, Ying [1 ,2 ]
Li, Wenshan [1 ,2 ]
Wang, Liguo [1 ,2 ]
Wang, Chao [3 ]
机构
[1] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[3] Univ Elect Sci & Technol China, State Key Lab Elect Thin Film & Integrated Device, Clean Energy Mat & Engn Ctr, Sch Elect Sci & Engn, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Computational modeling; Residual neural networks; Adaptation models; Standards; Data mining; Convolutional neural networks (CNNs); hyperspectral image (HSI) classification; lightweight residual structure; self-attention mechanism;
D O I
10.1109/LGRS.2022.3169836
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Compared with traditional hyperspectral image classification methods, the classification model based on the deep convolutional neural network (DCNN) can achieve higher precision classification. However, the increase in classification accuracy has led to explosive growth in model complexity. In this letter, we proposed a more lightweight and efficient residual structure to alleviate this problem to replace the standard residual structure. This structure uses the "divide and conquer" idea to reduce the number of model parameters and calculations. In addition, the structure introduces a self-attention mechanism so that the input feature map and output feature map can be adaptively fused, and the feature extraction ability of the residual structure is further enhanced. The experimental results reveal that the residual structure we proposed can significantly reduce the complexity of the model and maintain a high classification accuracy, even surpassing the current mainstream classification model.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] SANet: A Self-Attention Network for Agricultural Hyperspectral Image Classification
    Zhang, Bo
    Chen, Yaxiong
    Li, Zhiheng
    Xiong, Shengwu
    Lu, Xiaoqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [2] Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification
    Luo, Junshen
    He, Zhi
    Lin, Haomei
    Wu, Heqian
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [3] Lightweight Self-Attention Network for Semantic Segmentation
    Zhou, Yan
    Zhou, Haibin
    Li, Nanjun
    Li, Jianxun
    Wang, Dongli
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [4] Lightweight omni-dimensional dynamic convolution with spatial-spectral self-attention network for hyperspectral image classification
    Liu, Yi
    Peng, Xufeng
    Zhang, Yanjun
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (18) : 6572 - 6600
  • [5] A Dynamic Residual Self-Attention Network for Lightweight Single Image Super-Resolution
    Park, Karam
    Soh, Jae Woong
    Cho, Nam Ik
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 907 - 918
  • [6] Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification
    Xu, Yonghao
    Du, Bo
    Zhang, Liangpei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8671 - 8685
  • [7] AN ATTENTION BASED LIGHTWEIGHT NETWORK FOR HYPERSPECTRAL IMAGES CLASSIFICATION
    Zhang, Xuming
    Tian, Qingjiu
    Gu, Xingfa
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 2251 - 2254
  • [8] RDNet: Lightweight Residual and Detail self-attention Network for infrared image super-resolution
    Chen, Feiyang
    Huang, Detian
    Lin, Mingxin
    Song, Jiaxun
    Huang, Xiaoqian
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2024, 141
  • [9] Multilayer self-attention residual network for code search
    Hu, Haize
    Liu, Jianxun
    Zhang, Xiangping
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (09):
  • [10] DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification
    Yang, Zian
    Zheng, Nairong
    Wang, Feng
    [J]. REMOTE SENSING, 2023, 15 (15)