Lightweight Self-Attention Residual Network for Hyperspectral Classification

被引:13
|
作者
Xia, Jinbiao [1 ,2 ]
Cui, Ying [1 ,2 ]
Li, Wenshan [1 ,2 ]
Wang, Liguo [1 ,2 ]
Wang, Chao [3 ]
机构
[1] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[3] Univ Elect Sci & Technol China, State Key Lab Elect Thin Film & Integrated Device, Clean Energy Mat & Engn Ctr, Sch Elect Sci & Engn, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Computational modeling; Residual neural networks; Adaptation models; Standards; Data mining; Convolutional neural networks (CNNs); hyperspectral image (HSI) classification; lightweight residual structure; self-attention mechanism;
D O I
10.1109/LGRS.2022.3169836
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Compared with traditional hyperspectral image classification methods, the classification model based on the deep convolutional neural network (DCNN) can achieve higher precision classification. However, the increase in classification accuracy has led to explosive growth in model complexity. In this letter, we proposed a more lightweight and efficient residual structure to alleviate this problem to replace the standard residual structure. This structure uses the "divide and conquer" idea to reduce the number of model parameters and calculations. In addition, the structure introduces a self-attention mechanism so that the input feature map and output feature map can be adaptively fused, and the feature extraction ability of the residual structure is further enhanced. The experimental results reveal that the residual structure we proposed can significantly reduce the complexity of the model and maintain a high classification accuracy, even surpassing the current mainstream classification model.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention
    Zhang, Minghua
    Duan, Yuxia
    Song, Wei
    Mei, Haibin
    He, Qi
    [J]. JOURNAL OF IMAGING, 2023, 9 (07)
  • [22] Pyramidal Multiscale Convolutional Network With Polarized Self-Attention for Pixel-Wise Hyperspectral Image Classification
    Ge, Haimiao
    Wang, Liguo
    Liu, Moqi
    Zhao, Xiaoyu
    Zhu, Yuexia
    Pan, Haizhu
    Liu, Yanzhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] Pyramidal Multiscale Convolutional Network With Polarized Self-Attention for Pixel-Wise Hyperspectral Image Classification
    Ge, Haimiao
    Wang, Liguo
    Liu, Moqi
    Zhao, Xiaoyu
    Zhu, Yuexia
    Pan, Haizhu
    Liu, Yanzhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [24] An effective dual self-attention residual network for seizure prediction
    Yang, Xinwu
    Zhao, Jiaqi
    Sun, Qi
    Lu, Jianbo
    Ma, Xu
    [J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2021, 29 : 1604 - 1613
  • [25] Crowd counting method based on the self-attention residual network
    Liu, Yan-Bo
    Jia, Rui-Sheng
    Liu, Qing-Ming
    Zhang, Xing-Li
    Sun, Hong-Mei
    [J]. APPLIED INTELLIGENCE, 2021, 51 (01) : 427 - 440
  • [26] Interactive Enhanced Network Based on Multihead Self-Attention and Graph Convolution for Classification of Hyperspectral and LiDAR Data
    Gao, Hongmin
    Feng, Hao
    Zhang, Yiyan
    Fei, Shuyu
    Shen, Runhua
    Xu, Shufang
    Zhang, Bing
    [J]. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [27] Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification
    Qing, Yuhao
    Huang, Quanzhen
    Feng, Liuyan
    Qi, Yueyan
    Liu, Wenyi
    [J]. REMOTE SENSING, 2022, 14 (03)
  • [28] An Effective Dual Self-Attention Residual Network for Seizure Prediction
    Yang, Xinwu
    Zhao, Jiaqi
    Sun, Qi
    Lu, Jianbo
    Ma, Xu
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1604 - 1613
  • [29] Crowd counting method based on the self-attention residual network
    Yan-Bo Liu
    Rui-Sheng Jia
    Qing-Ming Liu
    Xing-Li Zhang
    Hong-Mei Sun
    [J]. Applied Intelligence, 2021, 51 : 427 - 440
  • [30] Hyperspectral image classification with dual attention dense residual network
    Gao, Hongmin
    Wang, Mingxia
    Yang, Yao
    Cao, Xueying
    Li, Chenming
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (15) : 5604 - 5625