Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification

被引:66
|
作者
Xu, Yonghao [1 ,2 ]
Du, Bo [3 ,4 ]
Zhang, Liangpei [1 ,2 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Inst Artificial Intelligence, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Inst Artificial Intelligence, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Wuhan Univ, Hubei Key Lab Multimedia & Network Commun Engn, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Training; Hyperspectral imaging; Feature extraction; Task analysis; Perturbation methods; Predictive models; Hyperspectral image (HSI) classification; adversarial example; adversarial attack; adversarial defense; convolutional neural network (CNN); deep learning; NEURAL-NETWORKS; DEEP; CNN;
D O I
10.1109/TIP.2021.3118977
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models have shown their great capability for the hyperspectral image (HSI) classification task in recent years. Nevertheless, their vulnerability towards adversarial attacks could not be neglected. In this study, we systematically analyze the influence of adversarial attacks on the HSI classification task for the first time. While existing research of adversarial attacks focuses on the generation of adversarial examples in the RGB domain, the experiments in this study show such adversarial examples could also exist in the hyperspectral domain. Although the difference between the generated adversarial image and the original hyperspectral data is imperceptible to the human visual system, most of the existing state-of-the-art deep learning models could be fooled by the adversarial image to make wrong predictions. To address this challenge, a novel self-attention context network (SACNet) is further proposed. We discover that the global context information contained in HSI can significantly improve the robustness of deep neural networks when confronted with adversarial attacks. Extensive experiments on three benchmark HSI datasets demonstrate that the proposed SACNet possesses stronger resistibility towards adversarial examples compared with the existing state-of-the-art deep learning models.
引用
收藏
页码:8671 / 8685
页数:15
相关论文
共 50 条
  • [1] Sample Generation with Self-Attention Generative Adversarial Adaptation Network (SaGAAN) for Hyperspectral Image Classification
    Zhao, Wenzhi
    Chen, Xi
    Chen, Jiage
    Qu, Yang
    [J]. REMOTE SENSING, 2020, 12 (05)
  • [2] SANet: A Self-Attention Network for Agricultural Hyperspectral Image Classification
    Zhang, Bo
    Chen, Yaxiong
    Li, Zhiheng
    Xiong, Shengwu
    Lu, Xiaoqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [3] WFSS: weighted fusion of spectral transformer and spatial self-attention for robust hyperspectral image classification against adversarial attacks
    Lichun Tang
    Zhaoxia Yin
    Hang Su
    Wanli Lyu
    Bin Luo
    [J]. Visual Intelligence, 2 (1):
  • [4] S3ANet: Spatial-Spectral Self-Attention Learning Network for Defending Against Adversarial Attacks in Hyperspectral Image Classification
    Xu, Yichu
    Xu, Yonghao
    Jiao, Hongzan
    Gao, Zhi
    Zhang, Lefei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] Lightweight Self-Attention Residual Network for Hyperspectral Classification
    Xia, Jinbiao
    Cui, Ying
    Li, Wenshan
    Wang, Liguo
    Wang, Chao
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [6] DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification
    Yang, Zian
    Zheng, Nairong
    Wang, Feng
    [J]. REMOTE SENSING, 2023, 15 (15)
  • [7] Spectral-Spatial Self-Attention Networks for Hyperspectral Image Classification
    Zhang, Xuming
    Sun, Genyun
    Jia, Xiuping
    Wu, Lixin
    Zhang, Aizhu
    Ren, Jinchang
    Fu, Hang
    Yao, Yanjuan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification
    Luo, Junshen
    He, Zhi
    Lin, Haomei
    Wu, Heqian
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [9] Pyramidal Multiscale Convolutional Network With Polarized Self-Attention for Pixel-Wise Hyperspectral Image Classification
    Ge, Haimiao
    Wang, Liguo
    Liu, Moqi
    Zhao, Xiaoyu
    Zhu, Yuexia
    Pan, Haizhu
    Liu, Yanzhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Pyramidal Multiscale Convolutional Network With Polarized Self-Attention for Pixel-Wise Hyperspectral Image Classification
    Ge, Haimiao
    Wang, Liguo
    Liu, Moqi
    Zhao, Xiaoyu
    Zhu, Yuexia
    Pan, Haizhu
    Liu, Yanzhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61