Self-Attention Context Network: Addressing the Threat of Adversarial Attacks for Hyperspectral Image Classification

被引:66
|
作者
Xu, Yonghao [1 ,2 ]
Du, Bo [3 ,4 ]
Zhang, Liangpei [1 ,2 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Inst Artificial Intelligence, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Inst Artificial Intelligence, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430079, Peoples R China
[4] Wuhan Univ, Hubei Key Lab Multimedia & Network Commun Engn, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Training; Hyperspectral imaging; Feature extraction; Task analysis; Perturbation methods; Predictive models; Hyperspectral image (HSI) classification; adversarial example; adversarial attack; adversarial defense; convolutional neural network (CNN); deep learning; NEURAL-NETWORKS; DEEP; CNN;
D O I
10.1109/TIP.2021.3118977
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning models have shown their great capability for the hyperspectral image (HSI) classification task in recent years. Nevertheless, their vulnerability towards adversarial attacks could not be neglected. In this study, we systematically analyze the influence of adversarial attacks on the HSI classification task for the first time. While existing research of adversarial attacks focuses on the generation of adversarial examples in the RGB domain, the experiments in this study show such adversarial examples could also exist in the hyperspectral domain. Although the difference between the generated adversarial image and the original hyperspectral data is imperceptible to the human visual system, most of the existing state-of-the-art deep learning models could be fooled by the adversarial image to make wrong predictions. To address this challenge, a novel self-attention context network (SACNet) is further proposed. We discover that the global context information contained in HSI can significantly improve the robustness of deep neural networks when confronted with adversarial attacks. Extensive experiments on three benchmark HSI datasets demonstrate that the proposed SACNet possesses stronger resistibility towards adversarial examples compared with the existing state-of-the-art deep learning models.
引用
收藏
页码:8671 / 8685
页数:15
相关论文
共 50 条
  • [31] Generative Adversarial Network With Transformer for Hyperspectral Image Classification
    Hao, Siyuan
    Xia, Yufeng
    Ye, Yuanxin
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [32] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Niu, Jiawei
    Liu, Zhunga
    Pan, Quan
    Yang, Yanbo
    LI, Yang
    [J]. CHINESE JOURNAL OF AERONAUTICS, 2023, 36 (03) : 303 - 315
  • [33] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Jiawei NIU
    Zhunga LIU
    Quan PAN
    Yanbo YANG
    Yang LI
    [J]. Chinese Journal of Aeronautics, 2023, (03) : 303 - 315
  • [34] Conditional self-attention generative adversarial network with differential evolution algorithm for imbalanced data classification
    Jiawei NIU
    Zhunga LIU
    Quan PAN
    Yanbo YANG
    Yang LI
    [J]. Chinese Journal of Aeronautics., 2023, 36 (03) - 315
  • [35] Dialogue Generation Using Self-Attention Generative Adversarial Network
    Hatua, Amartya
    Nguyen, Trung T.
    Sung, Andrew H.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON CONVERSATIONAL DATA & KNOWLEDGE ENGINEERING (CDKE), 2019, : 33 - 38
  • [36] Hyperspectral Image Classification Based on 3-D Multihead Self-Attention Spectral-Spatial Feature Fusion Network
    Zhou, Qigao
    Zhou, Shuai
    Shen, Feng
    Yin, Juan
    Xu, Dingjie
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1072 - 1084
  • [37] A multiscale 3D convolution with context attention network for hyperspectral image classification
    Wu, Linfeng
    Wang, Huajun
    Zhang, Tong
    [J]. EARTH SCIENCE INFORMATICS, 2022, 15 (04) : 2553 - 2569
  • [38] A multiscale 3D convolution with context attention network for hyperspectral image classification
    Linfeng Wu
    Huajun Wang
    Tong Zhang
    [J]. Earth Science Informatics, 2022, 15 : 2553 - 2569
  • [39] Self-Attention Generative Adversarial Networks
    Zhang, Han
    Goodfellow, Ian
    Metaxas, Dimitris
    Odena, Augustus
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [40] ADASAN: ADAPTIVE COSINE SIMILARITY SELF-ATTENTION NETWORK FOR GASTROINTESTINAL ENDOSCOPY IMAGE CLASSIFICATION
    Zhao, Qian
    Yang, Wenming
    Liao, Qingmin
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1855 - 1859