Dual-Branch Sparse Self-Learning With Instance Binding Augmentation for Adversarial Detection in Remote Sensing Images

被引:0
|
作者
Zhang, Zhentong [1 ,2 ,4 ]
Li, Xinde [2 ,3 ]
Li, Heqing [1 ]
Dunkin, Fir [3 ]
Li, Bing [3 ]
Li, Zhijun [5 ,6 ]
机构
[1] Southeast Univ, Sch Cyber Sci Engn, Nanjing 210096, Peoples R China
[2] Nanjing Ctr Appl Math, Nanjing 211135, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[4] Southeast Univ, Shenzhen Res Inst, Nanjing 518063, Peoples R China
[5] Tongji Univ, Translat Res Ctr, Sch Mech Engn, Shanghai 200070, Peoples R China
[6] Tongji Univ, Shanghai Yangzhi Rehabil Hosp, Shanghai 200070, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Detectors; Glass box; Convolutional codes; Contrastive learning; Mobile handsets; Adversarial examples (AEs); AE detection; instance binding augmentation; self-supervised; sparse depthwise separable convolution; ATTACKS;
D O I
10.1109/TGRS.2024.3436841
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing image analysis technology based on neural networks has significantly facilitated human life. However, adversarial attacks can drastically impair the performance of these models, posing substantial economic and security risks. Current adversarial example (AE) detectors primarily focus on studying attacked natural images, while AEs in the remote sensing domain have not received adequate attention. To address this challenge, we propose a novel dual-branch sparse self-learning framework, leveraging instance binding augmentation. The contrastive branch concurrently enhances intra-instance and inter-example feature discrimination, while the masked branch reconstructs perturbation distributions. Furthermore, our method utilizes sparse encoding within depthwise separable convolutions to efficiently transfer parameters, thereby ensuring compatibility with deployment on mobile devices. Extensive experiments demonstrate that our method achieves state-of-the-art performance in detecting both white-box and black-box attacks on remote sensing images. Specifically, our method achieves an average detection accuracy of 95.69%/95.18%, a recall of 91.8%/93.6%, and an F1-score of 93.48%/94.22% on two attacked models across various attack scenarios, outperforming existing methods.
引用
收藏
页数:13
相关论文
共 48 条
  • [1] Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images
    Chen, Hao
    Li, Wenyuan
    Shi, Zhenwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Change Detection on Remote Sensing Images Using Dual-Branch Multilevel Intertemporal Network
    Feng, Yuchao
    Jiang, Jiawei
    Xu, Honghui
    Zheng, Jianwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Dual-branch network for change detection of remote sensing image
    Ma, Chong
    Weng, Liguo
    Xia, Min
    Lin, Haifeng
    Qian, Ming
    Zhang, Yonghong
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [4] Dual-Branch Feature Fusion Remote Sensing Building Detection Model
    Cheng, Jiawei
    Guo, Rongzuo
    Wu, Jiancheng
    Zhang, Hao
    [J]. Computer Engineering and Applications, 2024, 60 (22) : 145 - 153
  • [5] DBDAN: Dual-Branch Dynamic Attention Network for Semantic Segmentation of Remote Sensing Images
    Che, Rui
    Ma, Xiaowen
    Hong, Tingfeng
    Wang, Xinyu
    Feng, Tian
    Zhang, Wei
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IV, 2024, 14428 : 306 - 317
  • [6] Dual-branch Branch Networks Based on Contrastive Learning for Long-Tailed Remote Sensing
    Zhang, Lei
    Peng, Lijia
    Xia, Pengfei
    Wei, Chuyuan
    Yang, Chengwei
    Zhang, Yanyan
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2024, 90 (01): : 45 - 53
  • [7] DHRNet: A Dual-Branch Hybrid Reinforcement Network for Semantic Segmentation of Remote Sensing Images
    Bai, Qinyan
    Luo, Xiaobo
    Wang, Yaxu
    Wei, Tengfei
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4176 - 4193
  • [8] Modified Self-Learning with Clustering for the Classification of Remote Sensing Images
    Aydav, Prem Shankar Singh
    Minz, Sonajharia
    [J]. SECOND INTERNATIONAL SYMPOSIUM ON COMPUTER VISION AND THE INTERNET (VISIONNET'15), 2015, 58 : 97 - 104
  • [9] A Dual-Branch Deep Learning Architecture for Multisensor and Multitemporal Remote Sensing Semantic Segmentation
    Bergamasco, Luca
    Bovolo, Francesca
    Bruzzone, Lorenzo
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 2147 - 2162
  • [10] A dual-branch weakly supervised learning based network for accurate mapping of woody vegetation from remote sensing images
    Cheng, Youwei
    Lan, Shaocheng
    Fan, Xijian
    Tjahjadi, Tardi
    Jin, Shichao
    Cao, Lin
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 124