Dual-Branch Sparse Self-Learning With Instance Binding Augmentation for Adversarial Detection in Remote Sensing Images

被引:0
|
作者
Zhang, Zhentong [1 ,2 ,4 ]
Li, Xinde [2 ,3 ]
Li, Heqing [1 ]
Dunkin, Fir [3 ]
Li, Bing [3 ]
Li, Zhijun [5 ,6 ]
机构
[1] Southeast Univ, Sch Cyber Sci Engn, Nanjing 210096, Peoples R China
[2] Nanjing Ctr Appl Math, Nanjing 211135, Peoples R China
[3] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[4] Southeast Univ, Shenzhen Res Inst, Nanjing 518063, Peoples R China
[5] Tongji Univ, Translat Res Ctr, Sch Mech Engn, Shanghai 200070, Peoples R China
[6] Tongji Univ, Shanghai Yangzhi Rehabil Hosp, Shanghai 200070, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Detectors; Glass box; Convolutional codes; Contrastive learning; Mobile handsets; Adversarial examples (AEs); AE detection; instance binding augmentation; self-supervised; sparse depthwise separable convolution; ATTACKS;
D O I
10.1109/TGRS.2024.3436841
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing image analysis technology based on neural networks has significantly facilitated human life. However, adversarial attacks can drastically impair the performance of these models, posing substantial economic and security risks. Current adversarial example (AE) detectors primarily focus on studying attacked natural images, while AEs in the remote sensing domain have not received adequate attention. To address this challenge, we propose a novel dual-branch sparse self-learning framework, leveraging instance binding augmentation. The contrastive branch concurrently enhances intra-instance and inter-example feature discrimination, while the masked branch reconstructs perturbation distributions. Furthermore, our method utilizes sparse encoding within depthwise separable convolutions to efficiently transfer parameters, thereby ensuring compatibility with deployment on mobile devices. Extensive experiments demonstrate that our method achieves state-of-the-art performance in detecting both white-box and black-box attacks on remote sensing images. Specifically, our method achieves an average detection accuracy of 95.69%/95.18%, a recall of 91.8%/93.6%, and an F1-score of 93.48%/94.22% on two attacked models across various attack scenarios, outperforming existing methods.
引用
收藏
页数:13
相关论文
共 48 条
  • [41] Weakly supervised object detection from remote sensing images via self-attention distillation and instance-aware mining
    Yang, Peng
    Zhou, Shi
    Wang, Linlin
    Yang, Guowei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (13) : 39073 - 39095
  • [42] Weakly supervised object detection from remote sensing images via self-attention distillation and instance-aware mining
    Peng Yang
    Shi Zhou
    Linlin Wang
    Guowei Yang
    [J]. Multimedia Tools and Applications, 2024, 83 : 39073 - 39095
  • [43] Automatic Garbage Scattered Area Detection with Data Augmentation and Transfer Learning in SUAV Low-Altitude Remote Sensing Images
    You, Tengfei
    Chen, Weiyang
    Wang, Haifeng
    Yang, Yang
    Liu, Xinang
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [44] Automatic segmentation algorithm for high-spatial-resolution remote sensing images based on self-learning super-pixel convolutional network
    Yang, Zenan
    Niu, Haipeng
    Huang, Liang
    Wang, Xiaoxuan
    Fan, Liangxin
    Xiao, Dongyang
    [J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2022, 15 (01) : 1101 - 1124
  • [45] HMLNet: a hierarchical metric learning network with dual attention for change detection in high-resolution remote sensing images
    Liang, Yi
    Zhang, Chengkun
    Liu, Jianwei
    Han, Min
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (03) : 1001 - 1021
  • [46] Self-Supervised Learning for High-Resolution Remote Sensing Images Change Detection With Variational Information Bottleneck
    Wang, Congcong
    Du, Shouhang
    Sun, Wenbin
    Fan, Deqin
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5849 - 5866
  • [47] Dual Learning-Based Siamese Framework for Change Detection Using Bi-Temporal VHR Optical Remote Sensing Images
    Fang, Bo
    Pan, Li
    Kou, Rong
    [J]. REMOTE SENSING, 2019, 11 (11)
  • [48] SS R-CNN: Self-Supervised Learning Improving Mask R-CNN for Ship Detection in Remote Sensing Images
    Jian, Ling
    Pu, Zhiqi
    Zhu, Lili
    Yao, Tiancan
    Liang, Xijun
    [J]. REMOTE SENSING, 2022, 14 (17)