Hybrid network of convolutional neural network and transformer for deepfake geographic image detection

被引:1
|
作者
Liu, Xiaoyong [1 ,2 ]
Dong, Xiaofei [1 ]
Xie, Feng [1 ]
Lu, Pei [1 ,2 ]
Lu, Xi [1 ,2 ]
Jiang, Mingzhong [1 ]
机构
[1] Guilin Univ Technol, Sch Informat Sci & Engn, Guilin, Peoples R China
[2] Guilin Univ Technol, Guangxi Key Lab Embedded Technol & Intelligent Sys, Guilin, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake geographic images; generative adversarial networks; convolutional neural networks; vision transformer;
D O I
10.1117/1.JEI.33.2.023007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, generative adversarial networks have been widely used to generate realistic fake images, and the current research mainly focuses on deepfake detection in face images. However, we are now facing the emergence of fake satellite images, which could potentially mislead and threaten national security. To address this issue, we propose a hybrid network of convolutional neural network and Transformer for deepfake geographic image detection. Specifically, our method combines the local modeling capability of convolutional neural networks with the global modeling capability of transformers. This allows us to effectively extract both local features and global representations from the satellite images. Additionally, we enhance the detection performance of the model by introducing channel attention mechanisms. Experimental results demonstrate that our proposed method outperforms existing approaches. Furthermore, under common image processing scenarios, such as Joint Photographic Experts Group compression and Gaussian noise corruption, our method also performs better than other comparison methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] RETRACTED ARTICLE: Deepfake detection using rationale-augmented convolutional neural network
    Saadaldeen Rashid Ahmed Ahmed
    Emrullah Sonuç
    [J]. Applied Nanoscience, 2023, 13 : 1485 - 1493
  • [32] Multisemantic Path Neural Network for Deepfake Detection
    Wu, Nan
    Jin, Xin
    Jiang, Qian
    Wang, Puming
    Zhang, Ya
    Yao, Shaowen
    Zhou, Wei
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2022, 2022
  • [33] HiGANCNN: A Hybrid Generative Adversarial Network and Convolutional Neural Network for Glaucoma Detection
    Alsulami, Fairouz
    Alseleahbi, Hind
    Alsaedi, Rawan
    Almaghdawi, Rasha
    Alafif, Tarik
    Ikram, Mohammad
    Zong, Weiwei
    Alzahrani, Yahya
    Bawazeer, Ahmed
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2022, 22 (09): : 23 - 30
  • [34] A Lightweight Hybrid Convolutional Neural Network for Hyperspectral Image Classification
    Ma, Xiaohu
    Kang, Xudong
    Qin, Huawei
    Wang, Wuli
    Ren, Guangbo
    Wang, Jianbu
    Liu, Baodi
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [35] HCNNet: A Hybrid Convolutional Neural Network for Spatiotemporal Image Fusion
    Zhu, Zhuangshan
    Tao, Yuxiang
    Luo, Xiaobo
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] Enhanced Adaptive Hybrid Convolutional Transformer Network for Malware Detection in IoT
    Almazroi, Abdulaleem Ali
    [J]. International Journal of Advanced Computer Science and Applications, 2024, 15 (11) : 1250 - 1263
  • [37] Deep Convolutional Pooling Transformer for Deepfake Detection
    Wang, Tianyi
    Cheng, Harry
    Chow, Kam Pui
    Nie, Liqiang
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [38] Cascaded Network Based on EfficientNet and Transformer for Deepfake Video Detection
    Deng, Liwei
    Wang, Jiandong
    Liu, Zhen
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (06) : 7057 - 7076
  • [39] Cascaded Network Based on EfficientNet and Transformer for Deepfake Video Detection
    Liwei Deng
    Jiandong Wang
    Zhen Liu
    [J]. Neural Processing Letters, 2023, 55 : 7057 - 7076
  • [40] Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network
    Arshed, Muhammad Asad
    Alwadain, Ayed
    Ali, Rao Faizan
    Mumtaz, Shahzad
    Ibrahim, Muhammad
    Muneer, Amgad
    [J]. MATHEMATICS, 2023, 11 (17)