Hybrid network of convolutional neural network and transformer for deepfake geographic image detection

被引:1
|
作者
Liu, Xiaoyong [1 ,2 ]
Dong, Xiaofei [1 ]
Xie, Feng [1 ]
Lu, Pei [1 ,2 ]
Lu, Xi [1 ,2 ]
Jiang, Mingzhong [1 ]
机构
[1] Guilin Univ Technol, Sch Informat Sci & Engn, Guilin, Peoples R China
[2] Guilin Univ Technol, Guangxi Key Lab Embedded Technol & Intelligent Sys, Guilin, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake geographic images; generative adversarial networks; convolutional neural networks; vision transformer;
D O I
10.1117/1.JEI.33.2.023007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, generative adversarial networks have been widely used to generate realistic fake images, and the current research mainly focuses on deepfake detection in face images. However, we are now facing the emergence of fake satellite images, which could potentially mislead and threaten national security. To address this issue, we propose a hybrid network of convolutional neural network and Transformer for deepfake geographic image detection. Specifically, our method combines the local modeling capability of convolutional neural networks with the global modeling capability of transformers. This allows us to effectively extract both local features and global representations from the satellite images. Additionally, we enhance the detection performance of the model by introducing channel attention mechanisms. Experimental results demonstrate that our proposed method outperforms existing approaches. Furthermore, under common image processing scenarios, such as Joint Photographic Experts Group compression and Gaussian noise corruption, our method also performs better than other comparison methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Hybrid Transformer Network for Deepfake Detection
    Khan, Sohail Ahmed
    Dang-Nguyen, Duc-Tien
    [J]. 19TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2022, 2022, : 8 - 14
  • [2] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao, Zhan
    Wang, Ruizi
    Zhang, Xiangyi
    Fu, Bo
    Thanh, Dang Ngoc Hoang
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [3] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao, Zhan
    Wang, Ruizi
    Zhang, Xiangyi
    Fu, Bo
    Thanh, Dang Ngoc Hoang
    [J]. PeerJ Computer Science, 2023, 9
  • [4] Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network
    Shad, Hasin Shahed
    Rizvee, Md. Mashfiq
    Roza, Nishat Tasnim
    Hoq, S. M. Ahsanul
    Khan, Mohammad Monirujjaman
    Singh, Arjun
    Zaguia, Atef
    Bourouis, Sami
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021
  • [5] DeepFake Face Image Detection based on Improved VGG Convolutional Neural Network
    Chang, Xu
    Wu, Jian
    Yang, Tongfeng
    Feng, Guorui
    [J]. PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7252 - 7256
  • [6] A Network Combining a Transformer and a Convolutional Neural Network for Remote Sensing Image Change Detection
    Wang, Guanghui
    Li, Bin
    Zhang, Tao
    Zhang, Shubi
    [J]. REMOTE SENSING, 2022, 14 (09)
  • [7] A new deep spatial transformer convolutional neural network for image saliency detection
    Zhang, Xinsheng
    Gao, Teng
    Gao, Dongdong
    [J]. DESIGN AUTOMATION FOR EMBEDDED SYSTEMS, 2018, 22 (03) : 243 - 256
  • [8] A new deep spatial transformer convolutional neural network for image saliency detection
    Xinsheng Zhang
    Teng Gao
    Dongdong Gao
    [J]. Design Automation for Embedded Systems, 2018, 22 : 243 - 256
  • [9] TCURL: Exploring hybrid transformer and convolutional neural network on phishing URL detection
    Wang, Chenguang
    Chen, Yuanyuan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [10] Deepfake detection using rationale-augmented convolutional neural network
    Ahmed, Saadaldeen Rashid Ahmed
    Sonuc, Emrullah
    [J]. APPLIED NANOSCIENCE, 2021, 13 (2) : 1485 - 1493