Hybrid network of convolutional neural network and transformer for deepfake geographic image detection

被引:1
|
作者
Liu, Xiaoyong [1 ,2 ]
Dong, Xiaofei [1 ]
Xie, Feng [1 ]
Lu, Pei [1 ,2 ]
Lu, Xi [1 ,2 ]
Jiang, Mingzhong [1 ]
机构
[1] Guilin Univ Technol, Sch Informat Sci & Engn, Guilin, Peoples R China
[2] Guilin Univ Technol, Guangxi Key Lab Embedded Technol & Intelligent Sys, Guilin, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake geographic images; generative adversarial networks; convolutional neural networks; vision transformer;
D O I
10.1117/1.JEI.33.2.023007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, generative adversarial networks have been widely used to generate realistic fake images, and the current research mainly focuses on deepfake detection in face images. However, we are now facing the emergence of fake satellite images, which could potentially mislead and threaten national security. To address this issue, we propose a hybrid network of convolutional neural network and Transformer for deepfake geographic image detection. Specifically, our method combines the local modeling capability of convolutional neural networks with the global modeling capability of transformers. This allows us to effectively extract both local features and global representations from the satellite images. Additionally, we enhance the detection performance of the model by introducing channel attention mechanisms. Experimental results demonstrate that our proposed method outperforms existing approaches. Furthermore, under common image processing scenarios, such as Joint Photographic Experts Group compression and Gaussian noise corruption, our method also performs better than other comparison methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] DEEPFAKE VIDEO DETECTION USING 3D-ATTENTIONAL INCEPTION CONVOLUTIONAL NEURAL NETWORK
    Lu, Changlei
    Liu, Bin
    Zhou, Wenbo
    Chu, Qi
    Yu, Nenghai
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3572 - 3576
  • [42] Convolutional Transformer Network for Hyperspectral Image Classification
    Zhao, Zhengang
    Hu, Dan
    Wang, Hao
    Yu, Xianchuan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [43] Pure large kernel convolutional neural network transformer for medical image registration
    Fang, Zhao
    Cao, Wenming
    [J]. INTELLIGENT DATA ANALYSIS, 2024, 28 (03) : 769 - 790
  • [44] Analysis of image forgery detection using convolutional neural network
    Gnaneshwar C.
    Singh M.K.
    Yadav S.S.
    Balabantaray B.K.
    [J]. International Journal of Applied Systemic Studies, 2022, 9 (03) : 240 - 260
  • [45] Automatic Segmentation Algorithm of Dermoscopy Image Based on Transformer and Convolutional Neural Network
    Wei C.
    Xu Y.
    Jiang X.
    Wei Y.
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (12): : 1877 - 1886
  • [46] Learn a Deep Convolutional Neural Network for Image Smoke Detection
    Liu, Maoshen
    Gu, Ke
    Wu, Li
    Xu, Xin
    Qiao, Junfei
    [J]. DIGITAL TV AND MULTIMEDIA COMMUNICATION, 2019, 1009 : 217 - 226
  • [47] Image Spam Detection on Instagram Using Convolutional Neural Network
    Fatichah, Chastine
    Lazuardi, Wildan F.
    Navastara, Dini A.
    Suciati, Nanik
    Munif, Abdul
    [J]. INTELLIGENT AND INTERACTIVE COMPUTING, 2019, 67 : 295 - 303
  • [48] Trademark Image Similarity Detection Using Convolutional Neural Network
    Alshowaish, Hayfa
    Al-Ohali, Yousef
    Al-Nafjan, Abeer
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [49] A LIGHTWEIGHT CONVOLUTIONAL NEURAL NETWORK FOR BITEMPORAL IMAGE CHANGE DETECTION
    Wang, Rongfang
    Ding, Fan
    Chen, Jia-Wei
    Jiao, Licheng
    Wang, Liang
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2551 - 2554
  • [50] Face image manipulation detection based on a convolutional neural network
    Dang, L. Minh
    Hassan, Syed Ibrahim
    Im, Suhyeon
    Moon, Hyeonjoon
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 129 : 156 - 168