CSTAN: A Deepfake Detection Network with CST Attention for Superior Generalization

被引:0
|
作者
Yang, Rui [1 ,2 ]
You, Kang [2 ]
Pang, Cheng [1 ]
Luo, Xiaonan [1 ,2 ]
Lan, Rushi [1 ,3 ]
机构
[1] Guilin Univ Elect Technol, Guangxi Key Lab Image & G Intelligent Proc, Guilin 541004, Peoples R China
[2] Guilin Univ Elect Technol, Sch Comp Sci & Informat Secur, Guilin 541004, Peoples R China
[3] Guilin Univ Elect Technol, Int Joint Res Lab Spatio Temporal Informat Intelli, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake detection; attention mechanism; detection model; feature extraction;
D O I
10.3390/s24227101
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the advancement of deepfake forgery technology, highly realistic fake faces have posed serious security risks to sensor-based facial recognition systems. Recent deepfake detection models mainly use binary classification models based on deep learning. Despite achieving high detection accuracy on intra-datasets, these models lack generalization ability when applied to cross-datasets. We propose a deepfake detection model named Channel-Spatial-Triplet Attention Network (CSTAN), which focuses on the difference between real and fake features, thereby enhancing the generality of the detection model. To enhance the feature-learning ability of the model for image forgery regions, we have designed the Channel-Spatial-Triplet (CST) attention mechanism, which extracts subtle local information by capturing feature channels and the spatial correlation of three different scales. Additionally, we propose a novel feature extraction method, OD-ResNet-34, by embedding ODConv into the feature extraction network to enhance its dynamic adaptability to data features. Trained on the FF++ dataset and tested on the Celeb-DF-v1 and Celeb-DF-v2 datasets, the experimental results show that our model has stronger generalization ability in cross-datasets than similar models.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    PROCEEDINGS OF THE 2022 ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, IH-MMSEC 2022, 2022, : 1 - 1
  • [2] Towards Generalization in Deepfake Detection
    Verdoliva, Luisa
    1ST ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2022, 2022, : 1 - 1
  • [3] Generalization of Forgery Detection With Meta Deepfake Detection Model
    Tran, Van-Nhan
    Kwon, Seong-Geun
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kwon, Ki-Ryong
    IEEE ACCESS, 2023, 11 : 535 - 546
  • [4] Improving Generalization of Deepfake Detection by Training for Attribution
    Jain, Anubhav
    Korshunov, Pavel
    Marcel, Sebastien
    IEEE MMSP 2021: 2021 IEEE 23RD INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2021,
  • [5] CDNET: CLUSTER DECISION FOR DEEPFAKE DETECTION GENERALIZATION
    Hou, Zeming
    Hua, Zhongyun
    Zhang, Kuiyuan
    Zhang, Yushu
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3010 - 3014
  • [6] Demystifying Attention Mechanisms for Deepfake Detection
    Das, Abhijit
    Das, Srijan
    Dantcheva, Antitza
    2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021), 2021,
  • [7] Global and Temporal-Frequency Attention Based Network in Audio Deepfake Detection
    Wang C.
    Yi J.
    Tao J.
    Ma H.
    Tian Z.
    Fu R.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (07): : 1466 - 1475
  • [8] A Deepfake Image Detection Method Based on a Multi-Graph Attention Network
    Chen, Guorong
    Du, Chongling
    Yu, Yuan
    Hu, Hong
    Duan, Hongjun
    Zhu, Huazheng
    ELECTRONICS, 2025, 14 (03):
  • [9] On the Generalization of Deep Learning Models in Video Deepfake Detection
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    JOURNAL OF IMAGING, 2023, 9 (05)
  • [10] Improving Deepfake Detection Generalization by Invariant Risk Minimization
    Yin, Zixin
    Wang, Jiakai
    Xiao, Yisong
    Zhao, Hanqing
    Li, Tianlin
    Zhou, Wenbo
    Liu, Aishan
    Liu, Xianglong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6785 - 6798