CSTAN: A Deepfake Detection Network with CST Attention for Superior Generalization

被引:0
|
作者
Yang, Rui [1 ,2 ]
You, Kang [2 ]
Pang, Cheng [1 ]
Luo, Xiaonan [1 ,2 ]
Lan, Rushi [1 ,3 ]
机构
[1] Guilin Univ Elect Technol, Guangxi Key Lab Image & G Intelligent Proc, Guilin 541004, Peoples R China
[2] Guilin Univ Elect Technol, Sch Comp Sci & Informat Secur, Guilin 541004, Peoples R China
[3] Guilin Univ Elect Technol, Int Joint Res Lab Spatio Temporal Informat Intelli, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
deepfake detection; attention mechanism; detection model; feature extraction;
D O I
10.3390/s24227101
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
With the advancement of deepfake forgery technology, highly realistic fake faces have posed serious security risks to sensor-based facial recognition systems. Recent deepfake detection models mainly use binary classification models based on deep learning. Despite achieving high detection accuracy on intra-datasets, these models lack generalization ability when applied to cross-datasets. We propose a deepfake detection model named Channel-Spatial-Triplet Attention Network (CSTAN), which focuses on the difference between real and fake features, thereby enhancing the generality of the detection model. To enhance the feature-learning ability of the model for image forgery regions, we have designed the Channel-Spatial-Triplet (CST) attention mechanism, which extracts subtle local information by capturing feature channels and the spatial correlation of three different scales. Additionally, we propose a novel feature extraction method, OD-ResNet-34, by embedding ODConv into the feature extraction network to enhance its dynamic adaptability to data features. Trained on the FF++ dataset and tested on the Celeb-DF-v1 and Celeb-DF-v2 datasets, the experimental results show that our model has stronger generalization ability in cross-datasets than similar models.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Attention-Guided Supervised Contrastive Learning for Deepfake Detection
    Waseem, Saima
    Abu Bakar, Syed Abdul Rahman Bin Syed
    Ahmed, Bilal Ashfaq
    2024 IEEE 8TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS, ICSIPA, 2024,
  • [32] Visual attention-based deepfake video forgery detection
    Shreyan Ganguly
    Sk Mohiuddin
    Samir Malakar
    Erik Cuevas
    Ram Sarkar
    Pattern Analysis and Applications, 2022, 25 : 981 - 992
  • [33] Visual attention-based deepfake video forgery detection
    Ganguly, Shreyan
    Mohiuddin, Sk
    Malakar, Samir
    Cuevas, Erik
    Sarkar, Ram
    PATTERN ANALYSIS AND APPLICATIONS, 2022, 25 (04) : 981 - 992
  • [34] Improving Generalization of Deepfake Detection With Data Farming and Few-Shot Learning
    Korshunov, Pavel
    Marcel, Sebastien
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2022, 4 (03): : 386 - 397
  • [35] Comprehensive Evaluation of Deepfake Detection Models: Accuracy, Generalization, and Resilience to Adversarial Attacks
    Abbasi, Maryam
    Vaz, Paulo
    Silva, Jose
    Martins, Pedro
    APPLIED SCIENCES-BASEL, 2025, 15 (03):
  • [36] Using Graph Neural Networks to Improve Generalization Capability of the Models for Deepfake Detection
    She, Huimin
    Hu, Yongjian
    Liu, Beibei
    Li, Jicheng
    Li, Chang-Tsun
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 8414 - 8427
  • [37] Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network
    Yishan Su
    Huawei Xia
    Qi Liang
    Weizhi Nie
    Neural Processing Letters, 2021, 53 : 4159 - 4175
  • [38] Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network
    Su, Yishan
    Xia, Huawei
    Liang, Qi
    Nie, Weizhi
    NEURAL PROCESSING LETTERS, 2021, 53 (06) : 4159 - 4175
  • [39] LiSiam: Localization Invariance Siamese Network for Deepfake Detection
    Wang, Jian
    Sun, Yunlian
    Tang, Jinhui
    IEEE Transactions on Information Forensics and Security, 2022, 17 : 2425 - 2436
  • [40] LiSiam: Localization Invariance Siamese Network for Deepfake Detection
    Wang, Jian
    Sun, Yunlian
    Tang, Jinhui
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 2425 - 2436