ID-insensitive deepfake detection model based on multi-attention mechanism

被引:0
|
作者
Sheng, Yuncan [4 ]
Zou, Zhengrui [1 ]
Yu, Zongxuan [1 ]
Pang, Mengxue [1 ]
Ou, Wei [1 ,2 ,3 ]
Han, Wenbao [1 ]
机构
[1] Hainan Univ, Sch Cyberspace Secur, Sch Cryptol, Haikou 570228, Peoples R China
[2] Lab Adv Comp & Intelligence Engn, Wuxi 214100, Peoples R China
[3] Jiangsu Variable Supercomp Technol Co Ltd, Wuxi 214100, Peoples R China
[4] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
来源
SCIENTIFIC REPORTS | 2025年 / 15卷 / 01期
基金
中国国家自然科学基金;
关键词
Deepfake detection; Multi-scale artifact detection; Attention map; Texture feature enhancement;
D O I
10.1038/s41598-025-96254-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deepfake technology has enabled the widespread distribution of manipulated facial content online, raising serious societal concerns. In recent years, deepfake detection has emerged as a critical research focus. However, existing methods frequently overlook the connection between local details and overall image features, while also failing to address the problem of implicit identity leakage. Consequently, their performance is suboptimal, particularly in cross-dataset evaluations. Specifically, the proposed multi-attention deepfake detection model consists of the following three parts: (1) Texture Feature Enhancement: We employ CondenseNet to enhance texture features efficiently, preserving subtle details and ensuring feature integrity; (2) Multi-Scale Artifact Detection: We introduce an artifact detection module that identifies potentially manipulated regions, enabling localized detection and minimizing the impact of identity information. (3) Multi-Attention Mechanism: By generating multiple attention maps, our model prioritizes different regions of the input image, fusing both texture and local features to improve classification performance. Our method is evaluated on the FaceForensics++ and DFDC benchmarks for facial manipulation detection. Additionally, we assess its cross-dataset performance on Celeb-DF-v2, achieving state-of-the-art results.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Personal-Bullying Detection Based on Multi-Attention and Cognitive Feature
    M. Niu
    L. Yu
    S. Tian
    X. Wang
    Q. Zhang
    Automatic Control and Computer Sciences, 2020, 54 : 52 - 61
  • [22] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Lv, Xiaodong
    Dai, Chuankai
    Liu, Haijie
    Tian, Ye
    Chen, Luyao
    Lang, Yiran
    Tang, Rongyu
    He, Jiping
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (19): : 13839 - 13849
  • [23] Polyp Segmentation Network Combined With Multi-Attention Mechanism
    Jia L.
    Hu Y.
    Jin Y.
    Xue Z.
    Jiang Z.
    Zheng Q.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (03): : 463 - 473
  • [24] Multi-attention mechanism based on gate recurrent unit for English text classification
    Liu, Haiying
    EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2022, 9 (04):
  • [25] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Xiaodong Lv
    Chuankai Dai
    Haijie Liu
    Ye Tian
    Luyao Chen
    Yiran Lang
    Rongyu Tang
    Jiping He
    Neural Computing and Applications, 2023, 35 : 13839 - 13849
  • [26] MU-GAN: Facial Attribute Editing Based on Multi-Attention Mechanism
    Zhang, Ke
    Su, Yukun
    Guo, Xiwang
    Qi, Liang
    Zhao, Zhenbing
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (09) : 1614 - 1626
  • [27] MU-GAN:Facial Attribute Editing Based on Multi-Attention Mechanism
    Ke Zhang
    Yukun Su
    Xiwang Guo
    Liang Qi
    Zhenbing Zhao
    IEEE/CAAJournalofAutomaticaSinica, 2021, 8 (09) : 1614 - 1626
  • [28] Texture-aware video inpainting algorithm based on the multi-attention mechanism
    Xia, Yilan
    Wang, Xiumei
    Cheng, Peitao
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2024, 51 (03): : 136 - 146
  • [29] A Deepfake Image Detection Method Based on a Multi-Graph Attention Network
    Chen, Guorong
    Du, Chongling
    Yu, Yuan
    Hu, Hong
    Duan, Hongjun
    Zhu, Huazheng
    ELECTRONICS, 2025, 14 (03):
  • [30] Multi-attention embedded network for salient object detection
    Wei He
    Chen Pan
    Wenlong Xu
    Ning Zhang
    Soft Computing, 2021, 25 : 13053 - 13067