ID-insensitive deepfake detection model based on multi-attention mechanism

被引:0
|
作者
Sheng, Yuncan [4 ]
Zou, Zhengrui [1 ]
Yu, Zongxuan [1 ]
Pang, Mengxue [1 ]
Ou, Wei [1 ,2 ,3 ]
Han, Wenbao [1 ]
机构
[1] Hainan Univ, Sch Cyberspace Secur, Sch Cryptol, Haikou 570228, Peoples R China
[2] Lab Adv Comp & Intelligence Engn, Wuxi 214100, Peoples R China
[3] Jiangsu Variable Supercomp Technol Co Ltd, Wuxi 214100, Peoples R China
[4] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
来源
SCIENTIFIC REPORTS | 2025年 / 15卷 / 01期
基金
中国国家自然科学基金;
关键词
Deepfake detection; Multi-scale artifact detection; Attention map; Texture feature enhancement;
D O I
10.1038/s41598-025-96254-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deepfake technology has enabled the widespread distribution of manipulated facial content online, raising serious societal concerns. In recent years, deepfake detection has emerged as a critical research focus. However, existing methods frequently overlook the connection between local details and overall image features, while also failing to address the problem of implicit identity leakage. Consequently, their performance is suboptimal, particularly in cross-dataset evaluations. Specifically, the proposed multi-attention deepfake detection model consists of the following three parts: (1) Texture Feature Enhancement: We employ CondenseNet to enhance texture features efficiently, preserving subtle details and ensuring feature integrity; (2) Multi-Scale Artifact Detection: We introduce an artifact detection module that identifies potentially manipulated regions, enabling localized detection and minimizing the impact of identity information. (3) Multi-Attention Mechanism: By generating multiple attention maps, our model prioritizes different regions of the input image, fusing both texture and local features to improve classification performance. Our method is evaluated on the FaceForensics++ and DFDC benchmarks for facial manipulation detection. Additionally, we assess its cross-dataset performance on Celeb-DF-v2, achieving state-of-the-art results.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Face frontalization with deep GAN via multi-attention mechanism
    Cao, Jiaqian
    Chen, Zhenxue
    Zhang, Yujiao
    Sun, Luna
    Chen, Jiyang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 1965 - 1973
  • [42] Rapid Vehicle Trajectory Prediction Based on Multi-Attention Mechanism for Fusing Multimodal Information
    Ge, Likun
    Wang, Shuting
    Wang, Guangqi
    ELECTRONICS, 2024, 13 (23):
  • [43] Person re-identification based on multi-scale feature fusion and multi-attention mechanism
    Pu, Jiacheng
    Zou, Wei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 243 - 253
  • [44] Face frontalization with deep GAN via multi-attention mechanism
    Jiaqian Cao
    Zhenxue Chen
    Yujiao Zhang
    Luna Sun
    Jiyang Chen
    Signal, Image and Video Processing, 2023, 17 : 1965 - 1973
  • [45] Secure Medical Image Retrieval Based on Multi-Attention Mechanism and Triplet Deep Hashing
    Zhang, Shaozheng
    Zhang, Qiuyu
    Tang, Jiahui
    Xu, Ruihua
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 2137 - 2158
  • [46] Multi-attention-based approach for deepfake face and expression swap detection and localization
    Saima Waseem
    Syed Abdul Rahman Syed Abu-Bakar
    Zaid Omar
    Bilal Ashfaq Ahmed
    Saba Baloch
    Adel Hafeezallah
    EURASIP Journal on Image and Video Processing, 2023
  • [47] Video Captioning using Hierarchical Multi-Attention Model
    Xiao, Huanhou
    Shi, Jinglun
    ICAIP 2018: 2018 THE 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN IMAGE PROCESSING, 2018, : 96 - 101
  • [48] MACRO: Multi-Attention Convolutional Recurrent Model for Subject-Independent ERP Detection
    Lan, Zhen
    Yan, Chao
    Li, Zixing
    Tang, Dengqing
    Xiang, Xiaojia
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1505 - 1509
  • [49] Hyperspectral Image Classification Based on Multi-attention Mechanism and Compiled Graph Neural Networks
    Jie S.
    Jing Y.
    Shujie D.
    Shaobo L.
    Jianjun H.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2024, 55 (03): : 183 - 192and212
  • [50] Text-Aware Recommendation Model Based on Multi-attention Neural Networks
    Qiu, Gang
    Yu, Xiaoli
    Jiang, Liping
    Ma, Baoying
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, 2021, 12815 : 590 - 603