ID-insensitive deepfake detection model based on multi-attention mechanism

被引:0
|
作者
Sheng, Yuncan [4 ]
Zou, Zhengrui [1 ]
Yu, Zongxuan [1 ]
Pang, Mengxue [1 ]
Ou, Wei [1 ,2 ,3 ]
Han, Wenbao [1 ]
机构
[1] Hainan Univ, Sch Cyberspace Secur, Sch Cryptol, Haikou 570228, Peoples R China
[2] Lab Adv Comp & Intelligence Engn, Wuxi 214100, Peoples R China
[3] Jiangsu Variable Supercomp Technol Co Ltd, Wuxi 214100, Peoples R China
[4] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
来源
SCIENTIFIC REPORTS | 2025年 / 15卷 / 01期
基金
中国国家自然科学基金;
关键词
Deepfake detection; Multi-scale artifact detection; Attention map; Texture feature enhancement;
D O I
10.1038/s41598-025-96254-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deepfake technology has enabled the widespread distribution of manipulated facial content online, raising serious societal concerns. In recent years, deepfake detection has emerged as a critical research focus. However, existing methods frequently overlook the connection between local details and overall image features, while also failing to address the problem of implicit identity leakage. Consequently, their performance is suboptimal, particularly in cross-dataset evaluations. Specifically, the proposed multi-attention deepfake detection model consists of the following three parts: (1) Texture Feature Enhancement: We employ CondenseNet to enhance texture features efficiently, preserving subtle details and ensuring feature integrity; (2) Multi-Scale Artifact Detection: We introduce an artifact detection module that identifies potentially manipulated regions, enabling localized detection and minimizing the impact of identity information. (3) Multi-Attention Mechanism: By generating multiple attention maps, our model prioritizes different regions of the input image, fusing both texture and local features to improve classification performance. Our method is evaluated on the FaceForensics++ and DFDC benchmarks for facial manipulation detection. Additionally, we assess its cross-dataset performance on Celeb-DF-v2, achieving state-of-the-art results.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] DEEPFAKE SATELLITE IMAGERY DETECTION WITH MULTI-ATTENTION AND SUPER RESOLUTION
    Ciftci, Umur Aybars
    Demir, Ilke
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 4871 - 4874
  • [2] 3D Object Detection with LiDAR Based on Multi-Attention Mechanism
    Cao, Jie
    Peng, Yiqiang
    Fan, Likang
    Mo, Lingfan
    Wang, Longfei
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [3] Fast Ship Detection in Remote Sensing Images Based on Multi-Attention Mechanism
    Huang, Jian
    Chen, Zhuo
    Xu, Hao
    Zhang, Xiushan
    5TH INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS, ICACS 2021, 2021, : 105 - 112
  • [4] Stereo Matching Algorithm Based on Multi-Attention Mechanism
    Chen Qibo
    Ge Baozhen
    Li Yunpeng
    Quan Jianing
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)
  • [5] Multi-Attention Object Detection Model in Remote Sensing Images Based on Multi-Scale
    Ying, Xiang
    Wang, Qiang
    Li, Xuewei
    Yu, Mei
    Jiang, Han
    Gao, Jie
    Liu, Zhiqiang
    Yu, Ruiguo
    IEEE ACCESS, 2019, 7 : 94508 - 94519
  • [6] Factual Consistency Assessment Evaluation Model for Text Summarization Based on Multi-Attention Mechanism
    Wei, Chuyuan
    Zhang, Xinxian
    Wang, Zhiyuan
    Li, Jinzhe
    Liu, Jie
    Computer Engineering and Applications, 2023, 59 (07) : 163 - 170
  • [7] Domain adaptation based on feature fusion and multi-attention mechanism*
    Wang, Tiansheng
    Liu, Zhonghua
    Ou, Weihua
    Huo, Hua
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 108
  • [8] Short Text Classification Model Based on Multi-Attention
    Liu, Yunxiang
    Xu, Qi
    2020 13TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2020), 2020, : 225 - 229
  • [9] A Multi-Attention Fusion Mechanism for Collaborative Industrial Surface Defect Detection
    Yue, Xiaoli
    Zhong, Guoqiang
    Chu, Boce
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [10] FACIAL EXPRESSION RECOGNITION ALGORITHM BASED ON MULTI-ATTENTION MECHANISM
    Wu, Huixin
    Huang, Zehuan
    Jiang, Wei
    Zhao, Xin
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2023, 19 (04): : 1239 - 1250