Convergence of Deep Learning and Forensic Methodologies Using Self-attention Integrated EfficientNet Model for Deep Fake Detection

被引:0
|
作者
Rimjhim Padam Singh [1 ]
Nichenametla Hima Sree [1 ]
Koti Leela Sai Praneeth Reddy [1 ]
Kandukuri Jashwanth [1 ]
机构
[1] Amrita Vishwa Vidyapeetham,Department of Computer Science and Engineering, Amrita School of Computing
关键词
Celeb-DF dataset; EfficientNetB0; NasNetLarge; Xception Deepfake detection; Multimedia forensics; Self-attention mechanism;
D O I
10.1007/s42979-024-03455-3
中图分类号
学科分类号
摘要
The immensely increasing number of Deepfake technologies poses significant challenges to digital media integrity, leading to the immediate need for effective Deepfake detection methods. In light of the growing threat posed by sophisticated synthetic media, this paper tackles the urgent need for accurate deepfake detection in real-time by proposing a novel classification model employing a fine-tuned EfficientNet-B0 model with an optimally integrated Self-attention mechanism. The study also analyzes various Deepfake generation techniques by utilizing a suite of Convolutional Neural Networks namely, XceptionNet, NasNetLarge, InceptionV3, ConNextv1, ConvNext2 and EfficientB0 model on the Celeb-DF dataset for baseline model selection and performance comparison purposes. The results prove that the proposed fine-tuned EfficientNet-B0 model with integrated self-attention mechanism is the most superior at identifying complex long-range dependencies and relations in various unconnected image regions, highlighting the importance of attention mechanisms in improving deep learning models for multimedia forensics with a remarkable F-score of 97.67%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$97.67 \%$$\end{document}. In an era marked by the proliferation of sophisticated artificial intelligence (AI)-driven synthetic media, these findings establish the foundation for strengthening digital media platform security and protecting information authenticity.
引用
收藏
相关论文
共 50 条
  • [1] RETRACTED: A Deep Learning Approach for a Source Code Detection Model Using Self-Attention (Retracted Article)
    Meng, Yao
    Liu, Long
    COMPLEXITY, 2020, 2020
  • [2] Enhanced Colorectal Cancer Detection and Localization using Self-Attention Mechanisms in Deep Learning
    Gurumoorthi, T.
    Logesh, P.
    Ismail, N. Mohamed
    Malathi, K.
    2ND INTERNATIONAL CONFERENCE ON SUSTAINABLE COMPUTING AND SMART SYSTEMS, ICSCSS 2024, 2024, : 1589 - 1594
  • [3] Compressed Self-Attention for Deep Metric Learning
    Chen, Ziye
    Gong, Mingming
    Xu, Yanwu
    Wang, Chaohui
    Zhang, Kun
    Du, Bo
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 3561 - 3568
  • [4] Homogeneous Learning: Self-Attention Decentralized Deep Learning
    Sun, Yuwei
    Ochiai, Hideya
    IEEE ACCESS, 2022, 10 : 7695 - 7703
  • [5] Mineral Prospectivity Mapping Using Deep Self-Attention Model
    Bojun Yin
    Renguang Zuo
    Siquan Sun
    Natural Resources Research, 2023, 32 : 37 - 56
  • [6] Mineral Prospectivity Mapping Using Deep Self-Attention Model
    Yin, Bojun
    Zuo, Renguang
    Sun, Siquan
    NATURAL RESOURCES RESEARCH, 2023, 32 (01) : 37 - 56
  • [7] COVAD: Content-Oriented Video Anomaly Detection using a Self-Attention based Deep Learning Model
    Shao W.
    Rajapaksha P.
    Wei Y.
    Li D.
    Crespi N.
    Luo Z.
    Virtual Reality and Intelligent Hardware, 2023, 5 (01): : 24 - 41
  • [8] Fake news detection and classification using hybrid BiLSTM and self-attention model
    Mohapatra, Asutosh
    Thota, Nithin
    Prakasam, P.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (13) : 18503 - 18519
  • [9] Fake news detection and classification using hybrid BiLSTM and self-attention model
    Asutosh Mohapatra
    Nithin Thota
    P. Prakasam
    Multimedia Tools and Applications, 2022, 81 : 18503 - 18519
  • [10] Deep learning model for deep fake face recognition and detection
    Suganthi, S. T.
    Ayoobkhan, Mohamed Uvaze Ahamed
    Kumar, Krishna, V
    Bacanin, Nebojsa
    Venkatachalam, K.
    Stepan, Hubalovsky
    Pavel, Trojovsky
    PEERJ COMPUTER SCIENCE, 2022, 8