Convergence of Deep Learning and Forensic Methodologies Using Self-attention Integrated EfficientNet Model for Deep Fake Detection

被引:0
|
作者
Rimjhim Padam Singh [1 ]
Nichenametla Hima Sree [1 ]
Koti Leela Sai Praneeth Reddy [1 ]
Kandukuri Jashwanth [1 ]
机构
[1] Amrita Vishwa Vidyapeetham,Department of Computer Science and Engineering, Amrita School of Computing
关键词
Celeb-DF dataset; EfficientNetB0; NasNetLarge; Xception Deepfake detection; Multimedia forensics; Self-attention mechanism;
D O I
10.1007/s42979-024-03455-3
中图分类号
学科分类号
摘要
The immensely increasing number of Deepfake technologies poses significant challenges to digital media integrity, leading to the immediate need for effective Deepfake detection methods. In light of the growing threat posed by sophisticated synthetic media, this paper tackles the urgent need for accurate deepfake detection in real-time by proposing a novel classification model employing a fine-tuned EfficientNet-B0 model with an optimally integrated Self-attention mechanism. The study also analyzes various Deepfake generation techniques by utilizing a suite of Convolutional Neural Networks namely, XceptionNet, NasNetLarge, InceptionV3, ConNextv1, ConvNext2 and EfficientB0 model on the Celeb-DF dataset for baseline model selection and performance comparison purposes. The results prove that the proposed fine-tuned EfficientNet-B0 model with integrated self-attention mechanism is the most superior at identifying complex long-range dependencies and relations in various unconnected image regions, highlighting the importance of attention mechanisms in improving deep learning models for multimedia forensics with a remarkable F-score of 97.67%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$97.67 \%$$\end{document}. In an era marked by the proliferation of sophisticated artificial intelligence (AI)-driven synthetic media, these findings establish the foundation for strengthening digital media platform security and protecting information authenticity.
引用
收藏
相关论文
共 50 条
  • [21] USING SELF ATTENTION DNNS TO DISCOVER PHONEMIC FEATURES FOR AUDIO DEEP FAKE DETECTION
    Dhamyal, Hira
    Ali, Ayesha
    Qazi, Ihsan Ayyub
    Raza, Agha Ali
    2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, : 1178 - 1184
  • [22] SAGSleepNet: A deep learning model for sleep staging based on self-attention graph of polysomnography
    Jin, Zheng
    Jia, Kebin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [23] A Cross-Project Defect Prediction Model Based on Deep Learning With Self-Attention
    Wen, Wanzhi
    Zhang, Ruinian
    Wang, Chuyue
    Shen, Chenqiang
    Yu, Meng
    Zhang, Suchuan
    Gao, Xinxin
    IEEE ACCESS, 2022, 10 : 110385 - 110401
  • [24] A deep learning sequence model based on self-attention and convolution for wind power prediction
    Liu, Chien-Liang
    Chang, Tzu-Yu
    Yang, Jie-Si
    Huang, Kai-Bin
    RENEWABLE ENERGY, 2023, 219
  • [25] Fake Detect: A Deep Learning Ensemble Model for Fake News Detection
    Aslam, Nida
    Ullah Khan, Irfan
    Alotaibi, Farah Salem
    Aldaej, Lama Abdulaziz
    Aldubaikil, Asma Khaled
    COMPLEXITY, 2021, 2021
  • [26] Merging deep learning model for fake news detection
    Amine, Belhakimi Mohamed
    Drif, Ahlem
    Giordano, Silvia
    2019 INTERNATIONAL CONFERENCE ON ADVANCED ELECTRICAL ENGINEERING (ICAEE), 2019,
  • [27] RETRACTION: A Deep Learning Approach for a Source Code Detection Model Using Self-Attention (Retraction of Vol 2020, art no 5027198, 2020)
    Meng, Y.
    Liu, I.
    COMPLEXITY, 2024, 2024
  • [28] A Self-Attention Mechanism-Based Model for Early Detection of Fake News
    Jamshidi, Bahman
    Hakak, Saqib
    Lu, Rongxing
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (04) : 5241 - 5252
  • [29] A self-attention based deep learning method for lesion attribute detection from CT reports
    Peng, Yifan
    Yan, Ke
    Sandfort, Veit
    Summers, Ronald M.
    Lu, Zhiyong
    2019 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2019, : 218 - 222
  • [30] ENHANCING NATURAL LANGUAGE PROCESSING USING WALRUS OPTIMIZER WITH SELF-ATTENTION DEEP LEARNING MODEL IN APPLIED LINGUISTICS
    Hassan, Abdulkhaleq Q. A.
    Alshammari, Alya
    Zaqaibeh, Belal
    Alzaidi, Muhammad Swaileh a.
    Allafi, Randa
    Alazwari, Sana
    Aljabri, Jawhara
    Nouri, Amal M.
    FRACTALS-COMPLEX GEOMETRY PATTERNS AND SCALING IN NATURE AND SOCIETY, 2024,