Convergence of Deep Learning and Forensic Methodologies Using Self-attention Integrated EfficientNet Model for Deep Fake Detection

被引:0
|
作者
Rimjhim Padam Singh [1 ]
Nichenametla Hima Sree [1 ]
Koti Leela Sai Praneeth Reddy [1 ]
Kandukuri Jashwanth [1 ]
机构
[1] Amrita Vishwa Vidyapeetham,Department of Computer Science and Engineering, Amrita School of Computing
关键词
Celeb-DF dataset; EfficientNetB0; NasNetLarge; Xception Deepfake detection; Multimedia forensics; Self-attention mechanism;
D O I
10.1007/s42979-024-03455-3
中图分类号
学科分类号
摘要
The immensely increasing number of Deepfake technologies poses significant challenges to digital media integrity, leading to the immediate need for effective Deepfake detection methods. In light of the growing threat posed by sophisticated synthetic media, this paper tackles the urgent need for accurate deepfake detection in real-time by proposing a novel classification model employing a fine-tuned EfficientNet-B0 model with an optimally integrated Self-attention mechanism. The study also analyzes various Deepfake generation techniques by utilizing a suite of Convolutional Neural Networks namely, XceptionNet, NasNetLarge, InceptionV3, ConNextv1, ConvNext2 and EfficientB0 model on the Celeb-DF dataset for baseline model selection and performance comparison purposes. The results prove that the proposed fine-tuned EfficientNet-B0 model with integrated self-attention mechanism is the most superior at identifying complex long-range dependencies and relations in various unconnected image regions, highlighting the importance of attention mechanisms in improving deep learning models for multimedia forensics with a remarkable F-score of 97.67%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$97.67 \%$$\end{document}. In an era marked by the proliferation of sophisticated artificial intelligence (AI)-driven synthetic media, these findings establish the foundation for strengthening digital media platform security and protecting information authenticity.
引用
收藏
相关论文
共 50 条
  • [31] Arabic Fake News Detection Using Deep Learning
    Fouad, Khaled M.
    Sabbeh, Sahar F.
    Medhat, Walaa
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (02): : 3647 - 3665
  • [32] Detection of Online Fake Review Using Deep Learning
    Monisha, G. B.
    Nayak, Jyothi S.
    SMART TRENDS IN COMPUTING AND COMMUNICATIONS, VOL 4, SMARTCOM 2024, 2024, 948 : 161 - 172
  • [33] Arabic Fake News Detection Using Deep Learning
    Othman, Nermin Abdelhakim
    Elzanfaly, Doaa S.
    Elhawary, Mostafa Mahmoud M.
    IEEE ACCESS, 2024, 12 : 122363 - 122376
  • [34] Deep Transfer Learning With Self-Attention for Industry Sensor Fusion Tasks
    Zhang, Ze
    Farnsworth, Michael
    Song, Boyang
    Tiwari, Divya
    Tiwari, Ashutosh
    IEEE SENSORS JOURNAL, 2022, 22 (15) : 15235 - 15247
  • [35] Magnetotelluric Data Inversion Based on Deep Learning With the Self-Attention Mechanism
    Xu, Kaijun
    Liang, Shuyuan
    Lu, Yan
    Hu, Zuzhi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [36] Traffic Signal Control with Deep Reinforcement Learning and Self-attention Mechanism
    Zhang X.
    Nie S.
    Li Z.
    Zhang H.
    Jiaotong Yunshu Xitong Gongcheng Yu Xinxi/Journal of Transportation Systems Engineering and Information Technology, 2024, 24 (02): : 96 - 104
  • [37] Learning Contextual Features with Multi-head Self-attention for Fake News Detection
    Wang, Yangqian
    Han, Hao
    Ding, Ye
    Wang, Xuan
    Liao, Qing
    COGNITIVE COMPUTING - ICCC 2019, 2019, 11518 : 132 - 142
  • [38] A Multiscale Self-Attention Deep Clustering for Change Detection in SAR Images
    Dong, Huihui
    Ma, Wenping
    Jiao, Licheng
    Liu, Fang
    Li, LingLing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] Efficient Fake News Detection Mechanism Using Enhanced Deep Learning Model
    Ahmad, Tahir
    Faisal, Muhammad Shahzad
    Rizwan, Atif
    Alkanhel, Reem
    Khan, Prince Waqas
    Muthanna, Ammar
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [40] COVID-19 Fake News Detection using Deep Learning Model
    Akhter M.
    Hossain S.M.M.
    Nigar R.S.
    Paul S.
    Kamal K.M.A.
    Sen A.
    Sarker I.H.
    Annals of Data Science, 2024, 11 (6) : 2167 - 2198