Convergence of Deep Learning and Forensic Methodologies Using Self-attention Integrated EfficientNet Model for Deep Fake Detection

被引:0
|
作者
Rimjhim Padam Singh [1 ]
Nichenametla Hima Sree [1 ]
Koti Leela Sai Praneeth Reddy [1 ]
Kandukuri Jashwanth [1 ]
机构
[1] Amrita Vishwa Vidyapeetham,Department of Computer Science and Engineering, Amrita School of Computing
关键词
Celeb-DF dataset; EfficientNetB0; NasNetLarge; Xception Deepfake detection; Multimedia forensics; Self-attention mechanism;
D O I
10.1007/s42979-024-03455-3
中图分类号
学科分类号
摘要
The immensely increasing number of Deepfake technologies poses significant challenges to digital media integrity, leading to the immediate need for effective Deepfake detection methods. In light of the growing threat posed by sophisticated synthetic media, this paper tackles the urgent need for accurate deepfake detection in real-time by proposing a novel classification model employing a fine-tuned EfficientNet-B0 model with an optimally integrated Self-attention mechanism. The study also analyzes various Deepfake generation techniques by utilizing a suite of Convolutional Neural Networks namely, XceptionNet, NasNetLarge, InceptionV3, ConNextv1, ConvNext2 and EfficientB0 model on the Celeb-DF dataset for baseline model selection and performance comparison purposes. The results prove that the proposed fine-tuned EfficientNet-B0 model with integrated self-attention mechanism is the most superior at identifying complex long-range dependencies and relations in various unconnected image regions, highlighting the importance of attention mechanisms in improving deep learning models for multimedia forensics with a remarkable F-score of 97.67%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$97.67 \%$$\end{document}. In an era marked by the proliferation of sophisticated artificial intelligence (AI)-driven synthetic media, these findings establish the foundation for strengthening digital media platform security and protecting information authenticity.
引用
收藏
相关论文
共 50 条
  • [41] SAR Image Reconstruction Method for Target Detection Using Self-Attention CNN-Based Deep Prior Learning
    Li, Min
    Huo, Weibo
    Wu, Junjie
    Yang, Jianyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [42] High-Fidelity Permeability and Porosity Prediction Using Deep Learning With the Self-Attention Mechanism
    Yang, Liuqing
    Wang, Shoudong
    Chen, Xiaohong
    Chen, Wei
    Saad, Omar M.
    Zhou, Xu
    Nam Pham
    Geng, Zhicheng
    Fomel, Sergey
    Chen, Yangkang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3429 - 3443
  • [43] Plant leaf disease classification using EfficientNet deep learning model
    Atila, Umit
    Ucar, Murat
    Akyol, Kemal
    Ucar, Emine
    ECOLOGICAL INFORMATICS, 2021, 61
  • [44] Deep Learning Model for House Price Prediction Using Heterogeneous Data Analysis Along With Joint Self-Attention Mechanism
    Wang, Pei-Ying
    Chen, Chiao-Ting
    Su, Jain-Wun
    Wang, Ting-Yun
    Huang, Szu-Hao
    IEEE ACCESS, 2021, 9 : 55244 - 55259
  • [45] SatCoBiLSTM: Self-attention based hybrid deep learning framework for crisis event detection in social media
    Upadhyay, Abhishek
    Meena, Yogesh Kumar
    Chauhan, Ganpat Singh
    Expert Systems with Applications, 2024, 249
  • [46] SatCoBiLSTM: Self-attention based hybrid deep learning framework for crisis event detection in social media
    Upadhyay, Abhishek
    Meena, Yogesh Kumar
    Chauhan, Ganpat Singh
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [47] Towards better representation learning using hybrid deep learning model for fake news detection
    Nabeela Kausar
    Asghar AliKhan
    Mohsin Sattar
    Social Network Analysis and Mining, 2022, 12
  • [48] Towards better representation learning using hybrid deep learning model for fake news detection
    Kausar, Nabeela
    AliKhan, Asghar
    Sattar, Mohsin
    SOCIAL NETWORK ANALYSIS AND MINING, 2022, 12 (01)
  • [49] SCVD-SA: A Smart Contract Vulnerability Detection Method based on Hybrid Deep Learning Model and Self-attention Mechanism
    Wang, Dongjie
    Chen, Jinfu
    Cai, Saihua
    Feng, Qiaowei
    Chen, Yuhao
    Hu, Xinyi
    2024 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING-COMPANION, SANER-C 2024, 2024, : 207 - 214
  • [50] Fake News Detection Using Machine Learning and Deep Learning Methods
    Saeed, Ammar
    Al Solami, Eesa
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (02): : 2079 - 2096