A novel approach for detecting deep fake videos using graph neural network

被引:0
|
作者
M. M. El-Gayar
Mohamed Abouhawwash
S. S. Askar
Sara Sweidan
机构
[1] Mansoura University,Department of Information Technology, Faculty of Computers and Information
[2] Michigan State University,Department of Computational Mathematics, Science and Engineering (CMSE), College of Engineering
[3] Mansoura University,Department of Mathematics, Faculty of Science
[4] King Saud University,Department of Statistics and Operations Research, College of Science
[5] Benha University,Artificial Intelligence Department, Faculty of Computer and Artificial Intelligence
[6] New Mansoura University,Faculty of Computer Science and Engineering
来源
关键词
Graph neural network; Convolutional neural network; Deepfake video detection; Multi-task cascaded convolutional neural network; Mini-GNN;
D O I
暂无
中图分类号
学科分类号
摘要
Deep fake technology has emerged as a double-edged sword in the digital world. While it holds potential for legitimate uses, it can also be exploited to manipulate video content, causing severe social and security concerns. The research gap lies in the fact that traditional deep fake detection methods, such as visual quality analysis or inconsistency detection, need help to keep up with the rapidly advancing technology used to create deep fakes. That means there's a need for more sophisticated detection techniques. This paper introduces an enhanced approach for detecting deep fake videos using graph neural network (GNN). The proposed method splits the detection process into two phases: a mini-batch graph convolution network stream four-block CNN stream comprising Convolution, Batch Normalization, and Activation function. The final step is a flattening operation, which is essential for connecting the convolutional layers to the dense layer. The fusion of these two phases is performed using three different fusion networks: FuNet-A (additive fusion), FuNet-M (element-wise multiplicative fusion), and FuNet-C (concatenation fusion). The paper further evaluates the proposed model on different datasets, where it achieved an impressive training and validation accuracy of 99.3% after 30 epochs.
引用
收藏
相关论文
共 50 条
  • [21] Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches
    Agarwal, Shruti
    Farid, Hany
    Fried, Ohad
    Agrawala, Maneesh
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2814 - 2822
  • [22] Detecting Transportation Modes Using Deep Neural Network
    Wang, Hao
    Liu, GaoJun
    Duan, Jianyong
    Zhang, Lei
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (05): : 1132 - 1135
  • [23] A Discriminative Graph Neural Network for Fake News Detection
    Cao, Honghao
    Deng, Junhao
    Dong, Guoxuan
    Yuan, Dewei
    2021 2ND INTERNATIONAL CONFERENCE ON BIG DATA & ARTIFICIAL INTELLIGENCE & SOFTWARE ENGINEERING (ICBASE 2021), 2021, : 224 - 228
  • [24] Graph global attention network with memory: A deep learning approach for fake news detection
    Chang, Qian
    Li, Xia
    Duan, Zhao
    NEURAL NETWORKS, 2024, 172
  • [25] Modelling Social Context for Fake News Detection: A Graph Neural Network Based Approach
    Saikia, Pallabi
    Gundale, Kshitij
    Jain, Ankit
    Jadeja, Dev
    Pate, Harvi
    Roy, Mohendra
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [26] Fake review and reviewer detection through behavioral graph partitioning integrating deep neural network
    Manaskasemsak, Bundit
    Tantisuwankul, Jirateep
    Rungsawang, Arnon
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (02): : 1169 - 1182
  • [27] GETAE: Graph Information Enhanced Deep Neural NeTwork Ensemble ArchitecturE for fake news detection
    Truica, Ciprian-Octavian
    Apostol, Elena-Simona
    Marogel, Marius
    Paschke, Adrian
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 275
  • [28] Fake review and reviewer detection through behavioral graph partitioning integrating deep neural network
    Bundit Manaskasemsak
    Jirateep Tantisuwankul
    Arnon Rungsawang
    Neural Computing and Applications, 2023, 35 : 1169 - 1182
  • [29] Graph Neural Network for Cell Tracking in Microscopy Videos
    Ben-Haim, Tal
    Raviv, Tammy Riklin
    COMPUTER VISION, ECCV 2022, PT XXI, 2022, 13681 : 610 - 626
  • [30] Detecting brain tumors using deep learning convolutional neural network with transfer learning approach
    Anjum, Sadia
    Hussain, Lal
    Ali, Mushtaq
    Alkinani, Monagi H.
    Aziz, Wajid
    Gheller, Sabrina
    Abbasi, Adeel Ahmed
    Marchal, Ali Raza
    Suresh, Harshini
    Duong, Tim Q.
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2022, 32 (01) : 307 - 323