An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System

被引:6
|
作者
Awotunde, Joseph Bamidele [1 ]
Jimoh, Rasheed Gbenga [1 ]
Imoize, Agbotiname Lucky [2 ,3 ]
Abdulrazaq, Akeem Tayo [1 ]
Li, Chun-Ta [4 ,5 ]
Lee, Cheng-Chi [6 ,7 ]
机构
[1] Univ Ilorin, Fac Informat & Commun Sci, Dept Comp Sci, Ilorin 240003, Nigeria
[2] Univ Lagos, Fac Engn, Dept Elect & Elect Engn, Akoka 100213, Lagos, Nigeria
[3] Ruhr Univ, Inst Digital Commun, Dept Elect Engn & Informat Technol, D-44801 Bochum, Germany
[4] Fu Jen Catholic Univ, Program Artificial Intelligence & Informat Secur, New Taipei City 24206, Taiwan
[5] Tainan Univ Technol, Dept Informat Management, Tainan 71002, Taiwan
[6] Fu Jen Catholic Univ, Res & Dev Ctr Phys Educ Hlth & Informat Technol, Dept Lib & Informat Sci, New Taipei City 24206, Taiwan
[7] Asia Univ, Dept Comp Sci & Informat Engn, Taichung 41354, Taiwan
关键词
convolutional neural networks; DeepFake facial reconstruction; deep learning; DeepFake video detection; image alteration; generative adversarial networks; rectifying linear unit; recurrent neural networks;
D O I
10.3390/electronics12010087
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The privacy of individuals and entire countries is currently threatened by the widespread use of face-swapping DeepFake models, which result in a sizable number of fake videos that seem extraordinarily genuine. Because DeepFake production tools have advanced so much and since so many researchers and businesses are interested in testing their limits, fake media is spreading like wildfire over the internet. Therefore, this study proposes five-layered convolutional neural networks (CNNs) for a DeepFake detection and classification model. The CNN enhanced with ReLU is used to extract features from these faces once the model has extracted the face region from video frames. To guarantee model accuracy while maintaining a suitable weight, a CNN enabled with ReLU model was used for the DeepFake-detection-influenced video. The performance evaluation of the proposed model was tested using Face2Face, and first-order motion DeepFake datasets. Experimental results revealed that the proposed model has an average prediction rate of 98% for DeepFake videos and 95% for Face2Face videos under actual network diffusion circumstances. When compared with systems such as Meso4, MesoInception4, Xception, EfficientNet-B0, and VGG16 which utilizes the convolutional neural network, the suggested model produced the best results with an accuracy rate of 86%.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] A New Deep Learning-Based Methodology for Video Deepfake Detection Using XGBoost
    Ismail, Aya
    Elpeltagy, Marwa
    S. Zaki, Mervat
    Eldahshan, Kamal
    SENSORS, 2021, 21 (16)
  • [2] Unsupervised Learning-Based Framework for Deepfake Video Detection
    Zhang, Li
    Qiao, Tong
    Xu, Ming
    Zheng, Ning
    Xie, Shichuang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4785 - 4799
  • [3] A review of deep learning-based approaches for deepfake content detection
    Passos, Leandro A.
    Jodas, Danilo
    Costa, Kelton A. P.
    Souza, Luis A.
    Rodrigues, Douglas
    Del Ser, Javier
    Camacho, David
    Papa, Joao Paulo
    EXPERT SYSTEMS, 2024, 41 (08)
  • [4] Deep Learning-Based Person Detection and Classification for Far Field Video Surveillance
    Wei, H.
    Laszewski, M.
    Kehtarnavaz, N.
    PROCEEDINGS OF THE 2018 IEEE 13TH DALLAS CIRCUITS AND SYSTEMS CONFERENCE (DCAS), 2018,
  • [5] On the Generalization of Deep Learning Models in Video Deepfake Detection
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    JOURNAL OF IMAGING, 2023, 9 (05)
  • [6] Deep learning-based video surveillance system for suspicious activity detection
    Hanief Wani, Mohd
    Faridi, Arman Rasool
    Journal of Intelligent and Fuzzy Systems, 2024, 47 (1-2): : 71 - 82
  • [7] Deepfake video detection using deep learning algorithms
    Korkmaz, Sahin
    Alkan, Mustafa
    JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2023, 26 (02): : 855 - 862
  • [8] Deep Learning-Based Firework Video Pattern Classification
    Arachchi, S. P. Kasthuri
    Shih, Timothy K.
    Lin, Chih-Yang
    Wijayarathna, Gamini
    JOURNAL OF INTERNET TECHNOLOGY, 2019, 20 (07): : 2033 - 2042
  • [9] Review of Deep Learning-Based Video Anomaly Detection
    Ji G.
    Qi X.
    Wang J.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (02): : 128 - 143
  • [10] An efficient deepfake video detection using robust deep learning
    Qadir, Abdul
    Mahum, Rabbia
    El-Meligy, Mohammed A.
    Ragab, Adham E.
    AlSalman, Abdulmalik
    Awais, Muhammad
    HELIYON, 2024, 10 (05)