Enhancing Deepfake Detection Through Quantum Transfer Learning and Class-Attention Vision Transformer Architecture

被引:0
|
作者
Kati, Bekir Eray [1 ]
Kucuksille, Ecir Ugur [2 ]
Sariman, Guencel [3 ]
机构
[1] Suleyman Demirel Univ, Inst Nat & Appl Sci, TR-32200 Isparta, Turkiye
[2] Suleyman Demirel Univ, Engn & Nat Sci Fac, Dept Comp Engn, TR-32200 Isparta, Turkiye
[3] Mugla Sitki Kocman Univ, Fac Technol, Dept Informat Syst Engn, TR-48000 Mugla, Turkiye
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 02期
关键词
deepfake detection; quantum transfer learning; vision transformer;
D O I
10.3390/app15020525
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The widespread use of the internet, coupled with the increasing production of digital content, has caused significant challenges in information security and manipulation. Deepfake detection has become a critical research topic in both academic and practical domains, as it involves identifying forged elements in artificially generated videos using various deep learning and artificial intelligence techniques. In this dissertation, an innovative model was developed for detecting deepfake videos by combining the Quantum Transfer Learning (QTL) and Class-Attention Vision Transformer (CaiT) architectures. The Deepfake Detection Challenge (DFDC) dataset was used for training, and a system capable of detecting spatiotemporal inconsistencies was constructed by integrating QTL and CaiT technologies. In addition to existing preprocessing methods in the literature, a novel preprocessing function tailored to the requirements of deep learning models was developed for the dataset. The advantages of quantum computing offered by QTL were merged with the global feature extraction capabilities of the CaiT. The results demonstrated that the proposed method achieved a remarkable performance in detecting deepfake videos, with an accuracy of 90% and ROC AUC score of 0.94 achieved. The model's performance was compared with other methods evaluated on the DFDC dataset, highlighting its efficiency in resource utilization and overall effectiveness. The findings reveal that the proposed QTL-CaiT-based system provides a strong foundation for deepfake detection and contributes significantly to the academic literature. Future research should focus on testing the model on real quantum devices and applying it to larger datasets to further enhance its applicability.
引用
收藏
页数:21
相关论文
共 34 条
  • [21] TransPV: Refining photovoltaic panel detection accuracy through a vision transformer-based deep learning model
    Guo, Zhiling
    Lu, Jiayue
    Chen, Qi
    Liu, Zhengguang
    Song, Chenchen
    Tan, Hongjun
    Zhang, Haoran
    Yan, Jinyue
    APPLIED ENERGY, 2024, 355
  • [22] Enhancing pap smear image classification: integrating transfer learning and attention mechanisms for improved detection of cervical abnormalities
    Sood, Tamanna
    Padmavati, Rajesh
    Bhatia, Rajesh
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2024, 10 (06):
  • [23] Enhancing Medicare Fraud Detection Through Machine Learning: Addressing Class Imbalance With SMOTE-ENN
    Bounab, Rayene
    Zarour, Karim
    Guelib, Bouchra
    Khlifa, Nawres
    IEEE ACCESS, 2024, 12 : 54382 - 54396
  • [24] Grading diffuse glioma based on 2021 WHO grade using self-attention-base deep learning architecture: variable Vision Transformer (vViT)
    Usuzaki, Takuma
    Takahashi, Kengo
    Inamori, Ryusei
    Morishita, Yohei
    Takagi, Hidenobu
    Shizukuishi, Takashi
    Toyama, Yoshitaka
    Abe, Mirei
    Ishikuro, Mami
    Obara, Taku
    Majima, Kazuhiro
    Takase, Kei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 91
  • [25] Enhancing multi-type fault diagnosis in lithium-ion battery systems: Vision transformer-based transfer learning approach
    Liu, Xuyang
    Cai, Hongchang
    Zhou, Zihan
    Kong, Ye
    Zhou, Xingyu
    Han, Xuebing
    Sun, Yuedong
    Zhang, Bowen
    Guo, Dongxu
    Zheng, Yuejiu
    JOURNAL OF POWER SOURCES, 2024, 624
  • [26] Vision transformer and explainable transfer learning models for auto detection of kidney cyst, stone and tumor from CT-radiography
    Islam, Md Nazmul
    Hasan, Mehedi
    Hossain, Md. Kabir
    Alam, Md. Golam Rabiul
    Uddin, Md Zia
    Soylu, Ahmet
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [27] Vision transformer and explainable transfer learning models for auto detection of kidney cyst, stone and tumor from CT-radiography
    Md Nazmul Islam
    Mehedi Hasan
    Md. Kabir Hossain
    Md. Golam Rabiul Alam
    Md Zia Uddin
    Ahmet Soylu
    Scientific Reports, 12
  • [28] Breathing Sound Segmentation and Detection Using Transfer Learning Techniques on an Attention-Based Encoder-Decoder Architecture
    Hsiao, Chiu-Han
    Lin, Ting-Wei
    Lin, Chii-Wann
    Hsu, Fu-Shun
    Lin, Frank Yeong-Sung
    Chen, Chung-Wei
    Chung, Chi-Ming
    42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20, 2020, : 754 - 759
  • [29] Enhancing MOOCs through Real-time Learner Engagement and Emotion Detection Using Computer Vision and Machine Learning
    Mrayhi, Salwa
    Khribi, Mohamed Koutheair
    Jemni, Mohamed
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES, ICALT 2024, 2024, : 1 - 2
  • [30] Enhancing the performance of premature ventricular contraction detection in unseen datasets through deep learning with denoise and contrast attention module
    Shin, Keewon
    Kim, Hyunjung
    Seo, Woo-Young
    Kim, Hyun-Seok
    Shin, Jae-Man
    Kim, Dong-Kyu
    Park, Yong-Seok
    Kim, Sung-Hoon
    Kim, Namkug
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 166