Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network

被引:5
|
作者
Arshed, Muhammad Asad [1 ,2 ]
Alwadain, Ayed [3 ]
Ali, Rao Faizan [2 ]
Mumtaz, Shahzad [4 ]
Ibrahim, Muhammad [1 ]
Muneer, Amgad [5 ,6 ]
机构
[1] Islamia Univ Bahawalpur, Dept Comp Sci, Bahawalpur 63100, Pakistan
[2] Univ Management & Technol, Sch Syst & Technol, Lahore 54770, Pakistan
[3] King Saud Univ, Community Coll, Comp Sci Dept, Riyadh 145111, Saudi Arabia
[4] Islamia Univ Bahawalpur, Dept Data Sci, Bahawalpur 63100, Pakistan
[5] Univ Texas MD Anderson Canc Ctr, Dept Imaging Phys, Houston, TX 77030 USA
[6] Univ Teknol Petronas, Dept Comp & Informat Sci, Seri Iskandar 32160, Malaysia
关键词
deepfake; identification; Vision Transformer; pretrained; fine tuning;
D O I
10.3390/math11173710
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
With the development of image-generating technologies, significant progress has been made in the field of facial manipulation techniques. These techniques allow people to easily modify media information, such as videos and images, by substituting the identity or facial expression of one person with the face of another. This has significantly increased the availability and accessibility of such tools and manipulated content termed 'deepfakes'. Developing an accurate method for detecting fake images needs time to prevent their misuse and manipulation. This paper examines the capabilities of the Vision Transformer (ViT), i.e., extracting global features to detect deepfake images effectively. After conducting comprehensive experiments, our method demonstrates a high level of effectiveness, achieving a detection accuracy, precision, recall, and F1 rate of 99.5 to 100% for both the original and mixture data set. According to our existing understanding, this study is a research endeavor incorporating real-world applications, specifically examining Snapchat-filtered images.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] HolisticDFD: Infusing spatiotemporal transformer embeddings for deepfake detection
    Raza, Muhammad Anas
    Malik, Khalid Mahmood
    Haq, Ijaz Ul
    INFORMATION SCIENCES, 2023, 645
  • [23] Combining EfficientNet and Vision Transformers for Video Deepfake Detection
    Coccomini, Davide Alessandro
    Messina, Nicola
    Gennaro, Claudio
    Falchi, Fabrizio
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 219 - 229
  • [24] Empowering Network Security: BERT Transformer Learning Approach and MLP for Intrusion Detection in Imbalanced Network Traffic
    Ali, Zeeshan
    Tiberti, Walter
    Marotta, Andrea
    Cassioli, Dajana
    IEEE Access, 2024, 12 : 137618 - 137633
  • [25] ConTrans-Detect: A Multi-Scale Convolution-Transformer Network for DeepFake Video Detection
    Sun, Weirong
    Ma, Yujun
    Zhang, Hong
    Wang, Ruili
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [26] Transformer-Based Feature Compensation and Aggregation for DeepFake Detection
    Tan, Zichang
    Yang, Zhichao
    Miao, Changtao
    Guo, Guodong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2183 - 2187
  • [27] MSVT: Multiple Spatiotemporal Views Transformer for DeepFake Video Detection
    Yu, Yang
    Ni, Rongrong
    Zhao, Yao
    Yang, Siyuan
    Xia, Fen
    Jiang, Ning
    Zhao, Guoqing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4462 - 4471
  • [28] Improving Video Vision Transformer for Deepfake Video Detection Using Facial Landmark, Depthwise Separable Convolution and Self Attention
    Ramadhani, Kurniawan Nur
    Munir, Rinaldi
    Utama, Nugraha Priya
    IEEE ACCESS, 2024, 12 : 8932 - 8939
  • [29] CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Yao, Yongxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [30] CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection
    Zhang, Bin
    Zhang, Yongjun
    Li, Yansheng
    Wan, Yi
    Yao, Yongxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20