Unmasking Deception: Empowering Deepfake Detection with Vision Transformer Network

被引:5
|
作者
Arshed, Muhammad Asad [1 ,2 ]
Alwadain, Ayed [3 ]
Ali, Rao Faizan [2 ]
Mumtaz, Shahzad [4 ]
Ibrahim, Muhammad [1 ]
Muneer, Amgad [5 ,6 ]
机构
[1] Islamia Univ Bahawalpur, Dept Comp Sci, Bahawalpur 63100, Pakistan
[2] Univ Management & Technol, Sch Syst & Technol, Lahore 54770, Pakistan
[3] King Saud Univ, Community Coll, Comp Sci Dept, Riyadh 145111, Saudi Arabia
[4] Islamia Univ Bahawalpur, Dept Data Sci, Bahawalpur 63100, Pakistan
[5] Univ Texas MD Anderson Canc Ctr, Dept Imaging Phys, Houston, TX 77030 USA
[6] Univ Teknol Petronas, Dept Comp & Informat Sci, Seri Iskandar 32160, Malaysia
关键词
deepfake; identification; Vision Transformer; pretrained; fine tuning;
D O I
10.3390/math11173710
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
With the development of image-generating technologies, significant progress has been made in the field of facial manipulation techniques. These techniques allow people to easily modify media information, such as videos and images, by substituting the identity or facial expression of one person with the face of another. This has significantly increased the availability and accessibility of such tools and manipulated content termed 'deepfakes'. Developing an accurate method for detecting fake images needs time to prevent their misuse and manipulation. This paper examines the capabilities of the Vision Transformer (ViT), i.e., extracting global features to detect deepfake images effectively. After conducting comprehensive experiments, our method demonstrates a high level of effectiveness, achieving a detection accuracy, precision, recall, and F1 rate of 99.5 to 100% for both the original and mixture data set. According to our existing understanding, this study is a research endeavor incorporating real-world applications, specifically examining Snapchat-filtered images.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] A Transformer-Based DeepFake-Detection Method for Facial Organs
    Xue, Ziyu
    Liu, Qingtong
    Shi, Haichao
    Zou, Ruoyu
    Jiang, Xiuhua
    [J]. ELECTRONICS, 2022, 11 (24)
  • [32] ISTVT: Interpretable Spatial-Temporal Video Transformer for Deepfake Detection
    Zhao, Cairong
    Wang, Chutian
    Hu, Guosheng
    Chen, Haonan
    Liu, Chun
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 1335 - 1348
  • [33] VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localization
    Mishra, Pankaj
    Verk, Riccardo
    Fornasier, Daniele
    Piciarelli, Claudio
    Foresti, Gian Luca
    [J]. PROCEEDINGS OF 2021 IEEE 30TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2021,
  • [34] Network Intrusion Detection Based on Feature Image and Deformable Vision Transformer Classification
    He, Kan
    Zhang, Wei
    Zong, Xuejun
    Lian, Lian
    [J]. IEEE ACCESS, 2024, 12 : 44335 - 44350
  • [35] LiSiam: Localization Invariance Siamese Network for Deepfake Detection
    Wang, Jian
    Sun, Yunlian
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 2425 - 2436
  • [36] Frequency Domain Filtered Residual Network for Deepfake Detection
    Wang, Bo
    Wu, Xiaohan
    Tang, Yeling
    Ma, Yanyan
    Shan, Zihao
    Wei, Fei
    [J]. MATHEMATICS, 2023, 11 (04)
  • [37] A Robust Lightweight Deepfake Detection Network Using Transformers
    Zhang, Yaning
    Wang, Tianyi
    Shu, Minglei
    Wang, Yinglong
    [J]. PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2022, 13629 : 275 - 288
  • [38] ViXNet: Vision Transformer with Xception Network for deepfakes based video and image forgery detection
    Ganguly, Shreyan
    Ganguly, Aditya
    Mohiuddin, Sk
    Malakar, Samir
    Sarkar, Ram
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [39] Network Intrusion Detection via Flow-to-Image Conversion and Vision Transformer Classification
    Ho, Chi Mai Kim
    Yow, Kin-Choong
    Zhu, Zhongwen
    Aravamuthan, Sarang
    [J]. IEEE ACCESS, 2022, 10 : 97780 - 97793
  • [40] A forest fire smoke detection model combining convolutional neural network and vision transformer
    Zheng, Ying
    Zhang, Gui
    Tan, Sanqing
    Yang, Zhigao
    Wen, Dongxin
    Xiao, Huashun
    [J]. FRONTIERS IN FORESTS AND GLOBAL CHANGE, 2023, 6