Exposing Deepfake Videos by Tracking Eye Movements

被引:13
|
作者
Li, Meng [1 ]
Liu, Beibei [1 ]
Hu, Yongjian [1 ,2 ]
Wang, Yufei [2 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
[2] Sino Singapore Int Joint Res Inst, Guangzhou, Guangdong, Peoples R China
关键词
D O I
10.1109/ICPR48806.2021.9413139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has recently become a major threat to the public media that fake videos are rapidly spreading over the Internet. The advent of Deepfake, a deep-learning based toolkit, has facilitated a massive abuse of improper synthesized videos, which may influence the media credibility and human rights. A worldwide alert has been set off that finding ways to detect such fake videos is not only crucial but also urgent. This paper reports a novel approach to expose deepfake videos. We found that most fake videos are markedly different from the real ones in the way the eyes move. We are thus motivated to define four features that could well capture such differences. The features are then fed to SVM for classification. It is shown to be a promising approach that without high dimensional features and complicated neural networks, we are able to achieve competitive results on several public datasets. Moreover, the proposed features could well participate with other existing methods in the confrontation with deepfakes.
引用
收藏
页码:5184 / 5189
页数:6
相关论文
共 50 条
  • [1] Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network
    Su, Yishan
    Xia, Huawei
    Liang, Qi
    Nie, Weizhi
    NEURAL PROCESSING LETTERS, 2021, 53 (06) : 4159 - 4175
  • [2] Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network
    Yishan Su
    Huawei Xia
    Qi Liang
    Weizhi Nie
    Neural Processing Letters, 2021, 53 : 4159 - 4175
  • [3] Exposing DeepFake Videos Using Facial Decomposition-Based Domain Generalization
    Liu, Hanqing
    Wang, Hongxia
    Zhang, Mingxu
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [4] Exposing Deepfake Videos with Spatial, Frequency and Multi-scale Temporal Artifacts
    Hu, Yongjian
    Zhao, Hongjie
    Yu, Zeqiong
    Liu, Beibei
    Yu, Xiangyu
    DIGITAL FORENSICS AND WATERMARKING, IWDW 2021, 2022, 13180 : 47 - 57
  • [5] Watching the BiG artifacts: Exposing DeepFake videos via Bi-granularity artifacts
    Chen, Han
    Li, Yuezun
    Lin, Dongdong
    Li, Bin
    Wu, Junqiang
    PATTERN RECOGNITION, 2023, 135
  • [6] Eye movements on blended natural videos
    Pomarjanschi, L.
    Dorr, M.
    Vig, E.
    Barth, E.
    PERCEPTION, 2009, 38 : 45 - 46
  • [7] Tracking and Comparing Eye Movements Patterns While Watching Interactive and Non-interactive Videos
    Daita, Ananda Rohit
    Mai, Bin
    Namuduri, Kamesh
    INFORMATION SYSTEMS AND NEUROSCIENCE (NEUROIS RETREAT 2018), 2019, 29 : 178 - 185
  • [8] A Dataset of Head and Eye Movements for 360° Videos
    David, Erwan J.
    Gutierrez, Jesus
    Coutrot, Antoine
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    PROCEEDINGS OF THE 9TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'18), 2018, : 432 - 437
  • [9] Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework
    Li, Ying
    Bian, Shan
    Wang, Chuntao
    Polat, Kemal
    Alhudhaif, Adi
    Alenezi, Fayadh
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [10] In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking
    Li, Yuezun
    Chang, Ming-Ching
    Lyu, Siwei
    2018 10TH IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2018,