Exposing Deepfake Videos by Tracking Eye Movements

被引:13
|
作者
Li, Meng [1 ]
Liu, Beibei [1 ]
Hu, Yongjian [1 ,2 ]
Wang, Yufei [2 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
[2] Sino Singapore Int Joint Res Inst, Guangzhou, Guangdong, Peoples R China
关键词
D O I
10.1109/ICPR48806.2021.9413139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has recently become a major threat to the public media that fake videos are rapidly spreading over the Internet. The advent of Deepfake, a deep-learning based toolkit, has facilitated a massive abuse of improper synthesized videos, which may influence the media credibility and human rights. A worldwide alert has been set off that finding ways to detect such fake videos is not only crucial but also urgent. This paper reports a novel approach to expose deepfake videos. We found that most fake videos are markedly different from the real ones in the way the eyes move. We are thus motivated to define four features that could well capture such differences. The features are then fed to SVM for classification. It is shown to be a promising approach that without high dimensional features and complicated neural networks, we are able to achieve competitive results on several public datasets. Moreover, the proposed features could well participate with other existing methods in the confrontation with deepfakes.
引用
收藏
页码:5184 / 5189
页数:6
相关论文
共 50 条
  • [31] Vulnerability assessment and detection of Deepfake videos
    Korshunov, Pavel
    Marcel, Sehastien
    2019 INTERNATIONAL CONFERENCE ON BIOMETRICS (ICB), 2019,
  • [32] Eye movements in repeated multiple object tracking
    Lukavsky, Jiri
    JOURNAL OF VISION, 2013, 13 (07):
  • [33] TRACKING EYE MOVEMENTS WITH AND WITHOUT SACCADIC CORRECTION
    PUCKETT, JDW
    STEINMAN, RM
    VISION RESEARCH, 1969, 9 (06) : 695 - &
  • [34] Tracking Eye Movements During Mental Division
    Tan, Shawn
    LeFevre, Jo-Anne
    CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2015, 69 (04): : 356 - 356
  • [35] The cerebellum coordinates eye and hand tracking movements
    R. C. Miall
    G. Z. Reckess
    H. Imamizu
    Nature Neuroscience, 2001, 4 : 638 - 644
  • [36] Tracking Eye Movements During Sleep in Mice
    Meng, Qingshuo
    Tan, Xinrong
    Jiang, Chengyong
    Xiong, Yanyu
    Yan, Biao
    Zhang, Jiayi
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [38] The cerebellum coordinates eye and hand tracking movements
    Miall, RC
    Reckess, GZ
    Imamizu, H
    NATURE NEUROSCIENCE, 2001, 4 (06) : 638 - 644
  • [39] Tracking Eye Movements To Predict The Valence of A Scene
    Tamuly, Sudarshana
    Jyotsna, C.
    Amudha, J.
    2019 10TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2019,
  • [40] Tracking eye movements while encoding faces
    Lemieux, C.
    Nelson, E.
    Collin, C.
    PERCEPTION, 2012, 41 : 161 - 161