Exposing Deepfake Videos by Tracking Eye Movements

被引:13
|
作者
Li, Meng [1 ]
Liu, Beibei [1 ]
Hu, Yongjian [1 ,2 ]
Wang, Yufei [2 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China
[2] Sino Singapore Int Joint Res Inst, Guangzhou, Guangdong, Peoples R China
关键词
D O I
10.1109/ICPR48806.2021.9413139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It has recently become a major threat to the public media that fake videos are rapidly spreading over the Internet. The advent of Deepfake, a deep-learning based toolkit, has facilitated a massive abuse of improper synthesized videos, which may influence the media credibility and human rights. A worldwide alert has been set off that finding ways to detect such fake videos is not only crucial but also urgent. This paper reports a novel approach to expose deepfake videos. We found that most fake videos are markedly different from the real ones in the way the eyes move. We are thus motivated to define four features that could well capture such differences. The features are then fed to SVM for classification. It is shown to be a promising approach that without high dimensional features and complicated neural networks, we are able to achieve competitive results on several public datasets. Moreover, the proposed features could well participate with other existing methods in the confrontation with deepfakes.
引用
收藏
页码:5184 / 5189
页数:6
相关论文
共 50 条
  • [21] Eyebrow Recognition for Identifying Deepfake Videos
    Nguyen, Hoang
    Derakhshani, Reza
    2020 INTERNATIONAL CONFERENCE OF THE BIOMETRICS SPECIAL INTEREST GROUP (BIOSIG), 2020, P-306
  • [22] Deepfake Videos in the Wild: Analysis and Detection
    Pu, Jiameng
    Mangaokar, Neal
    Kelly, Lauren
    Bhattacharya, Parantapa
    Sundaram, Kavya
    Javed, Mobin
    Wang, Bolun
    Viswanath, Bimal
    PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021), 2021, : 981 - 992
  • [23] Enriching Vision Videos with Text: An Eye Tracking Study
    Schmedes, Melanie
    Ahrens, Maike
    Nagel, Lukas
    Schneider, Kurt
    2022 30TH IEEE INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE (RE 2022), 2022, : 77 - 87
  • [24] Does color influence eye movements while exploring videos?
    Hamel, Shahrbanoo
    Houzet, Dominique
    Pellerin, Denis
    Guyader, Nathalie
    JOURNAL OF EYE MOVEMENT RESEARCH, 2015, 8 (01):
  • [25] SUBJECTIVE AND OBJECTIVE EVALUATION OF DEEPFAKE VIDEOS
    Korshunov, Pavel
    Marcel, Sebastien
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2510 - 2514
  • [26] Eye movements while viewing narrated, captioned, and silent videos
    Ross, Nicholas M.
    Kowler, Eileen
    JOURNAL OF VISION, 2013, 13 (04):
  • [27] Inferring Visual Biases in UAV Videos from Eye Movements
    Perrin, Anne-Flore
    Zhang, Lu
    Le Meur, Olivier
    DRONES, 2020, 4 (03) : 1 - 25
  • [28] Towards Understanding of Deepfake Videos in the Wild
    Cho, Beomsang
    Le, Binh M.
    Kim, Jiwon
    Woo, Simon
    Tariq, Shahroz
    Abuadbba, Alsharif
    Moore, Kristen
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 4530 - 4537
  • [29] Is it real? A study on detecting deepfake videos
    Thaw N.N.
    July T.
    Wai A.N.
    Goh D.H.-L.
    Chua A.Y.K.
    Thaw, Nyein Nyein (nyei0004@ntu.edu.sg), 1600, John Wiley and Sons Inc (57):
  • [30] Detection of deepfake technology in images and videos
    Liu, Yong
    Sun, Tianning
    Wang, Zonghui
    Zhao, Xu
    Cheng, Ruosi
    Shi, Baolan
    INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2024, 45 (02) : 135 - 148