DeepFakes Have No Heart: A Simple rPPG-Based Method to Reveal Fake Videos

被引:5
|
作者
Boccignone, Giuseppe [1 ]
Bursic, Sathya [1 ]
Cuculo, Vittorio [1 ]
D'Amelio, Alessandro [1 ]
Grossi, Giuliano [1 ]
Lanzarotti, Raffaella [1 ]
Patania, Sabrina [1 ]
机构
[1] Univ Milan, Dipartimento Informat, PHuSe Lab, I-20133 Milan, Italy
关键词
DeepFake detection; rPPG; Image forensics; Biological signals; FRAMEWORK;
D O I
10.1007/978-3-031-06430-2_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a simple, yet general method to detect fake videos displaying human subjects, generated via Deep Learning techniques. The method relies on gauging the complexity of heart rate dynamics as derived from the facial video streams through remote photoplethys-mography (rPPG). Features analyzed have a clear semantics as to such physiological behaviour. The approach is thus explainable both in terms of the underlying context model and the entailed computational steps. Most important, when compared to more complex state-of-the-art detection methods, results so far achieved give evidence of its capability to cope with datasets produced by different deep fake models.
引用
收藏
页码:186 / 195
页数:10
相关论文
共 8 条
  • [1] A Comparative Evaluation of Video Codecs for rPPG-based Heart Rate Estimation
    Hyanda, Muhammad H.
    Ahmadi, Nur
    Charlton, Peter H.
    Constandinou, Timothy G.
    Purwarianti, Ayu
    Adiono, Trio
    [J]. 2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 243 - 247
  • [2] rPPG-Based Heart Rate Estimation Using Spatial-Temporal Attention Network
    Hu, Min
    Guo, Dong
    Jiang, Mingxing
    Qian, Fei
    Wang, Xiaohua
    Ren, Fuji
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (04) : 1630 - 1641
  • [3] Fusion Method to Estimate Heart Rate from Facial Videos Based on RPPG and RBCG
    Lee, Hyunwoo
    Cho, Ayoung
    Whang, Mincheol
    [J]. SENSORS, 2021, 21 (20)
  • [4] A simple teacher behavior recognition method for massive teaching videos based on teacher set
    Gang, Zhao
    Wenjuan, Zhu
    Biling, Hu
    Jie, Chu
    Hui, He
    Qing, Xia
    [J]. APPLIED INTELLIGENCE, 2021, 51 (12) : 8828 - 8849
  • [5] A simple teacher behavior recognition method for massive teaching videos based on teacher set
    Zhao Gang
    Zhu Wenjuan
    Hu Biling
    Chu Jie
    He Hui
    Xia Qing
    [J]. Applied Intelligence, 2021, 51 : 8828 - 8849
  • [6] Simple ePDF: A Pair Distribution Function Method Based on Electron Diffraction Patterns to Reveal the Local Structure of Amorphous and Nanocrystalline Materials
    Labar, Janos L.
    Hajagos-Nagy, Klara
    Das, Partha P.
    Gomez-Perez, Alejandro
    Radnoczi, Gyorgy
    [J]. NANOMATERIALS, 2023, 13 (24)
  • [7] A simple method to estimate the exponential material parameters of heart valve tissue based on analogy between uniaxial tension and micropipette aspiration
    Ruogang Zhao
    Craig A. Simmons
    [J]. Biomechanics and Modeling in Mechanobiology, 2013, 12 : 1283 - 1290
  • [8] A simple method to estimate the exponential material parameters of heart valve tissue based on analogy between uniaxial tension and micropipette aspiration
    Zhao, Ruogang
    Simmons, Craig A.
    [J]. BIOMECHANICS AND MODELING IN MECHANOBIOLOGY, 2013, 12 (06) : 1283 - 1290