Deepfake Video Detection through Optical Flow based CNN

被引:181
|
作者
Amerini, Irene [1 ]
Galteri, Leonardo [1 ]
Caldelli, Roberto [1 ,2 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, Media Integrat & Commun Ctr MICC, Florence, Italy
[2] Natl Interuniv Consortium Telecommun CNIT, Parma, Italy
关键词
D O I
10.1109/ICCVW.2019.00152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in visual media technology have led to new tools for processing and, above all, generating multimedia contents. In particular, modern AI-based technologies have provided easy-to-use tools to create extremely realistic manipulated videos. Such synthetic videos, named Deep Fakes, may constitute a serious threat to attack the reputation of public subjects or to address the general opinion on a certain event. According to this, being able to individuate this kind of fake information becomes fundamental. In this work, a new forensic technique able to discern between fake and original video sequences is given; unlike other state-of-the-art methods which resorts at single video frames, we propose the adoption of optical flow fields to exploit possible inter-frame dissimilarities. Such a clue is then used as feature to be learned by CNN classifiers. Preliminary results obtained on FaceForensics++ dataset highlight very promising performances.
引用
收藏
页码:1205 / 1207
页数:3
相关论文
共 50 条
  • [31] Video Steganography System Based on Optical Flow for Object Detection
    Zouak, Abdellatif
    Busawon, Krishna
    Li, Xicong
    2024 14TH INTERNATIONAL SYMPOSIUM ON COMMUNICATION SYSTEMS, NETWORKS AND DIGITAL SIGNAL PROCESSING, CSNDSP 2024, 2024, : 598 - 602
  • [32] Optical Flow Feature Based for Fire Detection on Video Data
    Fatichah, Chastine
    Alam, Sirria Panah
    Navastara, Dini Adni
    2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA SCIENCES (AIDAS2019), 2019, : 100 - 105
  • [33] Deepfake Video Detection Based on EfficientNet-V2 Network
    Deng, Liwei
    Suo, Hongfei
    Li, Dongjie
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [34] AN EFFICIENT DEEP VIDEO MODEL FOR DEEPFAKE DETECTION
    Sun, Ruipeng
    Zhao, Ziyuan
    Shen, Li
    Zeng, Zeng
    Li, Yuxin
    Veeravalli, Bharadwaj
    Yang Xulei
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 351 - 355
  • [35] Deepfake Video Detection with Spatiotemporal Dropout Transformer
    Zhang, Daichi
    Lin, Fanzhao
    Hua, Yingying
    Wang, Pengju
    Zeng, Dan
    Ge, Shiming
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 5833 - 5841
  • [36] Analyzing temporal coherence for deepfake video detection
    Amin, Muhammad Ahmad
    Hu, Yongjian
    Hu, Jiankun
    ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (04): : 2621 - 2641
  • [37] TALL: Thumbnail Layout for Deepfake Video Detection
    Xu, Yuting
    Liang, Jian
    Jia, Gengyun
    Yang, Ziming
    Zhang, Yanhao
    He, Ran
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22601 - 22611
  • [38] Image Feature Detectors for Deepfake Video Detection
    Kharbat, Faten F.
    Elamsy, Tarik
    Mahmoud, Ahmed
    Abdullah, Rami
    2019 IEEE/ACS 16TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA 2019), 2019,
  • [39] Deepfake Video Detection Exploiting Binocular Synchronization
    Wang, Wenjie
    Wang, Zhongyuan
    Wang, Guangcheng
    Zou, Qin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT III, 2022, 13531 : 101 - 112
  • [40] On the effectiveness of handcrafted features for deepfake video detection
    Kaddar, Bachir
    Fezza, Sid Ahmed
    Hamidouche, Wassim
    Akhtar, Zahid
    Hadid, Abdenour
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)