Deepfake Video Detection through Optical Flow based CNN

被引:181
|
作者
Amerini, Irene [1 ]
Galteri, Leonardo [1 ]
Caldelli, Roberto [1 ,2 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, Media Integrat & Commun Ctr MICC, Florence, Italy
[2] Natl Interuniv Consortium Telecommun CNIT, Parma, Italy
关键词
D O I
10.1109/ICCVW.2019.00152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in visual media technology have led to new tools for processing and, above all, generating multimedia contents. In particular, modern AI-based technologies have provided easy-to-use tools to create extremely realistic manipulated videos. Such synthetic videos, named Deep Fakes, may constitute a serious threat to attack the reputation of public subjects or to address the general opinion on a certain event. According to this, being able to individuate this kind of fake information becomes fundamental. In this work, a new forensic technique able to discern between fake and original video sequences is given; unlike other state-of-the-art methods which resorts at single video frames, we propose the adoption of optical flow fields to exploit possible inter-frame dissimilarities. Such a clue is then used as feature to be learned by CNN classifiers. Preliminary results obtained on FaceForensics++ dataset highlight very promising performances.
引用
收藏
页码:1205 / 1207
页数:3
相关论文
共 50 条
  • [41] A Novel Smart Deepfake Video Detection System
    Elpeltagy, Marwa
    Ismail, Aya
    Zaki, Mervat S.
    Eldahshan, Kamal
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (01) : 407 - 419
  • [42] Robust optical flow detection based on the distance transform with the CNN nonlinear circuits
    Kim, H
    Son, H
    Roska, T
    Chua, LO
    2000 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS: DESIGN AND IMPLEMENTATION, 2000, : 743 - 752
  • [43] Spatiotemporal Inconsistency Learning for DeepFake Video Detection
    Gu, Zhihao
    Chen, Yang
    Yao, Taiping
    Ding, Shouhong
    Li, Jilin
    Huang, Feiyue
    Ma, Lizhuang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3473 - 3481
  • [44] Video Transformer for Deepfake Detection with Incremental Learning
    Khan, Sohail Ahmed
    Dai, Hang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1821 - 1828
  • [45] Compact CNN Based Video Representation for Efficient Video Copy Detection
    Wang, Ling
    Bao, Yu
    Li, Haojie
    Fan, Xin
    Luo, Zhongxuan
    MULTIMEDIA MODELING (MMM 2017), PT I, 2017, 10132 : 576 - 587
  • [46] Enhancing Deepfake Detection using SE Block Attention with CNN
    Dasgupta, Subhram
    Mason, Janelle
    Yuan, Xiaohong
    Odeyomi, Olusola
    Roy, Kaushik
    2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, BIG DATA, COMPUTING AND DATA COMMUNICATION SYSTEMS, ICABCD 2024, 2024,
  • [47] Optifake: optical flow extraction for deepfake detection using ensemble learning technique
    Vashishtha, Srishti
    Gaur, Harshit
    Das, Uttirna
    Sourav, Sreejan
    Bhattacharjee, Eshanika
    Kumar, Tarun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (32) : 77509 - 77527
  • [48] Deepfake Video Detection: A Novel Approach via NLP-Based Classification
    Bunluesakdikul, Patchraphon
    Mahanan, Waranya
    Sungunnasil, Prompong
    Sangamuang, Sumalee
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2025,
  • [49] An Enhanced Deep Learning-Based DeepFake Video Detection and Classification System
    Awotunde, Joseph Bamidele
    Jimoh, Rasheed Gbenga
    Imoize, Agbotiname Lucky
    Abdulrazaq, Akeem Tayo
    Li, Chun-Ta
    Lee, Cheng-Chi
    ELECTRONICS, 2023, 12 (01)
  • [50] Autonomous Flame Detection in Video Based on Saliency Analysis and Optical Flow
    Li, Zhenglin
    Isupova, Ga
    Lhaylova, Lyudmila
    Rossi, Lucile
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), 2016, : 218 - 223