Deepfake Video Detection through Optical Flow based CNN

被引:181
|
作者
Amerini, Irene [1 ]
Galteri, Leonardo [1 ]
Caldelli, Roberto [1 ,2 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, Media Integrat & Commun Ctr MICC, Florence, Italy
[2] Natl Interuniv Consortium Telecommun CNIT, Parma, Italy
关键词
D O I
10.1109/ICCVW.2019.00152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in visual media technology have led to new tools for processing and, above all, generating multimedia contents. In particular, modern AI-based technologies have provided easy-to-use tools to create extremely realistic manipulated videos. Such synthetic videos, named Deep Fakes, may constitute a serious threat to attack the reputation of public subjects or to address the general opinion on a certain event. According to this, being able to individuate this kind of fake information becomes fundamental. In this work, a new forensic technique able to discern between fake and original video sequences is given; unlike other state-of-the-art methods which resorts at single video frames, we propose the adoption of optical flow fields to exploit possible inter-frame dissimilarities. Such a clue is then used as feature to be learned by CNN classifiers. Preliminary results obtained on FaceForensics++ dataset highlight very promising performances.
引用
收藏
页码:1205 / 1207
页数:3
相关论文
共 50 条
  • [1] Enhance Deepfake Video Detection Through Optical Flow Algorithms-Based CNN
    Alzahrani, Amani
    Rawat, Danda B.
    HCI INTERNATIONAL 2024 POSTERS, PT VII, HCII 2024, 2024, 2120 : 14 - 22
  • [2] Optical Flow based CNN for detection of unlearnt deepfake manipulations
    Caldelli, Roberto
    Galteri, Leonardo
    Amerini, Irene
    Del Bimbo, Alberto
    PATTERN RECOGNITION LETTERS, 2021, 146 : 31 - 37
  • [3] A Hybrid CNN-LSTM model for Video Deepfake Detection by Leveraging Optical Flow Features
    Saikia, Pallabi
    Dholaria, Dhwani
    Yadav, Priyanka
    Patel, Vaidehi
    Roy, Mohendra
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [4] An Investigation into the Utilisation of CNN with LSTM for Video Deepfake Detection
    Tipper, Sarah
    Atlam, Hany F.
    Lallie, Harjinder Singh
    APPLIED SCIENCES-BASEL, 2024, 14 (21):
  • [5] Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection
    Bondi, Luca
    Cannas, Edoardo Daniele
    Bestagini, Paolo
    Tubaro, Stefano
    2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
  • [6] A Performance Enhancement of Deepfake Video Detection through the use of a Hybrid CNN Deep Learning Model
    Ikram, Sumaiya Thaseen
    Priya, V
    Chambial, Shourya
    Sood, Dhruv
    Arulkumar, V
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (02) : 169 - 178
  • [7] Key frame-based CNN-LSTM model for deepfake video detection
    Cheng, Yan
    JOURNAL OF ELECTRONIC IMAGING, 2025, 34 (01)
  • [8] Abnormal Event Detection Method in Surveillance Video Based on Temporal CNN and Sparse Optical Flow
    Xia, Hongxia
    Li, Ting
    Liu, Wenxuan
    Zhong, Xian
    Yuan, JingLing
    ICCDE 2019: PROCEEDINGS OF THE 2019 5TH INTERNATIONAL CONFERENCE ON COMPUTING AND DATA ENGINEERING, 2019, : 90 - 94
  • [9] Robust DeepFake Detection Method based on Ensemble of ViT and CNN
    Ha, Hyunsoo
    Kim, Minsang
    Han, Songhun
    Lee, Sangjun
    38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, : 1092 - 1095
  • [10] Leveraging edges and optical flow on faces for deepfake detection
    Chintha, Akash
    Rao, Aishwarya
    Sohrawardi, Saniat
    Bhatt, Kartavya
    Wright, Matthew
    Ptucha, Raymond
    IEEE/IAPR INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB 2020), 2020,