Deepfake Video Detection through Optical Flow based CNN

被引:181
|
作者
Amerini, Irene [1 ]
Galteri, Leonardo [1 ]
Caldelli, Roberto [1 ,2 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, Media Integrat & Commun Ctr MICC, Florence, Italy
[2] Natl Interuniv Consortium Telecommun CNIT, Parma, Italy
关键词
D O I
10.1109/ICCVW.2019.00152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in visual media technology have led to new tools for processing and, above all, generating multimedia contents. In particular, modern AI-based technologies have provided easy-to-use tools to create extremely realistic manipulated videos. Such synthetic videos, named Deep Fakes, may constitute a serious threat to attack the reputation of public subjects or to address the general opinion on a certain event. According to this, being able to individuate this kind of fake information becomes fundamental. In this work, a new forensic technique able to discern between fake and original video sequences is given; unlike other state-of-the-art methods which resorts at single video frames, we propose the adoption of optical flow fields to exploit possible inter-frame dissimilarities. Such a clue is then used as feature to be learned by CNN classifiers. Preliminary results obtained on FaceForensics++ dataset highlight very promising performances.
引用
收藏
页码:1205 / 1207
页数:3
相关论文
共 50 条
  • [21] Visual attention-based deepfake video forgery detection
    Ganguly, Shreyan
    Mohiuddin, Sk
    Malakar, Samir
    Cuevas, Erik
    Sarkar, Ram
    PATTERN ANALYSIS AND APPLICATIONS, 2022, 25 (04) : 981 - 992
  • [22] A Machine Learning Based Approach for Deepfake Detection in Social Media Through Key Video Frame Extraction
    Mitra A.
    Mohanty S.P.
    Corcoran P.
    Kougianos E.
    SN Computer Science, 2021, 2 (2)
  • [23] Deepfake video detection: challenges and opportunities
    Kaur, Achhardeep
    Hoshyar, Azadeh Noori
    Saikrishna, Vidya
    Firmin, Selena
    Xia, Feng
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (06)
  • [24] A COMPARATIVE ANALYSIS AND STUDY OF A FAST PARALLEL CNN BASED DEEPFAKE VIDEO DETECTION MODEL WITH FEATURE SELECTION (FPC-DFM)
    Das, Athirasree
    Sebastian, Linda
    2023 ADVANCED COMPUTING AND COMMUNICATION TECHNOLOGIES FOR HIGH PERFORMANCE APPLICATIONS, ACCTHPA, 2023,
  • [25] High Performance DeepFake Video Detection on CNN-Based with Attention Target-Specific Regions and Manual Distillation Extraction
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kwon, Ki-Ryong
    APPLIED SCIENCES-BASEL, 2021, 11 (16):
  • [26] Generalized Deepfake Video Detection Through Time-Distribution and Metric Learning
    Saif, Shahela
    Tehseen, Samabia
    Ali, Syed Sohaib
    Kausar, Sumaira
    Jameel, Amina
    IT PROFESSIONAL, 2022, 24 (02) : 38 - 44
  • [27] An Improved Dense CNN Architecture for Deepfake Image Detection
    Patel, Yogesh
    Tanwar, Sudeep
    Bhattacharya, Pronaya
    Gupta, Rajesh
    Alsuwian, Turki
    Davidson, Innocent Ewean
    Mazibuko, Thokozile F.
    IEEE ACCESS, 2023, 11 : 22081 - 22095
  • [28] Deepfake Detection Using CNN Trained on Eye Region
    Johnson, David
    Gwyn, Tony
    Qingge, Letu
    Roy, Kaushik
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: THEORY AND PRACTICES IN ARTIFICIAL INTELLIGENCE, 2022, 13343 : 443 - 451
  • [29] OPTICAL FLOW BASED DYNAMIC CURVED VIDEO TEXT DETECTION
    Shivakuamra, Palaiahnakote
    Lubani, Mohamed
    Wong, KokSheik
    Lu, Tong
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1668 - 1672
  • [30] Mask based Continuous Frame Faceswap Video Generation for Deepfake Detection
    Liu, Dazhuang
    Yang, Zhen
    Zhang, Ru
    Liu, Jianyi
    ASIA-PACIFIC JOURNAL OF CLINICAL ONCOLOGY, 2023, 19 : 14 - 14