Robust Frame-Level Detection for Deepfake Videos With Lightweight Bayesian Inference Weighting

被引:0
|
作者
Zhou, Linjiang [1 ]
Ma, Chao [1 ]
Wang, Zepeng [1 ]
Zhang, Yixuan [2 ]
Shi, Xiaochuan [1 ]
Wu, Libing [1 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430072, Hubei, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
关键词
Deepfakes; Computational modeling; Feature extraction; Robustness; Internet of Things; Faces; Bayes methods; Bayesian inference; deepfake video; frame-level detection; IoT security;
D O I
10.1109/JIOT.2023.3337128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deepfake threatens the authenticity of the information in artificial intelligence Internet of Things (IoT) systems. Recently, several deepfake detection methods have been proposed in academia and industry for securing the authenticity of visual information in the face of artificial intelligence advances. Frame-level detection methods, a widely employed security method against deepfake, have a small model size and offer real-time responsiveness, despite basing their classification decision only on the information contained within the frame they are evaluating. We propose a new lightweight frame-level detection technique based on Bayesian inference weighting (BIW) to improve the robustness of existing frame-level detection models. Our proposed BIW technique employs the Naive Bayesian algorithm to estimate the reliability of any candidate model's detection results. Comprehensive experiments were conducted on the attacked data sets by four designed video interference approaches and edge computing platform, showing that BIW enhances the robustness of all the baselines and improves their detection accuracy with a real-time response.
引用
收藏
页码:13018 / 13028
页数:11
相关论文
共 42 条
  • [1] Frame-Level Stutter Detection
    Harvill, John
    Hasegawa-Johnson, Mark
    Yoo, Changdong
    [J]. INTERSPEECH 2022, 2022, : 2843 - 2847
  • [2] FInfer: Frame Inference-Based Deepfake Detection for High-Visual-Quality Videos
    Hu, Juan
    Liao, Xin
    Liang, Jinwen
    Zhou, Wenbo
    Qin, Zheng
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 951 - 959
  • [3] Frame-level phoneme classification using inductive inference
    Samouelian, A
    [J]. COMPUTER SPEECH AND LANGUAGE, 1997, 11 (03): : 161 - 186
  • [4] Integrating frame-level boundary detection and deepfake detection for locating manipulated regions in partially spoofed audio forgery attacks
    Cai, Zexin
    Li, Ming
    [J]. COMPUTER SPEECH AND LANGUAGE, 2024, 85
  • [5] Frame-Level Event Detection in Athletics Videos with Pose-Based Convolutional Sequence Networks
    Einfalt, Moritz
    Dampeyrou, Charles
    Zecha, Dan
    Lienhart, Rainer
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL WORKSHOP ON MULTIMEDIA CONTENT ANALYSIS IN SPORTS, MMSPORTS 2019, 2019, : 42 - 50
  • [6] A Robust Lightweight Deepfake Detection Network Using Transformers
    Zhang, Yaning
    Wang, Tianyi
    Shu, Minglei
    Wang, Yinglong
    [J]. PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2022, 13629 : 275 - 288
  • [7] FRAME-LEVEL MATCHING OF NEAR DUPLICATE VIDEOS BASED ON TERNARY FRAME DESCRIPTOR AND ITERATIVE REFINEMENT
    Kim, Kyung-Rae
    Jang, Won-Doug
    Kim, Chang-Su
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 31 - 35
  • [8] Robust Frame Duplication Detection for Degraded Videos
    Han, Qi
    Chen, Hao
    Yu, Liyang
    Li, Qiong
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
  • [9] Frame-level global context modeling for detection and localization of abnormality
    Sharma, Manoj Kumar
    Kumar, Vikas
    Sheet, Debdoot
    Biswas, Prabir Kumar
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (25) : 38345 - 38370
  • [10] Frame-level global context modeling for detection and localization of abnormality
    Manoj Kumar Sharma
    Vikas Kumar
    Debdoot Sheet
    Prabir Kumar Biswas
    [J]. Multimedia Tools and Applications, 2023, 82 : 38345 - 38370