Robust Frame-Level Detection for Deepfake Videos With Lightweight Bayesian Inference Weighting

被引:0
|
作者
Zhou, Linjiang [1 ]
Ma, Chao [1 ]
Wang, Zepeng [1 ]
Zhang, Yixuan [2 ]
Shi, Xiaochuan [1 ]
Wu, Libing [1 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430072, Hubei, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
关键词
Deepfakes; Computational modeling; Feature extraction; Robustness; Internet of Things; Faces; Bayes methods; Bayesian inference; deepfake video; frame-level detection; IoT security;
D O I
10.1109/JIOT.2023.3337128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deepfake threatens the authenticity of the information in artificial intelligence Internet of Things (IoT) systems. Recently, several deepfake detection methods have been proposed in academia and industry for securing the authenticity of visual information in the face of artificial intelligence advances. Frame-level detection methods, a widely employed security method against deepfake, have a small model size and offer real-time responsiveness, despite basing their classification decision only on the information contained within the frame they are evaluating. We propose a new lightweight frame-level detection technique based on Bayesian inference weighting (BIW) to improve the robustness of existing frame-level detection models. Our proposed BIW technique employs the Naive Bayesian algorithm to estimate the reliability of any candidate model's detection results. Comprehensive experiments were conducted on the attacked data sets by four designed video interference approaches and edge computing platform, showing that BIW enhances the robustness of all the baselines and improves their detection accuracy with a real-time response.
引用
收藏
页码:13018 / 13028
页数:11
相关论文
共 41 条
  • [31] RECOGNITION OF HIGHLY IMBALANCED CODE-MIXED BILINGUAL SPEECH WITH FRAME-LEVEL LANGUAGE DETECTION BASED ON BLURRED POSTERIORGRAM
    Yeh, Ching-Feng
    Heidel, Aaron
    Lee, Hong-Yi
    Lee, Lin-Shan
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 4873 - 4876
  • [32] Learning Frame-Level Recurrent Neural Networks Representations for Query-by-Example Spoken Term Detection on Mobile Devices
    Zhu, Ziwei
    Wu, Zhiyong
    Li, Runnan
    Ning, Yishuang
    Meng, Helen
    [J]. ARTIFICIAL INTELLIGENCE AND MOBILE SERVICES - AIMS 2018, 2018, 10970 : 55 - 66
  • [33] RECOGNITION OF HIGHLY IMBALANCED CODE-MIXED BILINGUAL SPEECH WITH FRAME-LEVEL LANGUAGE DETECTION BASED ON BLURRED POSTERIORGRAM
    Yeh, Ching-Feng
    Heidel, Aaron
    Lee, Hong-Yi
    Lee, Lin-Shan
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 4873 - 4876
  • [34] Frame-Level Matching Scheme Using Posteriorgram Probability Distance of Spoken Data to Improve Search Accuracy of Spoken Term Detection
    Minakawa, Reo
    Kojima, Kazunori
    Lee, Shi-Wook
    Itoh, Yoshiaki
    [J]. PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 1893 - 1897
  • [35] An advanced entropy-based feature with a frame-level vocal effort likelihood space modeling for distant whisper-island detection
    Zhang, Chi
    Hansen, John H. L.
    [J]. SPEECH COMMUNICATION, 2015, 66 : 107 - 117
  • [36] SEMI-AUTOMATED ANNOTATION TOOL OUTPERFORMS TRAINED MEDICAL STUDENTS AND IS COMPARABLE TO CLINICAL EXPERT PERFORMANCE FOR FRAME-LEVEL DETECTION OF COLORECTAL POLYPS
    Eelbode, Tom
    Ahmad, Omer F.
    Sinonquel, Pieter
    Kocadag, Timon Blakemore
    Narayan, Neil
    Rana, Nikita
    Maes, Frederik
    Lovat, Laurence B.
    Bisschops, Raf
    [J]. GASTROINTESTINAL ENDOSCOPY, 2021, 93 (06) : AB202 - AB202
  • [37] Automatic Scoring of COVID-19 LUS Videos Using Cross-correlation-Based Features Aggregated from Frame-Level Confidence Levels Obtained by a Pre-trained Deep Neural Network
    Afrakhteh, Sajjad
    Mento, Federico
    Khan, Umair
    De Rosa, Laura
    Fatima, Noreen
    Azam, Zihadul
    Tursi, Francesco
    Smargiassi, Andrea
    Inchingolo, Riccardo
    Perrone, Tiziano
    Iacca, Giovanni
    Demi, Libertario
    [J]. 2022 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IEEE IUS), 2022,
  • [38] Frame duplication and shuffling forgery detection technique in surveillance videos based on temporal average and gray level co-occurrence matrix
    Fadl, Sondos
    Megahed, Amr
    Han, Qi
    Qiong, Li
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (25-26) : 17619 - 17643
  • [39] Frame duplication and shuffling forgery detection technique in surveillance videos based on temporal average and gray level co-occurrence matrix
    Sondos Fadl
    Amr Megahed
    Qi Han
    Li Qiong
    [J]. Multimedia Tools and Applications, 2020, 79 : 17619 - 17643
  • [40] Bayesian inference based on a bivariate gamma distribution of Kibble for low-level radioactivity detection in nuclear decommissioning operations
    Arahmane, Hanan
    Dumazert, Jonathan
    Barat, Eric
    Dautremer, Thomas
    Carrel, Frederick
    Dufour, Nicolas
    Michel, Maugan
    [J]. PROCESS SAFETY AND ENVIRONMENTAL PROTECTION, 2022, 163 : 727 - 742