Improving the generalization of face forgery detection via single domain augmentation

被引:0
|
作者
Li, Wenlong [1 ,2 ]
Feng, Chunhui [1 ,2 ]
Wei, Lifang [1 ,2 ]
Wu, Dawei [1 ,2 ]
机构
[1] Fujian Agr & Forestry Univ, Coll Comp & Informat Sci, Fuzhou 350002, Peoples R China
[2] Fujian Agr & Forestry Univ, Ctr Agroforestry Mega Data Sci, Sch Future Technol, Fuzhou 350002, Peoples R China
基金
中国国家自然科学基金;
关键词
Face forgery detection; Domain generalization; Multi-scale synthetic artifact; Color-difference feature; IMAGE; LOCALIZATION;
D O I
10.1007/s11042-023-17840-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, significant progress has been made in the field of face forgery and face forgery detection. However, the performance of the detection methods in the unknown environment is far beyond satisfactory due to the feature distribution deviation of different fake face generators. In this paper, we adopt the domain generalization theory to improve the generality of fake face detection. The utilized method augments the original image samples by introducing gradient noise yielded during back-propagation, simulating the forgery features in unknown domains. In the construction of the detection network, we propose a multi-scale synthetic artifact trace tracker (MSATT) to enhance the manipulation traces through multi-scale content suppression. Meanwhile, we observed that the synthesized images present a noticeable color abnormality after going through the proposed MSATT module. Therefore, we designed a color difference perception network (CDPNet) to capture this unique feature. Experimental results demonstrate that both the domain augmentation and the proposed CDPNet can effectively improve the performance of the detection network. The proposed method is competitive with the state-of-the-art face forgery detection methods on both intra- and inter-dataset evaluations.
引用
收藏
页码:63975 / 63992
页数:18
相关论文
共 50 条
  • [1] Improving Generalization by Commonality Learning in Face Forgery Detection
    Yu, Peipeng
    Fei, Jianwei
    Xia, Zhihua
    Zhou, Zhili
    Weng, Jian
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 547 - 558
  • [2] Learning Face Forgery Detection in Unseen Domain with Generalization Deepfake Detector
    Tran, Van-Nhan
    Lee, Suk-Hwan
    Le, Hoanh-Su
    Kim, Bo-Sung
    Kwon, Ki-Ryong
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS, ICCE, 2023,
  • [3] Domain Generalization for Face Anti-Spoofing via Negative Data Augmentation
    Wang, Weihang
    Liu, Peilin
    Zheng, Haoyuan
    Ying, Rendong
    Wen, Fei
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 : 2333 - 2344
  • [4] Improving Generalization in Deepfake Detection via Augmentation with Recurrent Adversarial Attacks
    Stanciu, Dan-Cristian
    Ionescu, Bogdan
    [J]. PROCEEDINGS OF THE 3RD ACM INTERNATIONAL WORKSHOP ON MULTIMEDIA AI AGAINST DISINFORMATION, MAD 2024, 2024, : 46 - 54
  • [5] Adaptive Face Forgery Detection in Cross Domain
    Song, Luchuan
    Fang, Zheng
    Li, Xiaodan
    Dong, Xiaoyi
    Jin, Zhenchao
    Chen, Yuefeng
    Lyu, Siwei
    [J]. COMPUTER VISION, ECCV 2022, PT XXXIV, 2022, 13694 : 467 - 484
  • [6] Domain Generalization via Ensemble Stacking for Face Presentation Attack Detection
    Muhammad, Usman
    Laaksonen, Jorma
    Beddiar, Djamila Romaissa
    Oussalah, Mourad
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024,
  • [7] Improving domain generalization performance for medical image segmentation via random feature augmentation
    Kang, Yuxin
    Zhao, Xuan
    Zhang, Yu
    Li, Hansheng
    Wang, Guan
    Cui, Lei
    Xing, Yaqiong
    Feng, Jun
    Yang, Lin
    [J]. METHODS, 2023, 218 : 149 - 157
  • [8] Face Forgery Detection via Symmetric Transformer
    Song, Luchuan
    Li, Xiaodan
    Fang, Zheng
    Jin, Zhenchao
    Chen, YueFeng
    Xu, Chenliang
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 4102 - 4111
  • [9] SINGLE-DOMAIN GENERALIZATION FOR SEMANTIC SEGMENTATION VIA DUAL-LEVEL DOMAIN AUGMENTATION
    Chang, Shu-Jung
    Lu, Chen-Yu
    Huang, Pei-Kai
    Hsu, Chiou-Ting
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2335 - 2339
  • [10] Domain General Face Forgery Detection by Learning to Weight
    Sun, Ke
    Liu, Hong
    Ye, Qixiang
    Gao, Yue
    Liu, Jianzhuang
    Shao, Ling
    Ji, Rongrong
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2638 - 2646