General GAN-generated Image Detection by Data Augmentation in Fingerprint Domain

被引:0
|
作者
Wang, Huaming [1 ]
Fei, Jianwei [2 ]
Dai, Yunshu [2 ]
Leng, Lingyun [1 ]
Xia, Zhihua [1 ]
机构
[1] Jinan Univ, Coll Cyber Secur, Guangzhou, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
GAN-generated image detection; image fingerprint; data augmentation; generalization ability;
D O I
10.1109/ICME55011.2023.00207
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we investigate improving the generalizability of GAN-generated image detectors by performing data augmentation in the fingerprint domain. Specifically, we first separate the fingerprints and contents of the GAN-generated images using an autoencoder based GAN fingerprint extractor, followed by random perturbations of the fingerprints. Then the original fingerprints are substituted with the perturbed fingerprints and added to the original contents, to produce images that are visually invariant but with distinct fingerprints. The perturbed images can successfully imitate images generated by different GANs to improve the generalization of the detectors, which is demonstrated by the spectra visualization. To our knowledge, we are the first to conduct data augmentation in the fingerprint domain. Our work explores a novel prospect that is distinct from previous works on spatial and frequency domains augmentation. Extensive cross-GAN experiments demonstrate the effectiveness of our method compared to the state-of-the-art methods in detecting fake images generated by unknown GANs.
引用
收藏
页码:1187 / 1192
页数:6
相关论文
共 50 条
  • [1] Evasion on general GAN-generated image detection by disentangled representation
    Chan, Patrick P. K.
    Zhang, Chuanxin
    Chen, Haitao
    Deng, Jingwen
    Meng, Xiao
    Yeung, Daniel S.
    INFORMATION SCIENCES, 2024, 683
  • [2] Generalized and robust model for GAN-generated image detection
    Raj, Surbhi
    Mathew, Jimson
    Mondal, Arijit
    PATTERN RECOGNITION LETTERS, 2024, 182 : 104 - 110
  • [3] Exposing unseen GAN-generated image using unsupervised domain adaptation
    Zhang, Mingxu
    Wang, Hongxia
    He, Peisong
    Malik, Asad
    Liu, Hanqing
    KNOWLEDGE-BASED SYSTEMS, 2022, 257
  • [4] GAN-Generated Image Detection With Self-Attention Mechanism Against GAN Generator Defect
    Mi, Zhongjie
    Jiang, Xinghao
    Sun, Tanfeng
    Xu, Ke
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (05) : 969 - 981
  • [5] Detection of GAN-Generated Images by Estimating Artifact Similarity
    Li, Weichuang
    He, Peisong
    Li, Haoliang
    Wang, Hongxia
    Zhang, Ruimei
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 862 - 866
  • [6] Towards Robust Gan-Generated Image Detection: A Multi-View Completion Representation
    Liu, Chi
    Zhu, Tianqing
    Shen, Sheng
    Zhou, Wanlei
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 464 - 472
  • [7] Incremental learning for the detection and classification of GAN-generated images
    Marra, Francesco
    Saltori, Cristiano
    Boato, Giulia
    Verdoliva, Luisa
    2019 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2019,
  • [8] GAN-generated face anti-forensics based on image wavelet domain adaptive perturbation
    Chen, Beijing
    Li, Yum
    Shu, Huazhong
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2024, 54 (05): : 1330 - 1338
  • [9] Transferability of CNN models for GAN-generated face detection
    Aieprasert, Thanapat
    Mahdlang, Yada
    Pansiri, Chadaya
    Sae-Bae, Napa
    Khomkham, Banphatree
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (33) : 79815 - 79831
  • [10] An Architecture for the detection of GAN-generated Flood Images with Localization Capabilities
    Wang, Jun
    Alamayreh, Omran
    Tondi, Benedetta
    Barni, Mauro
    2022 IEEE 14TH IMAGE, VIDEO, AND MULTIDIMENSIONAL SIGNAL PROCESSING WORKSHOP (IVMSP), 2022,