General GAN-generated Image Detection by Data Augmentation in Fingerprint Domain

被引:0
|
作者
Wang, Huaming [1 ]
Fei, Jianwei [2 ]
Dai, Yunshu [2 ]
Leng, Lingyun [1 ]
Xia, Zhihua [1 ]
机构
[1] Jinan Univ, Coll Cyber Secur, Guangzhou, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
GAN-generated image detection; image fingerprint; data augmentation; generalization ability;
D O I
10.1109/ICME55011.2023.00207
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we investigate improving the generalizability of GAN-generated image detectors by performing data augmentation in the fingerprint domain. Specifically, we first separate the fingerprints and contents of the GAN-generated images using an autoencoder based GAN fingerprint extractor, followed by random perturbations of the fingerprints. Then the original fingerprints are substituted with the perturbed fingerprints and added to the original contents, to produce images that are visually invariant but with distinct fingerprints. The perturbed images can successfully imitate images generated by different GANs to improve the generalization of the detectors, which is demonstrated by the spectra visualization. To our knowledge, we are the first to conduct data augmentation in the fingerprint domain. Our work explores a novel prospect that is distinct from previous works on spatial and frequency domains augmentation. Extensive cross-GAN experiments demonstrate the effectiveness of our method compared to the state-of-the-art methods in detecting fake images generated by unknown GANs.
引用
收藏
页码:1187 / 1192
页数:6
相关论文
共 50 条
  • [41] Perception matters: Exploring imperceptible and transferable anti-forensics for GAN-generated fake face imagery detection
    Wang, Yongwei
    Ding, Xin
    Yang, Yixin
    Ding, Li
    Ward, Rabab
    Wang, Z. Jane
    Yang, Yixin (yxyang@nwpu.edu.cn), 1600, Elsevier B.V. (146): : 15 - 22
  • [42] CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis
    Barni, Mauro
    Kailas, Kassem
    Nowroozi, Ehsan
    Tondi, Benedetta
    2020 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2020,
  • [43] AugGAN: Cross Domain Adaptation with GAN-Based Data Augmentation
    Huang, Sheng-Wei
    Lin, Che-Tsung
    Chen, Shu-Ping
    Wu, Yen-Yi
    Hsu, Po-Hao
    Lai, Shang-Hong
    COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 731 - 744
  • [44] Detection of GAN generated image using color gradient representation*
    Liu, Yun
    Wan, Zuliang
    Yin, Xiaohua
    Yue, Guanghui
    Tan, Aiping
    Zheng, Zhi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [45] Improved Endoscopic Polyp Classification using GAN Generated Synthetic Data Augmentation
    Sasmal, Pradipta
    Bhuyan, M. K.
    Sonowal, Sourav
    Iwahori, Yuji
    Kasugai, Kunio
    PROCEEDINGS OF 2020 IEEE APPLIED SIGNAL PROCESSING CONFERENCE (ASPCON 2020), 2020, : 247 - 251
  • [46] GAN and DM Generated Synthetic Image Detection in the Age of Misinformation
    Ghosh, Tanusree
    Naskar, Ruchira
    APPLIED CRYPTOGRAPHY AND NETWORK SECURITY WORKSHOPS, PT II, ACNS 2024-AIBLOCK 2024, AIHWS 2024, AIOTS 2024, SCI 2024, AAC 2024, SIMLA 2024, LLE 2024, AND CIMSS 2024, 2024, 14587 : 225 - 229
  • [47] DOPING: Generative Data Augmentation for Unsupervised Anomaly Detection with GAN
    Lim, Swee Kiat
    Loo, Yi
    Ngoc-Trung Tran
    Ngai-Man Cheung
    Roig, Gemma
    Elovici, Yuval
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 1122 - 1127
  • [48] GAN based ROI conditioned Synthesis of Medical Image for Data Augmentation
    Kim, Yisak
    Lee, Jong Hyuk
    Kim, Changi
    Jin, Kwang Nam
    Park, Chang Min
    MEDICAL IMAGING 2023, 2023, 12464
  • [49] Fruit quality and defect image classification with conditional GAN data augmentation
    Bird, Jordan J.
    Barnes, Chloe M.
    Manso, Luis J.
    Ekart, Aniko
    Faria, Diego R.
    SCIENTIA HORTICULTURAE, 2022, 293
  • [50] Multiple Fake Classes GAN for Data Augmentation in Face Image Dataset
    Ali-Gombe, Adamu
    Elyan, Eyad
    Jayne, Chrisina
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,