General GAN-generated Image Detection by Data Augmentation in Fingerprint Domain

被引:0
|
作者
Wang, Huaming [1 ]
Fei, Jianwei [2 ]
Dai, Yunshu [2 ]
Leng, Lingyun [1 ]
Xia, Zhihua [1 ]
机构
[1] Jinan Univ, Coll Cyber Secur, Guangzhou, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
GAN-generated image detection; image fingerprint; data augmentation; generalization ability;
D O I
10.1109/ICME55011.2023.00207
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we investigate improving the generalizability of GAN-generated image detectors by performing data augmentation in the fingerprint domain. Specifically, we first separate the fingerprints and contents of the GAN-generated images using an autoencoder based GAN fingerprint extractor, followed by random perturbations of the fingerprints. Then the original fingerprints are substituted with the perturbed fingerprints and added to the original contents, to produce images that are visually invariant but with distinct fingerprints. The perturbed images can successfully imitate images generated by different GANs to improve the generalization of the detectors, which is demonstrated by the spectra visualization. To our knowledge, we are the first to conduct data augmentation in the fingerprint domain. Our work explores a novel prospect that is distinct from previous works on spatial and frequency domains augmentation. Extensive cross-GAN experiments demonstrate the effectiveness of our method compared to the state-of-the-art methods in detecting fake images generated by unknown GANs.
引用
收藏
页码:1187 / 1192
页数:6
相关论文
共 50 条
  • [21] GAN-Generated Face Detection Based on Multiple Attention Mechanism and Relational Embedding
    Ouyang, Junlin
    Ma, Jiayong
    Chen, Beijing
    INFORMATION TECHNOLOGY AND CONTROL, 2024, 53 (02): : 408 - 428
  • [22] A robust ensemble model for Deepfake detection of GAN-generated images on social media
    Preeti Sharma
    Manoj Kumar
    Hitesh Kumar Sharma
    Discover Computing, 28 (1)
  • [23] KERNEL RANDOM MATRICES OF LARGE CONCENTRATED DATA: THE EXAMPLE OF GAN-GENERATED IMAGES
    Seddik, Mohamed El Amine
    Tamaazousti, Mohamed
    Couillet, Romain
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7480 - 7484
  • [24] Black-box attack against GAN-generated image detector with contrastive perturbation
    Lou, Zijie
    Cao, Gang
    Lin, Man
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [25] Think Twice Before Detecting GAN-generated Fake Images from their Spectral Domain Imprints
    Dong, Chengdong
    Kumar, Ajay
    Liu, Eryun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7855 - 7864
  • [26] Transfer Learning Strategies for Detecting Passive and GAN-Generated Image Forgeries with Pretrained Neural Networks
    Kaman, Shilpa
    Makandar, Aziz
    10TH INTERNATIONAL CONFERENCE ON ELECTRONICS, COMPUTING AND COMMUNICATION TECHNOLOGIES, CONECCT 2024, 2024,
  • [27] An Eyes-Based Siamese Neural Network for the Detection of GAN-Generated Face Images
    Wang, Jun
    Tondi, Benedetta
    Barni, Mauro
    FRONTIERS IN SIGNAL PROCESSING, 2022, 2
  • [28] GAN-generated fake face detection via two-stream CNN with PRNU in the wild
    Wang, Jinwei
    Zeng, Kehui
    Ma, Bin
    Luo, Xiangyang
    Yin, Qilin
    Liu, Guangjie
    Jha, Sunil Kr.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) : 42527 - 42545
  • [29] Evaluating the Efficiency of GAN-Generated Data in Deep Learning Models for Lung Disease Parameter Detection using CT and PET Images
    Sasikala, G. M.
    Anand, K.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [30] GAN-generated fake face detection via two-stream CNN with PRNU in the wild
    Jinwei Wang
    Kehui Zeng
    Bin Ma
    Xiangyang Luo
    Qilin Yin
    Guangjie Liu
    Sunil Kr. Jha
    Multimedia Tools and Applications, 2022, 81 : 42527 - 42545