General GAN-generated Image Detection by Data Augmentation in Fingerprint Domain

被引:0
|
作者
Wang, Huaming [1 ]
Fei, Jianwei [2 ]
Dai, Yunshu [2 ]
Leng, Lingyun [1 ]
Xia, Zhihua [1 ]
机构
[1] Jinan Univ, Coll Cyber Secur, Guangzhou, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
GAN-generated image detection; image fingerprint; data augmentation; generalization ability;
D O I
10.1109/ICME55011.2023.00207
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we investigate improving the generalizability of GAN-generated image detectors by performing data augmentation in the fingerprint domain. Specifically, we first separate the fingerprints and contents of the GAN-generated images using an autoencoder based GAN fingerprint extractor, followed by random perturbations of the fingerprints. Then the original fingerprints are substituted with the perturbed fingerprints and added to the original contents, to produce images that are visually invariant but with distinct fingerprints. The perturbed images can successfully imitate images generated by different GANs to improve the generalization of the detectors, which is demonstrated by the spectra visualization. To our knowledge, we are the first to conduct data augmentation in the fingerprint domain. Our work explores a novel prospect that is distinct from previous works on spatial and frequency domains augmentation. Extensive cross-GAN experiments demonstrate the effectiveness of our method compared to the state-of-the-art methods in detecting fake images generated by unknown GANs.
引用
收藏
页码:1187 / 1192
页数:6
相关论文
共 50 条
  • [31] Data Augmentation for Insider Threat Detection with GAN
    Yuan, Fangfang
    Shang, Yanmin
    Liu, Yanbing
    Cao, Yanan
    Tan, Jianlong
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 632 - 638
  • [32] Privacy-Preserving Face and Hair Swapping in Real-Time With a GAN-Generated Face Image
    Tran, Dinh Tuan
    Phung, Duc Tung
    Duong, Duc Manh
    Inoue, Katsumi
    Lee, Joo-Ho
    Nguyen, Anh Quang
    IEEE ACCESS, 2024, 12 : 179265 - 179280
  • [33] Detecting handcrafted facial image manipulations and GAN-generated facial images using Shallow-FakeFaceNet
    Lee, Sangyup
    Tariq, Shahroz
    Shin, Youjin
    Woo, Simon S.
    APPLIED SOFT COMPUTING, 2021, 105
  • [34] Data Augmentation: Recoloring of the Flame Image Based on GAN
    Wang, Teng
    Yang, Zhikai
    Li, Houpu
    Ouyang, Jineng
    Bu, Leping
    Yan, Zhengjun
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4168 - 4171
  • [35] Locally GAN-generated face detection algorithm based on dual-stream features fused by attention
    Chen B.
    Wang P.
    Yu L.
    Shu H.
    Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2023, 53 (03): : 543 - 551
  • [36] A Robust GAN-Generated Face Detection Method Based on Dual-Color Spaces and an Improved Xception
    Chen, Beijing
    Liu, Xin
    Zheng, Yuhui
    Zhao, Guoying
    Shi, Yun-Qing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3527 - 3538
  • [37] Survey of Image Detection Methods Generated by GAN Models
    Xie, Tianqi
    Wu, Yuanyuan
    Jing, Chao
    Sun, Weiheng
    Computer Engineering and Applications, 60 (22): : 74 - 86
  • [38] Microscopic Image Quality in Few-Shot GAN-Generated Cyanobacteria Images and Its Impact on Classification Networks
    Bueno, Gloria
    Sanchez, Lucia
    Perona, Elvira
    Munoz-Martin, M. Angeles
    Hiruelas, Alejandro
    Salido, Jesus
    Cristobal, Gabriel
    OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS VIII, 2024, 12998
  • [39] Leukocyte Recognition Using a Modified AlexNet and Image to Image GAN Data Augmentation
    Reyes-Esparza, Armando
    Chacon-Murguia, Mario, I
    Ramirez-Quintana, Juan A.
    Arzate-Quintana, Carlos
    PATTERN RECOGNITION, MCPR 2023, 2023, 13902 : 139 - 148
  • [40] Perception matters: Exploring imperceptible and transferable anti-forensics for GAN-generated fake face imagery detection
    Wang, Yongwei
    Ding, Xin
    Yang, Yixin
    Ding, Li
    Ward, Rabab
    Wang, Z. Jane
    PATTERN RECOGNITION LETTERS, 2021, 146 : 15 - 22