Towards Robust Gan-Generated Image Detection: A Multi-View Completion Representation

被引:0
|
作者
Liu, Chi [1 ]
Zhu, Tianqing [1 ]
Shen, Sheng [2 ]
Zhou, Wanlei [3 ]
机构
[1] Univ Technol Sydney, Sch Comp Sci, Ultimo, Australia
[2] Univ Sydney, Sch Elect & Informat Engn, Camperdown, Australia
[3] City Univ Macau, Macau, Peoples R China
基金
澳大利亚研究理事会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
GAN-generated image detection now becomes the first line of defense against the malicious uses of machine-synthesized image manipulations such as deepfakes. Although some existing detectors work well in detecting clean, known GAN samples, their success is largely attributable to overfitting unstable features such as frequency artifacts, which will cause failures when facing unknown GANs or perturbation attacks. To overcome the issue, we propose a robust detection framework based on a novel multi-view image completion representation. The framework first learns various view-to-image tasks to model the diverse distributions of genuine images. Frequency-irrelevant features can be represented from the distributional discrepancies characterized by the completion models, which are stable, generalized, and robust for detecting unknown fake patterns. Then, a multi-view classification is devised with elaborated intra- and inter-view learning strategies to enhance view-specific feature representation and cross-view feature aggregation, respectively. We evaluated the generalization ability of our framework across six popular GANs at different resolutions and its robustness against a broad range of perturbation attacks. The results confirm our method's improved effectiveness, generalization, and robustness over various baselines.
引用
收藏
页码:464 / 472
页数:9
相关论文
共 50 条
  • [41] Multi-View Missing Data Completion
    Zhang, Lei
    Zhao, Yao
    Zhu, Zhenfeng
    Shen, Dinggang
    Ji, Shuiwang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (07) : 1296 - 1309
  • [42] Locally GAN-generated face detection based on an improved Xception
    Chen, Beijing
    Ju, Xingwang
    Xiao, Bin
    Ding, Weiping
    Zheng, Yuhui
    de Albuquerque, Victor Hugo C.
    INFORMATION SCIENCES, 2021, 572 : 16 - 28
  • [43] Image annotation based on multi-view robust spectral clustering
    Zamiri, Mona
    Yazdi, Hadi Sadoghi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 74
  • [44] Detection of GAN generated image using color gradient representation*
    Liu, Yun
    Wan, Zuliang
    Yin, Xiaohua
    Yue, Guanghui
    Tan, Aiping
    Zheng, Zhi
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [45] ROMIR: Robust Multi-View Image Re-Ranking
    Li, Jun
    Xu, Chang
    Yang, Wankou
    Sun, Changyin
    Kotagiri, Ramamohanarao
    Tao, Dacheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (12) : 2393 - 2406
  • [46] Robust Attentive Deep Neural Network for Detecting GAN-Generated Faces
    Guo, Hui
    Hu, Shu
    Wang, Xin
    Chang, Ming-Ching
    Lyu, Siwei
    IEEE Access, 2022, 10 : 32574 - 32583
  • [47] Robust Attentive Deep Neural Network for Detecting GAN-Generated Faces
    Guo, Hui
    Hu, Shu
    Wang, Xin
    Chang, Ming-Ching
    Lyu, Siwei
    IEEE ACCESS, 2022, 10 : 32574 - 32583
  • [48] Robust image hashing based on multi-view dimension reduction
    Du, Ling
    Shang, Qiuchen
    Wang, Ziwei
    Wang, Xiaochao
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2023, 77
  • [49] UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and Localization
    Li, Shuaibo
    Ma, Wei
    Guo, Jianwei
    Xu, Shibiao
    Li, Benchong
    Zhan, Xiaopeng
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 12523 - 12533
  • [50] Robust and fast subspace representation learning for multi-view subspace clustering
    Yu, Tailong
    Xu, Yesong
    Yan, Nan
    Li, Mengyang
    Applied Soft Computing, 2025, 175