Towards Robust Gan-Generated Image Detection: A Multi-View Completion Representation

被引:0
|
作者
Liu, Chi [1 ]
Zhu, Tianqing [1 ]
Shen, Sheng [2 ]
Zhou, Wanlei [3 ]
机构
[1] Univ Technol Sydney, Sch Comp Sci, Ultimo, Australia
[2] Univ Sydney, Sch Elect & Informat Engn, Camperdown, Australia
[3] City Univ Macau, Macau, Peoples R China
基金
澳大利亚研究理事会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
GAN-generated image detection now becomes the first line of defense against the malicious uses of machine-synthesized image manipulations such as deepfakes. Although some existing detectors work well in detecting clean, known GAN samples, their success is largely attributable to overfitting unstable features such as frequency artifacts, which will cause failures when facing unknown GANs or perturbation attacks. To overcome the issue, we propose a robust detection framework based on a novel multi-view image completion representation. The framework first learns various view-to-image tasks to model the diverse distributions of genuine images. Frequency-irrelevant features can be represented from the distributional discrepancies characterized by the completion models, which are stable, generalized, and robust for detecting unknown fake patterns. Then, a multi-view classification is devised with elaborated intra- and inter-view learning strategies to enhance view-specific feature representation and cross-view feature aggregation, respectively. We evaluated the generalization ability of our framework across six popular GANs at different resolutions and its robustness against a broad range of perturbation attacks. The results confirm our method's improved effectiveness, generalization, and robustness over various baselines.
引用
收藏
页码:464 / 472
页数:9
相关论文
共 50 条
  • [21] Robust Multi-view Manifold Ranking for Image Retrieval
    Wu, Jun
    Yuan, Jianbo
    Luo, Jiebo
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2016, PT II, 2016, 9652 : 92 - 103
  • [22] STN-Net: A Robust GAN-Generated Face Detector
    Ghosh, Tanusree
    Naskar, Ruchira
    INFORMATION SYSTEMS SECURITY, ICISS 2023, 2023, 14424 : 141 - 158
  • [23] Incomplete multi-view subspace clustering based on robust matrix completion
    Xing, Lei
    Zheng, Xinhu
    Lu, Yao
    Chen, Badong
    NEUROCOMPUTING, 2025, 621
  • [24] Robust Spectral Embedding Completion Based Incomplete Multi-view Clustering
    Zhang, Chao
    Wei, Jingwen
    Wang, Bo
    Li, Zechao
    Chen, Chunlin
    Li, Huaxiong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 300 - 308
  • [25] Robust multi-view representation for spatial-spectral domain in application of hyperspectral image classification
    Li, Yanshan
    Wang, Xianchen
    Huang, Qinghua
    Hu, Xiaohui
    Xie, Weixin
    IET COMPUTER VISION, 2019, 13 (02) : 90 - 96
  • [26] Multi-View Robust Graph Representation Learning for Graph Classification
    Ma, Guanghui
    Hu, Chunming
    Ge, Ling
    Zhang, Hong
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 4037 - 4045
  • [27] Learning robust affinity graph representation for multi-view clustering
    Jing, Peiguang
    Su, Yuting
    Li, Zhengnan
    Nie, Liqiang
    INFORMATION SCIENCES, 2021, 544 : 155 - 167
  • [28] Missing View Completion for Multi-View Data
    Yang X.
    Zhu Z.-F.
    Xu M.-X.
    Zhang X.-X.
    Ruan Jian Xue Bao/Journal of Software, 2018, 29 (04): : 945 - 956
  • [29] Incremental learning for the detection and classification of GAN-generated images
    Marra, Francesco
    Saltori, Cristiano
    Boato, Giulia
    Verdoliva, Luisa
    2019 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2019,
  • [30] Multi-view Low Rank Representation for Multi-Source Traffic Data Completion
    Du, Rong
    Chen, Shudong
    INTERNATIONAL JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS RESEARCH, 2019, 17 (03) : 200 - 211