Modular Convolutional Neural Network for Discriminating between Computer-Generated Images and Photographic Images

被引:21
|
作者
Nguyen, Huy H. [1 ]
Tieu, Ngoc-Dung T. [1 ]
Hoang-Quoc Nguyen-Son [2 ]
Nozick, Vincent [3 ]
Yamagishi, Junichi [1 ,2 ,4 ]
Echizen, Isao [1 ,2 ]
机构
[1] SOKENDAI Grad Univ Adv Studies, Hayama, Kanagawa, Japan
[2] Natl Inst Informat, Tokyo, Japan
[3] JFLI, UMI 3527, Tokyo, Japan
[4] Univ Edinburgh, Edinburgh, Midlothian, Scotland
关键词
digital image forensics; computer-generated image; photographic image; convolutional neural network; NATURAL IMAGES;
D O I
10.1145/3230833.3230863
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Discriminating between computer-generated images (CGIs) and photographic images (PIs) is not a new problem in digital image forensics. However, with advances in rendering techniques supported by strong hardware and in generative adversarial networks, CGIs are becoming indistinguishable from PIs in both human and computer perception. This means that malicious actors can use CGIs for spoofing facial authentication systems, impersonating other people, and creating fake news to be spread on social networks. The methods developed for discriminating between CGIs and PIs quickly become outdated and must be regularly enhanced to be able to reduce these attack surfaces. Leveraging recent advances in deep convolutional networks, we have built a modular CGI-PI discriminator with a customized VGG-19 network as the feature extractor, statistical convolutional neural networks as the feature transformers, and a discriminator. We also devised a probabilistic patch aggregation strategy to deal with high-resolution images. This proposed method outperformed a state-of-the-art method and achieved accuracy up to 100%.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Distinguishing computer-generated images from photographic images using two-stream convolutional neural network
    Meena, Kunj Bihari
    Tyagi, Vipin
    [J]. APPLIED SOFT COMPUTING, 2021, 100
  • [2] Identifying natural images and computer-generated graphics based on convolutional neural network
    Long, Min
    Long, Sai
    Peng, Fei
    Hu, Xiao-hua
    [J]. INTERNATIONAL JOURNAL OF AUTONOMOUS AND ADAPTIVE COMMUNICATIONS SYSTEMS, 2021, 14 (1-2) : 151 - 162
  • [3] Distinguishing Between Natural and Computer-Generated Images Using Convolutional Neural Networks
    Quan, Weize
    Wang, Kai
    Yan, Dong-Ming
    Zhang, Xiaopeng
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (11) : 2772 - 2787
  • [4] Colour vision and computer-generated images
    Ramek, Michael
    [J]. SYMMETRIES IN SCIENCE XIV, 2010, 237
  • [5] COMPUTER-GENERATED IMAGES IN VISUAL SIMULATION
    BUNKER, WM
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1981, 71 (12) : 1555 - 1555
  • [6] Detecting Computer Generated Images with Deep Convolutional Neural Networks
    de Rezende, Edmar R. S.
    Ruppert, Guilherme C. S.
    Carvalho, Tiago
    [J]. 2017 30TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2017, : 71 - 78
  • [7] PERCEIVING SPATIAL RELATIONSHIPS IN COMPUTER-GENERATED IMAGES
    WANGER, LR
    FERWERDA, JA
    GREENBERG, DP
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 1992, 12 (03) : 44 - 58
  • [8] Computer-generated images of streamer propagation in nitrogen
    Durbhakula, K
    Dhali, S
    [J]. IEEE TRANSACTIONS ON PLASMA SCIENCE, 1999, 27 (01) : 24 - 25
  • [9] MORPHING BRINGS COMPUTER-GENERATED IMAGES TO LIFE
    CONNER, D
    [J]. EDN, 1993, 38 (26) : 66 - 68
  • [10] COMPUTER-GENERATED SHADED-RELIEF IMAGES
    BATSON, RM
    EDWARDS, K
    ELIASON, EM
    [J]. JOURNAL OF RESEARCH OF THE US GEOLOGICAL SURVEY, 1975, 3 (04): : 401 - 408