Modular Convolutional Neural Network for Discriminating between Computer-Generated Images and Photographic Images

被引:21
|
作者
Nguyen, Huy H. [1 ]
Tieu, Ngoc-Dung T. [1 ]
Hoang-Quoc Nguyen-Son [2 ]
Nozick, Vincent [3 ]
Yamagishi, Junichi [1 ,2 ,4 ]
Echizen, Isao [1 ,2 ]
机构
[1] SOKENDAI Grad Univ Adv Studies, Hayama, Kanagawa, Japan
[2] Natl Inst Informat, Tokyo, Japan
[3] JFLI, UMI 3527, Tokyo, Japan
[4] Univ Edinburgh, Edinburgh, Midlothian, Scotland
关键词
digital image forensics; computer-generated image; photographic image; convolutional neural network; NATURAL IMAGES;
D O I
10.1145/3230833.3230863
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Discriminating between computer-generated images (CGIs) and photographic images (PIs) is not a new problem in digital image forensics. However, with advances in rendering techniques supported by strong hardware and in generative adversarial networks, CGIs are becoming indistinguishable from PIs in both human and computer perception. This means that malicious actors can use CGIs for spoofing facial authentication systems, impersonating other people, and creating fake news to be spread on social networks. The methods developed for discriminating between CGIs and PIs quickly become outdated and must be regularly enhanced to be able to reduce these attack surfaces. Leveraging recent advances in deep convolutional networks, we have built a modular CGI-PI discriminator with a customized VGG-19 network as the feature extractor, statistical convolutional neural networks as the feature transformers, and a discriminator. We also devised a probabilistic patch aggregation strategy to deal with high-resolution images. This proposed method outperformed a state-of-the-art method and achieved accuracy up to 100%.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] COMPUTER-GENERATED IMAGES IN VISUAL SIMULATION AND AVIONIC TECHNOLOGIES
    MARR, PR
    [J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1981, 303 : 36 - 43
  • [22] Towards a perceptual quality metric for computer-generated images
    Boulenguez, Pierre
    Airieau, Boris
    Larabi, Mohamed-Chaker
    Meneveaux, Daniel
    [J]. IMAGE QUALITY AND SYSTEM PERFORMANCE IX, 2012, 8293
  • [23] ART-HISTORY AND THE CRITICISM OF COMPUTER-GENERATED IMAGES
    ELKINS, J
    [J]. LEONARDO, 1994, 27 (04) : 335 - 342
  • [24] Computer-generated holograms of images reconstructed on curved surfaces
    Rosen, J
    [J]. APPLIED OPTICS, 1999, 38 (29) : 6136 - 6140
  • [25] Interpretation of forest characteristics from computer-generated images
    Barrett, Tara M.
    Zuuring, Hans R.
    Christopher, Treg
    [J]. LANDSCAPE AND URBAN PLANNING, 2007, 80 (04) : 396 - 403
  • [26] Color computer-generated holograms from projection images
    Sando, Y
    Itoh, M
    Yatagai, T
    [J]. OPTICS EXPRESS, 2004, 12 (11): : 2487 - 2493
  • [27] Semantic Liquid Spray Understanding With Computer-Generated Images
    Lim, Wei Lun
    Teow, Matthew Y. W.
    Wong, Richard T. K.
    Pathan, Refat Khan
    Ho, Chiung Ching
    Koneru, Rahul Babu
    Khare, Prashant
    Bravo, Luis
    Lau, Sian Lun
    [J]. IEEE ACCESS, 2024, 12 : 39968 - 39977
  • [28] WHO OWNS YOUR FACE + COMPUTER-GENERATED IMAGES
    JONES, C
    [J]. SIGHT AND SOUND, 1996, 6 (03): : 33 - 33
  • [29] A Novel Method to Distinguish Photorealistic Computer Generated Images from Photographic Images
    Meena, Kunj Bihari
    Tyagi, Vipin
    [J]. 2019 FIFTH INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP 2019), 2019, : 385 - 390
  • [30] CGFormer: ViT-Based Network for Identifying Computer-Generated Images With Token Labeling
    Quan, Weize
    Deng, Pengfei
    Wang, Kai
    Yan, Dong-Ming
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 235 - 250