Ignored Details in Eyes: Exposing GAN-Generated Faces by Sclera

被引:0
|
作者
Zhang, Tong [1 ]
Peng, Anjie [1 ]
Zeng, Hui [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang, Sichuan, Peoples R China
关键词
Image Forensics; Generative adversarial networks; GAN-generated faces detection; Physical/physiological constraints; Capillaries;
D O I
10.1007/978-981-99-8073-4_43
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advances in Generative adversarial networks (GAN) have significantly improved the quality of synthetic facial images, posing threats to many vital areas. Thus, identifying whether a presented facial image is synthesized is of forensic importance. Our fundamental discovery is the lack of capillaries in the sclera of the GAN-generated faces, which is caused by the lack of physical/physiological constraints in the GAN model. Because there are more or fewer capillaries in people's eyes, one can distinguish real faces from GAN-generated ones by carefully examining the sclera area. Following this idea, we first extract the sclera area from a probe image, then feed it into a residual attention network to distinguish GAN-generated faces from real ones. The proposed method is validated on the Flickr-Faces-HQ and StyleGAN2/StyleGAN3-generated face datasets. Experiments demonstrate that the capillary in the sclera is a very effective feature for identifying GAN-generated faces. Our code is available at: https://github.com/109 61020/Deepfake-detector-based-on-blood-vessels.
引用
收藏
页码:563 / 574
页数:12
相关论文
共 50 条
  • [21] Uncertainties associated with GAN-generated datasets in high energy physics
    Matchev, Konstantin T.
    Roman, Alexander
    Shyamsundar, Prasanth
    SCIPOST PHYSICS, 2022, 12 (03):
  • [22] On the use of Benford's law to detect GAN-generated images
    Bonettini, Nicolo
    Bestagini, Paolo
    Milani, Simone
    Tubaro, Stefano
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5495 - 5502
  • [23] Locally GAN-generated face detection based on an improved Xception
    Chen, Beijing
    Ju, Xingwang
    Xiao, Bin
    Ding, Weiping
    Zheng, Yuhui
    de Albuquerque, Victor Hugo C.
    INFORMATION SCIENCES, 2021, 572 : 16 - 28
  • [24] Evasion on general GAN-generated image detection by disentangled representation
    Chan, Patrick P. K.
    Zhang, Chuanxin
    Chen, Haitao
    Deng, Jingwen
    Meng, Xiao
    Yeung, Daniel S.
    INFORMATION SCIENCES, 2024, 683
  • [25] STN-Net: A Robust GAN-Generated Face Detector
    Ghosh, Tanusree
    Naskar, Ruchira
    INFORMATION SYSTEMS SECURITY, ICISS 2023, 2023, 14424 : 141 - 158
  • [26] DETECTING GAN-GENERATED IMAGES BY ORTHOGONAL TRAINING OF MULTIPLE CNNS
    Mandelli, Sara
    Bonettini, Nicol O.
    Bestagini, Paolo
    Tubaro, Stefano
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3091 - 3095
  • [27] Detection of GAN-generated Fake Images over Social Networks
    Marra, Francesco
    Gragnaniello, Diego
    Cozzolino, Davide
    Verdoliva, Luisa
    IEEE 1ST CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2018), 2018, : 384 - 389
  • [28] GAN-Generated Face Detection with Strong Generalization Ability Based on Quaternions
    Chen, Beijing
    Li, Tianmu
    Wang, Jinwei
    Zhao, Guoying
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (05): : 734 - 742
  • [29] Unmasking GAN-Generated Faces with Optimal Deep Learning and Cognitive Computing-Based Cutting-Edge Detection System
    Alabdan, Rana
    Alsamri, Jamal
    Hassine, Siwar Ben Haj
    Alotaibi, Faiz Abdullah
    Alotaibi, Saud S.
    Yafoz, Ayman
    Alnfiai, Mrim M.
    Al Duhayyim, Mesfer
    COGNITIVE COMPUTATION, 2024, 16 (06) : 2982 - 2998
  • [30] Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images Detection
    Tan, Chuangchuang
    Zhao, Yao
    Wei, Shikui
    Gu, Guanghua
    Wei, Yunchao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12105 - 12114