Ignored Details in Eyes: Exposing GAN-Generated Faces by Sclera

被引:0
|
作者
Zhang, Tong [1 ]
Peng, Anjie [1 ]
Zeng, Hui [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang, Sichuan, Peoples R China
关键词
Image Forensics; Generative adversarial networks; GAN-generated faces detection; Physical/physiological constraints; Capillaries;
D O I
10.1007/978-981-99-8073-4_43
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advances in Generative adversarial networks (GAN) have significantly improved the quality of synthetic facial images, posing threats to many vital areas. Thus, identifying whether a presented facial image is synthesized is of forensic importance. Our fundamental discovery is the lack of capillaries in the sclera of the GAN-generated faces, which is caused by the lack of physical/physiological constraints in the GAN model. Because there are more or fewer capillaries in people's eyes, one can distinguish real faces from GAN-generated ones by carefully examining the sclera area. Following this idea, we first extract the sclera area from a probe image, then feed it into a residual attention network to distinguish GAN-generated faces from real ones. The proposed method is validated on the Flickr-Faces-HQ and StyleGAN2/StyleGAN3-generated face datasets. Experiments demonstrate that the capillary in the sclera is a very effective feature for identifying GAN-generated faces. Our code is available at: https://github.com/109 61020/Deepfake-detector-based-on-blood-vessels.
引用
收藏
页码:563 / 574
页数:12
相关论文
共 50 条
  • [1] EXPOSING GAN-GENERATED FACES USING INCONSISTENT CORNEAL SPECULAR HIGHLIGHTS
    Hu, Shu
    Li, Yuezun
    Lyu, Siwei
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2500 - 2504
  • [2] EYES TELL ALL: IRREGULAR PUPIL SHAPES REVEAL GAN-GENERATED FACES
    Guo, Hui
    Hu, Shu
    Wang, Xin
    Chang, Ming-Ching
    Lyu, Siwei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2904 - 2908
  • [3] Exposing GAN-Generated Profile Photos from Compact Embeddings
    Mundra, Shivansh
    Porcile, Gonzalo J. Aniano
    Marvaniya, Smit
    Verbus, James R.
    Farid, Hany
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW, 2023, : 884 - 892
  • [4] Exposing unseen GAN-generated image using unsupervised domain adaptation
    Zhang, Mingxu
    Wang, Hongxia
    He, Peisong
    Malik, Asad
    Liu, Hanqing
    KNOWLEDGE-BASED SYSTEMS, 2022, 257
  • [5] Robust Attentive Deep Neural Network for Detecting GAN-Generated Faces
    Guo, Hui
    Hu, Shu
    Wang, Xin
    Chang, Ming-Ching
    Lyu, Siwei
    IEEE Access, 2022, 10 : 32574 - 32583
  • [6] Robust Attentive Deep Neural Network for Detecting GAN-Generated Faces
    Guo, Hui
    Hu, Shu
    Wang, Xin
    Chang, Ming-Ching
    Lyu, Siwei
    IEEE ACCESS, 2022, 10 : 32574 - 32583
  • [7] An Eyes-Based Siamese Neural Network for the Detection of GAN-Generated Face Images
    Wang, Jun
    Tondi, Benedetta
    Barni, Mauro
    FRONTIERS IN SIGNAL PROCESSING, 2022, 2
  • [8] On the Privacy Properties of GAN-generated Samples
    Lin, Zinan
    Sekar, Vyas
    Fanti, Giulia
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [9] Forensics Forest: Multi-scale Hierarchical Cascade Forest for Detecting GAN-generated Faces
    Lu, Jiucui
    Li, Yuezun
    Zhou, Jiaran
    Li, Bin
    Lyu, Siwei
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2309 - 2314
  • [10] On the Parallel Struggles of Photography and GAN-generated Imagery
    Simkovicova, Martina
    EUROPEAN JOURNAL OF MEDIA ART AND PHOTOGRAPHY, 2023, 11 (01): : 66 - 71