Ignored Details in Eyes: Exposing GAN-Generated Faces by Sclera

被引:0
|
作者
Zhang, Tong [1 ]
Peng, Anjie [1 ]
Zeng, Hui [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang, Sichuan, Peoples R China
关键词
Image Forensics; Generative adversarial networks; GAN-generated faces detection; Physical/physiological constraints; Capillaries;
D O I
10.1007/978-981-99-8073-4_43
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advances in Generative adversarial networks (GAN) have significantly improved the quality of synthetic facial images, posing threats to many vital areas. Thus, identifying whether a presented facial image is synthesized is of forensic importance. Our fundamental discovery is the lack of capillaries in the sclera of the GAN-generated faces, which is caused by the lack of physical/physiological constraints in the GAN model. Because there are more or fewer capillaries in people's eyes, one can distinguish real faces from GAN-generated ones by carefully examining the sclera area. Following this idea, we first extract the sclera area from a probe image, then feed it into a residual attention network to distinguish GAN-generated faces from real ones. The proposed method is validated on the Flickr-Faces-HQ and StyleGAN2/StyleGAN3-generated face datasets. Experiments demonstrate that the capillary in the sclera is a very effective feature for identifying GAN-generated faces. Our code is available at: https://github.com/109 61020/Deepfake-detector-based-on-blood-vessels.
引用
收藏
页码:563 / 574
页数:12
相关论文
共 50 条
  • [41] Critiquing the Limitations' Challenges in Detecting GAN-Generated Images with Computer Vision
    Dwivedi, Dwijendra Nath
    Dwivedi, Varunendra Nath
    COMMUNICATION AND INTELLIGENT SYSTEMS, VOL 1, ICCIS 2023, 2024, 967 : 95 - 104
  • [42] GAN-Generated Image Detection With Self-Attention Mechanism Against GAN Generator Defect
    Mi, Zhongjie
    Jiang, Xinghao
    Sun, Tanfeng
    Xu, Ke
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (05) : 969 - 981
  • [43] GAN-Generated Face Detection Based on Multiple Attention Mechanism and Relational Embedding
    Ouyang, Junlin
    Ma, Jiayong
    Chen, Beijing
    INFORMATION TECHNOLOGY AND CONTROL, 2024, 53 (02): : 408 - 428
  • [44] A Local Perturbation Generation Method for GAN-Generated Face Anti-Forensics
    Zhang, Haitao
    Chen, Beijing
    Wang, Jinwei
    Zhao, Guoying
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 661 - 676
  • [45] HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms
    Afifi, Mahmoud
    Brubaker, Marcus A.
    Brown, Michael S.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7937 - 7946
  • [46] KERNEL RANDOM MATRICES OF LARGE CONCENTRATED DATA: THE EXAMPLE OF GAN-GENERATED IMAGES
    Seddik, Mohamed El Amine
    Tamaazousti, Mohamed
    Couillet, Romain
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7480 - 7484
  • [47] A robust ensemble model for Deepfake detection of GAN-generated images on social media
    Preeti Sharma
    Manoj Kumar
    Hitesh Kumar Sharma
    Discover Computing, 28 (1)
  • [48] Using GAN-generated market simulations to guide genetic algorithms in index tracking optimization
    Silva, Julio Cezar Soares
    de Almeida Filho, Adiel Teixeira
    APPLIED SOFT COMPUTING, 2023, 145
  • [49] Distinguishing Between Natural and GAN-Generated Face Images by Combining Global and Local Features
    CHEN Beijing
    TAN Weijin
    WANG Yiting
    ZHAO Guoying
    Chinese Journal of Electronics, 2022, 31 (01) : 59 - 67
  • [50] Bagging deep convolutional autoencoders trained with a mixture of real data and GAN-generated data
    Hu, Cong
    Wu, Xiao-Jun
    Shu, Zhen-Qiu
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2019, 13 (11): : 5427 - 5445