Ignored Details in Eyes: Exposing GAN-Generated Faces by Sclera

被引:0
|
作者
Zhang, Tong [1 ]
Peng, Anjie [1 ]
Zeng, Hui [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang, Sichuan, Peoples R China
关键词
Image Forensics; Generative adversarial networks; GAN-generated faces detection; Physical/physiological constraints; Capillaries;
D O I
10.1007/978-981-99-8073-4_43
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Advances in Generative adversarial networks (GAN) have significantly improved the quality of synthetic facial images, posing threats to many vital areas. Thus, identifying whether a presented facial image is synthesized is of forensic importance. Our fundamental discovery is the lack of capillaries in the sclera of the GAN-generated faces, which is caused by the lack of physical/physiological constraints in the GAN model. Because there are more or fewer capillaries in people's eyes, one can distinguish real faces from GAN-generated ones by carefully examining the sclera area. Following this idea, we first extract the sclera area from a probe image, then feed it into a residual attention network to distinguish GAN-generated faces from real ones. The proposed method is validated on the Flickr-Faces-HQ and StyleGAN2/StyleGAN3-generated face datasets. Experiments demonstrate that the capillary in the sclera is a very effective feature for identifying GAN-generated faces. Our code is available at: https://github.com/109 61020/Deepfake-detector-based-on-blood-vessels.
引用
收藏
页码:563 / 574
页数:12
相关论文
共 50 条
  • [31] Can Simpler Be Better? Review of Methods for the Detection of GAN-generated Imagery
    Ankolekar, Adisree, V
    Madappa, Raaga
    Savakis, Andreas
    PATTERN RECOGNITION AND TRACKING XXXIII, 2022, 12101
  • [32] Less is more: A minimalist approach to robust GAN-generated face detection
    Ghosh, Tanusree
    Naskar, Ruchira
    PATTERN RECOGNITION LETTERS, 2024, 179 : 185 - 191
  • [33] Causal Representation Learning for GAN-Generated Face Image Quality Assessment
    Tian, Yu
    Wang, Shiqi
    Chen, Baoliang
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7589 - 7600
  • [34] Cosmic voids in GAN-generated maps of large-scale structure
    Curtis, O.
    Brainerd, T. G.
    Hernandez, A.
    ASTRONOMY AND COMPUTING, 2022, 38
  • [35] Neighboring Algorithm for Visual Semantic Analysis toward GAN-Generated Pictures
    Zhang, Lu-Ming
    Sheng, Yichuan
    APPLIED BIONICS AND BIOMECHANICS, 2022, 2022
  • [36] Testing Deep Learning Recommender Systems Models on Synthetic GAN-Generated Datasets
    Bobadilla, Jesus
    Gutierrez, Abraham
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2023,
  • [37] General GAN-generated Image Detection by Data Augmentation in Fingerprint Domain
    Wang, Huaming
    Fei, Jianwei
    Dai, Yunshu
    Leng, Lingyun
    Xia, Zhihua
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1187 - 1192
  • [38] Comparative Analysis of Deepfake Detection Models on Diverse GAN-Generated Images
    Wyawahare, Medha
    Bhorge, Siddharth
    Rane, Milind
    Parkhi, Vrinda
    Jha, Mayank
    Muhal, Narendra
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2025, 16 (01) : 9 - 18
  • [39] Exposing GAN-synthesized Faces Using Landmark Locations
    Yang, Xin
    Li, Yuezun
    Qi, Honggang
    Lyu, Siwei
    IH&MMSEC '19: PROCEEDINGS OF THE ACM WORKSHOP ON INFORMATION HIDING AND MULTIMEDIA SECURITY, 2019, : 113 - 118
  • [40] T-GD: Transferable GAN-generated Images Detection Framework
    Jeon, Hyeonseong
    Bang, Youngoh
    Kim, Junyaup
    Woo, Simon S.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119