Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms

被引:196
|
作者
Phillips, P. Jonathon [1 ]
Yates, Amy N. [1 ]
Hu, Ying [2 ]
Hahn, Carina A. [2 ]
Noyes, Eilidh [2 ]
Jackson, Kelsey [2 ]
Cavazos, Jacqueline G. [2 ]
Jeckeln, Geraldine [2 ]
Ranjan, Rajeev [3 ]
Sankaranarayanan, Swami [3 ]
Chen, Jun-Cheng [4 ]
Castillo, Carlos D. [4 ]
Chellappa, Rama [3 ]
White, David [5 ]
O'Toole, Alice J. [2 ]
机构
[1] NIST, Informat Access Div, Gaithersburg, MD 20899 USA
[2] Univ Texas Dallas, Sch Behav & Brain Sci, Richardson, TX 75080 USA
[3] Univ Maryland, Inst Adv Comp Studies, Dept Elect & Comp Engn, College Pk, MD 20854 USA
[4] Univ Maryland, Inst Adv Comp Studies, College Pk, MD 20854 USA
[5] Univ New South Wales, Sch Psychol, Sydney, NSW 2052, Australia
基金
澳大利亚研究理事会;
关键词
face identification; forensic science; face recognition algorithm; wisdom-of-crowds; machine learning technology; PERSON RECOGNITION; PEOPLE; BODY;
D O I
10.1073/pnas.1721355115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Achieving the upper limits of face identification accuracy in forensic applications can minimize errors that have profound social and personal consequences. Although forensic examiners identify faces in these applications, systematic tests of their accuracy are rare. How can we achieve the most accurate face identification: using people and/or machines working alone or in collaboration? In a comprehensive comparison of face identification by humans and computers, we found that forensic facial examiners, facial reviewers, and superrecognizers were more accurate than fingerprint examiners and students on a challenging face identification test. Individual performance on the test varied widely. On the same test, four deep convolutional neural networks (DCNNs), developed between 2015 and 2017, identified faces within the range of human accuracy. Accuracy of the algorithms increased steadily over time, with the most recent DCNN scoring above the median of the forensic facial examiners. Using crowd-sourcing methods, we fused the judgments of multiple forensic facial examiners by averaging their rating-based identity judgments. Accuracy was substantially better for fused judgments than for individuals working alone. Fusion also served to stabilize performance, boosting the scores of lower-performing individuals and decreasing variability. Single forensic facial examiners fused with the best algorithm were more accurate than the combination of two examiners. Therefore, collaboration among humans and between humans and machines offers tangible benefits to face identification accuracy in important applications. These results offer an evidence-based roadmap for achieving the most accurate face identification possible.
引用
收藏
页码:6171 / 6176
页数:6
相关论文
共 50 条
  • [1] Influence of Facial Expression and Viewpoint Variations on Face Recognition Accuracy by Different Face Recognition Algorithms
    Phankokkruad, Manop
    Jaturawat, Phichaya
    [J]. 2017 18TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNDP 2017), 2017, : 231 - 237
  • [2] Designing Cross-Race Tests for Forensic Facial Examiners, Super-recognizers, and Face Recognition Algorithms
    Jeckeln, Geraldine
    Yavuzcan, Selin
    Marquis, Kate A.
    Mehta, Prajay S.
    Yates, Amy N.
    Phillips, P. Jonathon
    O'Toole, Alice J.
    [J]. 2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [3] Person recognition: Qualitative differences in how forensic face examiners and untrained people rely on the face versus the body for identification
    Hu, Ying
    Jackson, Kelsey
    Yates, Amy
    White, David
    Phillips, P. Jonathon
    O'Toole, Alice J.
    [J]. VISUAL COGNITION, 2017, 25 (4-6) : 492 - 506
  • [4] Fusing individual algorithms and humans improves face recognition accuracy
    O'Toole, Alice J.
    Jiang, Fang
    Abdi, Herve
    Phillips, P. Jonathon
    [J]. ADVANCES IN VISUAL COMPUTING, PT 2, 2006, 4292 : 447 - +
  • [5] Algorithms for face recognition drones
    Shanthi K.G.
    Sesha Vidhya S.
    Vishakha K.
    Subiksha S.
    Srija K.K.
    Srinee Mamtha R.
    [J]. Materials Today: Proceedings, 2023, 80 : 2224 - 2227
  • [6] Comparison of Face Recognition Algorithms
    Gunay, Melike
    Ensari, Tolga
    [J]. 2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [7] Comparison of compression algorithms' impact on fingerprint and face recognition accuracy
    Mascher-Kampfer, A.
    Stogner, Herbert
    Uhl, Andreas
    [J]. VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2007, PTS 1 AND 2, 2007, 6508
  • [8] Forensic face image generation and recognition
    Vikram, Adithya
    Chandrasekaran, Anusha
    Srinithyee, S. K.
    Priyadharsini, R.
    [J]. ROMANIAN JOURNAL OF INFORMATION TECHNOLOGY AND AUTOMATIC CONTROL-REVISTA ROMANA DE INFORMATICA SI AUTOMATICA, 2022, 32 (03): : 85 - 94
  • [9] Towards Automatic Forensic Face Recognition
    Ali, Tauseef
    Spreeuwers, Luuk
    Veldhuis, Raymond
    [J]. INFORMATICS ENGINEERING AND INFORMATION SCIENCE, PT II, 2011, 252 : 47 - 55
  • [10] Evaluation of Face Recognition Algorithms on Avatar Face Datasets
    Yampolskiy, Roman V.
    Cho, Gyuchoon
    Rosenthal, Richard
    Gavrilova, Marina L.
    [J]. 2011 INTERNATIONAL CONFERENCE ON CYBERWORLDS, 2011, : 93 - 99