Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms

被引:196
|
作者
Phillips, P. Jonathon [1 ]
Yates, Amy N. [1 ]
Hu, Ying [2 ]
Hahn, Carina A. [2 ]
Noyes, Eilidh [2 ]
Jackson, Kelsey [2 ]
Cavazos, Jacqueline G. [2 ]
Jeckeln, Geraldine [2 ]
Ranjan, Rajeev [3 ]
Sankaranarayanan, Swami [3 ]
Chen, Jun-Cheng [4 ]
Castillo, Carlos D. [4 ]
Chellappa, Rama [3 ]
White, David [5 ]
O'Toole, Alice J. [2 ]
机构
[1] NIST, Informat Access Div, Gaithersburg, MD 20899 USA
[2] Univ Texas Dallas, Sch Behav & Brain Sci, Richardson, TX 75080 USA
[3] Univ Maryland, Inst Adv Comp Studies, Dept Elect & Comp Engn, College Pk, MD 20854 USA
[4] Univ Maryland, Inst Adv Comp Studies, College Pk, MD 20854 USA
[5] Univ New South Wales, Sch Psychol, Sydney, NSW 2052, Australia
基金
澳大利亚研究理事会;
关键词
face identification; forensic science; face recognition algorithm; wisdom-of-crowds; machine learning technology; PERSON RECOGNITION; PEOPLE; BODY;
D O I
10.1073/pnas.1721355115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Achieving the upper limits of face identification accuracy in forensic applications can minimize errors that have profound social and personal consequences. Although forensic examiners identify faces in these applications, systematic tests of their accuracy are rare. How can we achieve the most accurate face identification: using people and/or machines working alone or in collaboration? In a comprehensive comparison of face identification by humans and computers, we found that forensic facial examiners, facial reviewers, and superrecognizers were more accurate than fingerprint examiners and students on a challenging face identification test. Individual performance on the test varied widely. On the same test, four deep convolutional neural networks (DCNNs), developed between 2015 and 2017, identified faces within the range of human accuracy. Accuracy of the algorithms increased steadily over time, with the most recent DCNN scoring above the median of the forensic facial examiners. Using crowd-sourcing methods, we fused the judgments of multiple forensic facial examiners by averaging their rating-based identity judgments. Accuracy was substantially better for fused judgments than for individuals working alone. Fusion also served to stabilize performance, boosting the scores of lower-performing individuals and decreasing variability. Single forensic facial examiners fused with the best algorithm were more accurate than the combination of two examiners. Therefore, collaboration among humans and between humans and machines offers tangible benefits to face identification accuracy in important applications. These results offer an evidence-based roadmap for achieving the most accurate face identification possible.
引用
收藏
页码:6171 / 6176
页数:6
相关论文
共 50 条
  • [21] Issues in evaluating face recognition algorithms
    Phillips, PJ
    [J]. CISST'98: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS AND TECHNOLOGY, 1998, : 234 - 241
  • [22] Genetic Algorithms Applied in Face Recognition
    Medeiros, L. X.
    Carrijo, G. A.
    Flores, E. L.
    Veiga, A. C. P.
    [J]. IEEE LATIN AMERICA TRANSACTIONS, 2012, 10 (06) : 2280 - 2285
  • [23] Dependence characteristics of face recognition algorithms
    Rukhin, A
    Grother, P
    Phillips, PJ
    Leigh, S
    Heckert, A
    Newton, E
    [J]. 16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 36 - 39
  • [24] Age Sensitivity of Face Recognition Algorithms
    Yassin, D. K. H. P. H. M.
    Hoque, S.
    Deravi, F.
    [J]. 2013 FOURTH INTERNATIONAL CONFERENCE ON EMERGING SECURITY TECHNOLOGIES (EST), 2013, : 12 - 15
  • [25] The Effects of AI-Driven Face Restoration on Forensic Face Recognition
    Yang, Mengxuan
    Li, Shengnan
    Zeng, Jinhua
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [26] Forensic sketch based Face Recognition using Geometrical Face Model
    Patil, Shivaleela
    Shubhangi, D. C.
    [J]. 2017 2ND INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2017, : 450 - 456
  • [27] Performance evaluation of face recognition algorithms on Asian face database
    Hwang, BW
    Roh, MC
    Lee, SW
    [J]. SIXTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2004, : 278 - 283
  • [28] Performance analysis of face recognition algorithms on Korean face database
    Roh, Myung-Cheol
    Lee, Seong-Whan
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2007, 21 (06) : 1017 - 1033
  • [29] How features of the human face affect recognition: a statistical comparison of three face recognition algorithms
    Givens, G
    Beveridge, JR
    Draper, BA
    Grother, P
    Phillips, PJ
    [J]. PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, 2004, : 381 - 388
  • [30] Comparison of Face Recognition Algorithms & its Subsequent Impact on Side Face
    Shukla, Shivang
    Dave, Sourabh
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ICT IN BUSINESS INDUSTRY & GOVERNMENT (ICTBIG), 2016,