Deep representations for cross-spectral ocular biometrics

被引:20
|
作者
Zanlorensi, Luiz A. [1 ]
Lucio, Diego Rafael [1 ]
Britto Junior, Alceu de Souza [2 ]
Proenca, Hugo [3 ]
Menotti, David [1 ]
机构
[1] Fed Univ Parana UFPR, Dept Informat, Curitiba, Parana, Brazil
[2] Pontifical Catholic Univ Parana PUCPR, Postgrad Programme Informat, Curitiba, Parana, Brazil
[3] Univ Beira Interior, IT, Covilha, Portugal
关键词
image representation; learning (artificial intelligence); image matching; biometrics (access control); feature extraction; iris recognition; eye; neural nets; face recognition; cross-spectral ocular biometrics; cross-spectral ocular verification methods; known deep learning representations; nonnormalised iris-periocular regions; publicly available cross-spectral; ResNet-50 deep representations; PolyU bi-spectral; cross-eye-cross-spectral datasets; IRIS RECOGNITION; CLASSIFICATION; CNN;
D O I
10.1049/iet-bmt.2019.0116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the major challenges in ocular biometrics is the cross-spectral scenario, i.e. how to match images acquired in different wavelengths. This study designs and extensively evaluates cross-spectral ocular verification methods using well known deep learning representations based on the iris and periocular regions. Using as inputs, the bounding boxes of non-normalised iris-periocular regions, the authors fine-tune convolutional neural network models, originally trained for face recognition. On the basis of the experiments carried out in two publicly available cross-spectral ocular databases, they report results for intra-spectral and cross-spectral scenarios, with the best performance being observed when fusing ResNet-50 deep representations from both the periocular and iris regions. When compared to the state of the art, they observed that the proposed solution consistently reduces the equal error rate values by 90%/93%/96% and 61%/77%/83% on the cross-spectral scenario and in the PolyU bi-spectral and cross-eye-cross-spectral datasets. Finally, they evaluate the effect that the 'deepness' factor of feature representations has in recognition effectiveness, and based on a subjective analysis of the most problematic pairwise comparisons - they point out further directions for this field of research.
引用
收藏
页码:68 / 77
页数:10
相关论文
共 50 条
  • [1] On Matching Cross-Spectral Periocular Images for Accurate Biometrics Identification
    Ramaiah, N. Pattabhi
    Kumar, Ajay
    2016 IEEE 8TH INTERNATIONAL CONFERENCE ON BIOMETRICS THEORY, APPLICATIONS AND SYSTEMS (BTAS), 2016,
  • [2] THE RADIANCE AND PHASE-SPACE REPRESENTATIONS OF THE CROSS-SPECTRAL DENSITY OPERATOR
    AGARWAL, GS
    FOLEY, JT
    WOLF, E
    OPTICS COMMUNICATIONS, 1987, 62 (02) : 67 - 72
  • [3] Deep Material-aware Cross-spectral Stereo Matching
    Zhi, Tiancheng
    Pires, Bernardo R.
    Hebert, Martial
    Narasimhan, Srinivasa G.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1916 - 1925
  • [4] Cross-Spectral Factor Analysis
    Gallagher, Neil M.
    Ulrich, Kyle
    Talbot, Austin
    Dzirasa, Kafui
    Carin, Lawrence
    Carlson, David E.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [5] Collapse of the Cross-spectral Function
    Nelson, C. W.
    Hati, A.
    Howe, D. A.
    2014 IEEE INTERNATIONAL FREQUENCY CONTROL SYMPOSIUM (FCS), 2014, : 583 - 584
  • [6] DEEP LEARNING BASED CROSS-SPECTRAL DISPARITY ESTIMATION FOR STEREO IMAGING
    Genser, Nils
    Spruck, Andreas
    Seiler, Juergen
    Kaup, Andre
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2536 - 2540
  • [7] Learning cross-spectral similarity measures with deep convolutional neural networks
    Aguilera, Cristhian A.
    Aguilera, Francisco J.
    Sappa, Angel D.
    Aguilera, Cristhian
    Toledo, Ricardo
    PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 267 - 275
  • [8] Local Gradient Gabor Pattern (LGGP) with Applications in Face Recognition, Cross-spectral Matching and Soft Biometrics
    Chen, Cunjian
    Ross, Arun
    BIOMETRIC AND SURVEILLANCE TECHNOLOGY FOR HUMAN AND ACTIVITY IDENTIFICATION X, 2013, 8712
  • [9] Deep GAN-Based Cross-Spectral Cross-Resolution Iris Recognition
    Mostofa M.
    Mohamadi S.
    Dawson J.
    Nasrabadi N.M.
    IEEE Transactions on Biometrics, Behavior, and Identity Science, 2021, 3 (04): : 443 - 463
  • [10] Difference of cross-spectral densities
    Santarsiero, M.
    Piquero, G.
    de Sande, J. C. G.
    Gori, F.
    OPTICS LETTERS, 2014, 39 (07) : 1713 - 1716