Deep Feature Fusion of Fingerprint and Online Signature for Multimodal Biometrics

被引:15
|
作者
Leghari, Mehwish [1 ,2 ]
Memon, Shahzad [1 ]
Das Dhomeja, Lachhman [1 ]
Jalbani, Akhtar Hussain [2 ]
Chandio, Asghar Ali [2 ]
机构
[1] Univ Sindh, Inst Informat & Commun Technol, Jamshoro 76080, Pakistan
[2] Quaid E Awam Univ Engn Sci & Technol, Informat Technol Dept, Nawabshah 67480, Pakistan
关键词
biometric fusion; feature-level fusion; multimodal biometrics; fingerprint and online signature recognition; convolutional neural network;
D O I
10.3390/computers10020021
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The extensive research in the field of multimodal biometrics by the research community and the advent of modern technology has compelled the use of multimodal biometrics in real life applications. Biometric systems that are based on a single modality have many constraints like noise, less universality, intra class variations and spoof attacks. On the other hand, multimodal biometric systems are gaining greater attention because of their high accuracy, increased reliability and enhanced security. This research paper proposes and develops a Convolutional Neural Network (CNN) based model for the feature level fusion of fingerprint and online signature. Two types of feature level fusion schemes for the fingerprint and online signature have been implemented in this paper. The first scheme named early fusion combines the features of fingerprints and online signatures before the fully connected layers, while the second fusion scheme named late fusion combines the features after fully connected layers. To train and test the proposed model, a new multimodal dataset consisting of 1400 samples of fingerprints and 1400 samples of online signatures from 280 subjects was collected. To train the proposed model more effectively, the size of the training data was further increased using augmentation techniques. The experimental results show an accuracy of 99.10% achieved with early feature fusion scheme, while 98.35% was achieved with late feature fusion scheme.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] Multimodal Biometrics System Using Feature-Level Fusion of Iris and Fingerprint
    Khoo, Yik-Herng
    Goi, Bok-Min
    Chai, Tong-Yuen
    Lai, Yen-Lung
    Jin, Zhe
    [J]. ICAIP 2018: 2018 THE 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN IMAGE PROCESSING, 2018, : 6 - 10
  • [2] Identification based on feature fusion of multimodal biometrics and deep learning
    Medjahed, Chahreddine
    Mezzoudj, Freha
    Rahmoun, Abdellatif
    Charrier, Christophe
    [J]. INTERNATIONAL JOURNAL OF BIOMETRICS, 2023, 15 (3-4) : 521 - 538
  • [3] Feature level fusion of face and fingerprint biometrics
    Rattani, A.
    Kisku, D. R.
    Bicego, M.
    Tistarelli, M.
    [J]. 2007 FIRST IEEE INTERNATIONAL CONFERENCE ON BIOMETRICS: THEORY, APPLICATIONS AND SYSTEMS, 2007, : 85 - +
  • [4] Multimodal Biometric System Based on the Fusion in Score of Fingerprint and Online Handwritten Signature
    Hafs, Toufik
    Zehir, Hatem
    Hafs, Ali
    Nait-Ali, Amine
    [J]. APPLIED COMPUTER SYSTEMS, 2023, 28 (01) : 58 - 65
  • [5] Multimodal Biometrics using Cancelable Feature Fusion
    Paul, Padma Polash
    Gavrilova, Marina
    [J]. 2014 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2014, : 279 - 284
  • [6] Feature Level Fusion of Fingerprint and Finger Vein Biometrics
    Lin, Kunming
    Han, Fengling
    Yang, Yongming
    Zhang, Zulong
    [J]. ADVANCES IN SWARM INTELLIGENCE, PT II, 2011, 6729 : 348 - +
  • [7] An investigation into feature-level fusion of face and fingerprint biometrics
    Computer Vision Laboratory, Department of Architecture and Planning , University of Sassari, Palazzo del Pou Salit Piazza Duomo 6, Alghero
    07041, Italy
    不详
    07041, Italy
    [J]. Multibiometrics for Hum. Identif., (120-142):
  • [8] INFORMATION FUSION IN BIOMETRICS: A CASE STUDY IN ONLINE SIGNATURE
    Almayyan, Waheeda
    Own, Hala S.
    Zedan, Hussein
    [J]. IMCIC 2010: INTERNATIONAL MULTI-CONFERENCE ON COMPLEXITY, INFORMATICS AND CYBERNETICS, VOL I (POST-CONFERENCE EDITION), 2010, : 269 - 273
  • [9] Design of Multimodal biometrics system based on Feature level fusion
    Joshi, S. C.
    Kumar, Abhay
    [J]. PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND CONTROL (ISCO'16), 2016,
  • [10] FEATURE LEVEL FUSION APPROACH FOR PERSONAL AUTHENTICATION IN MULTIMODAL BIOMETRICS
    Evangelin, L. Nisha
    Fred, A. Lenin
    [J]. 2017 THIRD INTERNATIONAL CONFERENCE ON SCIENCE TECHNOLOGY ENGINEERING & MANAGEMENT (ICONSTEM), 2017, : 148 - 151