Stacking ensemble model of deep learning and its application to Persian/Arabic handwritten digits recognition

被引:26
|
作者
Haghighi, Fatemeh [1 ]
Omranpour, Hesam [1 ]
机构
[1] Babol Noshirvani Univ Technol, Dept Elect & Comp Engn, Babol, Iran
关键词
Ensemble classification; Recursive neural network; Long-short term memory; Convolutional neural network; Stacking; Deep learning; CLASSIFICATION;
D O I
10.1016/j.knosys.2021.106940
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the challenges in recognizing handwritten texts is the individual style of writing. There is the structural similarity of the different digits to each other in writing. Along with the mentioned challenge, these similarities in the text may increase and make it difficult to correctly recognize digits and numbers. In this paper, a new model for recognizing handwritten digits is presented. The proposed model is a stacking ensemble classifier. This classifier is based on the convolutional neural network (CNN) and the bidirectional long-short term memory (BLSTM). Another innovation of the model is the use of the probability vector of images class as the input of the meta-classifier layer. One of the strengths of BLSTM is the ability to learn arrays and vectors; therefore, from a technical point of view, considering the output probability vector of the first model as the input of the meta-classifier (BLSTM) improves the accuracy of the deep learning model. The reason for using stacking ensemble classification is the sameness of the main body of some Persian/Arabic digits (e.g., "2, 3, and 4"). Also, the style the author writes makes classes that are not similar in a structure similar to each other, which causes errors incorrect recognition. This model helps to recognize the correct set of input digits by examining the structure of similarities. To achieve a reliable result in the face of this challenge, this model has been tested on a large Persian/Arabic dataset to cover a wide range of writing styles from different individuals. The dataset has a total of 102,352 data which 60,000 of them are for training data and 20,000 of them are for test data in ten classes of digits that are used in this paper. The result of using this database is to improve the recognition performance of these challenging digits. In examining the dataset presented by the model, the accuracy rate of the training set was 99.98%. And the sample accuracy rate in the test set was 99.39%. That is, compared to experimenting with the convolutional neural network and other researches, the rate has increased. (All codes available at http://web.nit.ac.ir/-h.omranpour/.) (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] A SOM-based fuzzy system and its application in handwritten digits recognition
    Su, MC
    Lai, E
    Tew, CY
    [J]. INTERNATIONAL SYMPOSIUM ON MULTIMEDIA SOFTWARE ENGINEERING, PROCEEDINGS, 2000, : 253 - 258
  • [42] An ensemble of deep transfer learning models for handwritten music symbol recognition
    Paul, Ashis
    Pramanik, Rishav
    Malakar, Samir
    Sarkar, Ram
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (13): : 10409 - 10427
  • [43] An ensemble of deep transfer learning models for handwritten music symbol recognition
    Ashis Paul
    Rishav Pramanik
    Samir Malakar
    Ram Sarkar
    [J]. Neural Computing and Applications, 2022, 34 : 10409 - 10427
  • [44] Handwritten Digits Recognition Using Multiple Instance Learning
    Yuan Hanning
    Wang Peng
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING (GRC), 2013, : 408 - 411
  • [45] Combining Committee-Based Semi-supervised and Active Learning and Its Application to Handwritten Digits Recognition
    Hady, Mohamed Farouk Abdel
    Schwenker, Friedhelm
    [J]. MULTIPLE CLASSIFIER SYSTEMS, PROCEEDINGS, 2010, 5997 : 225 - 234
  • [46] AMachine Learning and Deep Learning Approach for Recognizing Handwritten Digits
    Sharma, Ayushi
    Bhardwaj, Harshit
    Bhardwaj, Arpit
    Sakalle, Aditi
    Acharya, Divya
    Ibrahim, Wubshet
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [47] Investigation on deep learning for off-line handwritten Arabic character recognition
    Boufenar, Chaouki
    Kerboua, Adlen
    Batouche, Mohamed
    [J]. COGNITIVE SYSTEMS RESEARCH, 2018, 50 : 180 - 195
  • [48] Deep Learning, Ensemble and Supervised Machine Learning for Arabic Speech Emotion Recognition
    Ismaiel, Wahiba
    Alhalangy, Abdalilah
    Mohamed, Adil. O. Y.
    Musa, Abdalla Ibrahim Abdalla
    [J]. ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2024, 14 (02) : 13757 - 13764
  • [49] Classification of handwritten digits on the web using deep learning
    Purve, Shrawan J.
    Runwal, Rutuj
    Chandak, Mohit
    [J]. INTERNATIONAL JOURNAL OF NEXT-GENERATION COMPUTING, 2023, 14 (01): : 192 - 198
  • [50] Application of deep learning approach for recognition of voiced Odia digits
    Mohanty, Prithviraj
    Sahoo, Jyoti Prakash
    Nayak, Ajit Kumar
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2022, 25 (05) : 513 - 522