Combination of context-dependent bidirectional long short-term memory classifiers for robust offline handwriting recognition

被引:16
|
作者
Chherawala, Youssouf [1 ]
Roy, Partha Pratim [1 ]
Cheriet, Mohamed [1 ]
机构
[1] Ecole Technol Super, Synchromedia Lab, 1100 Notre Dame Ouest, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Handwriting recognition; BLSTM; Context-dependent model; RIMES database; HIDDEN MARKOV-MODELS;
D O I
10.1016/j.patrec.2017.03.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The BLSTM classifier has been recently introduced for sequence labeling tasks and provides state-of-the-art performance for handwriting recognition. Its recurrent connections integrate the context at the feature level over a long range. Nevertheless, this context is not explicitly modeled at the label level. Explicit context-modeling strategies have been applied to HMMs with improvement of the recognition rate. In this paper, we study the effect of context modeling on the performance of the BLSTM classifier. The baseline approach, consisting of context-independent character label, is compared with several context dependent approaches, modeling the left and right contexts. The results show that context-dependent models improve the recognition rate, and demonstrate the ability of the BLSTM classifier to deal with a large number of character models, without clustering. Furthermore, the context-dependent and context independent models are complementary, and their combination leads to a robust recognition. We tested our approach with promising results on the RIMES database of Latin script documents. (c) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:58 / 64
页数:7
相关论文
共 50 条
  • [1] CONTEXT-DEPENDENT BLSTM MODELS. APPLICATION TO OFFLINE HANDWRITING RECOGNITION
    Chherawala, Youssouf
    Roy, Partha Pratim
    Cheriet, Mohamed
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2565 - 2569
  • [2] A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks
    Liwicki, Marcus
    Graves, Alex
    Bunke, Horst
    Schmidhuber, Juergyen
    ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 367 - +
  • [3] On the use of context-dependent modeling units for HMM-based offline handwriting recognition
    Fink, Gernot A.
    Ploetz, Thomas
    ICDAR 2007: NINTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS I AND II, PROCEEDINGS, 2007, : 729 - 733
  • [4] Bidirectional Long Short-Term Memory Network for Vehicle Behavior Recognition
    Zhu, Jiasong
    Sun, Ke
    Jia, Sen
    Lin, Weidong
    Hou, Xianxu
    Liu, Bozhi
    Qiu, Guoping
    REMOTE SENSING, 2018, 10 (06)
  • [6] Centralized tracking and bidirectional long short-term memory for abnormal behaviour recognition
    Andersson, Maria
    COUNTERTERRORISM, CRIME FIGHTING, FORENSICS, AND SURVEILLANCE TECHNOLOGIES VI, 2022, 12275
  • [7] Applying Deep Bidirectional Long Short-Term Memory to Mandarin Tone Recognition
    Yang, Longfei
    Xie, Yanlu
    Zhang, Jinsong
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 1124 - 1127
  • [8] Handwriting Recognition with Large Multidimensional Long Short-Term Memory Recurrent Neural Networks
    Voigtlaender, Paul
    Doetsch, Patrick
    Ney, Hermann
    PROCEEDINGS OF 2016 15TH INTERNATIONAL CONFERENCE ON FRONTIERS IN HANDWRITING RECOGNITION (ICFHR), 2016, : 228 - 233
  • [9] Robust Human Action Recognition via Long Short-Term Memory
    Grushin, Alexander
    Monner, Derek D.
    Reggia, James A.
    Mishra, Ajay
    2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [10] Long Short-Term Memory Networks for Noise Robust Speech Recognition
    Woellmer, Martin
    Sun, Yang
    Eyben, Florian
    Schuller, Bjoern
    11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 3 AND 4, 2010, : 2966 - 2969