A general framework for the evaluation of symbol recognition methods

被引：15
|
作者：
Valveny, E.
Dosch, P.
Winstanley, Adam
Zhou, Yu
Yang, Su
Yan, Luo
Wenyin, Liu
Elliman, Dave
Delalandre, Mathieu
Trupin, Eric
Adam, Sebastien
Ogier, Jean-Marc
机构：
[1] Ctr Vis Comp, Barcelona 08193, Spain
[2] LORIA, F-54602 Villers Les Nancy, France
[3] Natl Univ Ireland, Maynooth, Kildare, Ireland
[4] Fudan Univ, Dept Comp Sci & Engn, Shanghai 200433, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[6] Univ Nottingham, Nottingham NG7 2RD, England
[7] Univ Rouen, LITIS Lab, Rouen, France
[8] La Rochelle Univ, L3i Lab, Rochelle, France
来源：
INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION | 2007年 / 9卷 / 01期
关键词：
performance evaluation; symbol recognition;
D O I：
10.1007/s10032-006-0033-x
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Performance evaluation is receiving increasing interest in graphics recognition. In this paper, we discuss some questions regarding the definition of a general framework for evaluation of symbol recognition methods. The discussion is centered on three key elements in performance evaluation: test data, evaluation metrics and protocols of evaluation. As a result of this discussion we state some general principles to be taken into account for the definition of such a framework. Finally, we describe the application of this framework to the organization of the first contest on symbol recognition in GREC'03, along with the results obtained by the participants.
引用
收藏
页码：59 / 74
页数：16
相关论文
共 50 条
  • [1] A general framework for the evaluation of symbol recognition methods
    E. Valveny
    P. Dosch
    Adam Winstanley
    Yu Zhou
    Su Yang
    Luo Yan
    Liu Wenyin
    Dave Elliman
    Mathieu Delalandre
    Eric Trupin
    Sébastien Adam
    Jean-Marc Ogier
    International Journal of Document Analysis and Recognition (IJDAR), 2007, 9 : 59 - 74
  • [2] An expert system for general symbol recognition
    Ahmed, M
    Ward, RK
    PATTERN RECOGNITION, 2000, 33 (12) : 1975 - 1988
  • [3] Performance evaluation of symbol recognition
    Valveny, E
    Dosch, P
    DOCUMENT ANALYSIS SYSTEMS VI, PROCEEDINGS, 2004, 3163 : 354 - 365
  • [4] A comparative study of graphic symbol recognition methods
    Irshad Khan
    Naveed Islam
    Hafeez Ur Rehman
    Murad Khan
    Multimedia Tools and Applications, 2020, 79 : 8695 - 8725
  • [5] A comparative study of graphic symbol recognition methods
    Khan, Irshad
    Islam, Naveed
    Rehman, Hafeez Ur
    Khan, Murad
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (13-14) : 8695 - 8725
  • [6] A general framework for symbol and rule extraction in neural networks
    Apolloni, B
    Orovas, C
    Taylor, J
    Fellenz, W
    IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL II, 2000, : 87 - 92
  • [7] Power System Security Analysis: A General Framework for Logical Recognition Methods.
    Barretta, L.
    Napoli, R.
    Energia Elettrica, 1982, 59 (10): : 426 - 439
  • [8] An Evaluation Framework and Database for MoCap-Based Gait Recognition Methods
    Balazia, Michal
    Sojka, Petr
    REPRODUCIBLE RESEARCH IN PATTERN RECOGNITION, RRPR 2016, 2017, 10214 : 33 - 47
  • [9] A general-purpose procedure for complex graphic symbol recognition
    Schettini, R
    CYBERNETICS AND SYSTEMS, 1996, 27 (04) : 353 - 365
  • [10] A general framework for classifying costing methods for economic evaluation of health care
    Zuzana Špacírová
    David Epstein
    Leticia García-Mochón
    Joan Rovira
    Antonio Olry de Labry Lima
    Jaime Espín
    The European Journal of Health Economics, 2020, 21 : 529 - 542
12345