A general framework for the evaluation of symbol recognition methods

被引：15
|
作者：
Valveny, E.
Dosch, P.
Winstanley, Adam
Zhou, Yu
Yang, Su
Yan, Luo
Wenyin, Liu
Elliman, Dave
Delalandre, Mathieu
Trupin, Eric
Adam, Sebastien
Ogier, Jean-Marc
机构：
[1] Ctr Vis Comp, Barcelona 08193, Spain
[2] LORIA, F-54602 Villers Les Nancy, France
[3] Natl Univ Ireland, Maynooth, Kildare, Ireland
[4] Fudan Univ, Dept Comp Sci & Engn, Shanghai 200433, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[6] Univ Nottingham, Nottingham NG7 2RD, England
[7] Univ Rouen, LITIS Lab, Rouen, France
[8] La Rochelle Univ, L3i Lab, Rochelle, France
来源：
INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION | 2007年 / 9卷 / 01期
关键词：
performance evaluation; symbol recognition;
D O I：
10.1007/s10032-006-0033-x
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Performance evaluation is receiving increasing interest in graphics recognition. In this paper, we discuss some questions regarding the definition of a general framework for evaluation of symbol recognition methods. The discussion is centered on three key elements in performance evaluation: test data, evaluation metrics and protocols of evaluation. As a result of this discussion we state some general principles to be taken into account for the definition of such a framework. Finally, we describe the application of this framework to the organization of the first contest on symbol recognition in GREC'03, along with the results obtained by the participants.
引用
收藏
页码：59 / 74
页数：16
相关论文
共 50 条
  • [31] IRVR: A General Image Restoration Framework for Visual Recognition
    Yang, Zizheng
    Huang, Jie
    Zhou, Man
    Zheng, Naishan
    Zhao, Feng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7012 - 7026
  • [32] A general framework of feature extraction: Application to speaker recognition
    Liu, CS
    1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 669 - 672
  • [33] An evaluation of methods for arabic character recognition
    Lawgali, A., 1600, Science and Engineering Research Support Society (07):
  • [34] Table recognition evaluation and combination methods
    Kboubi, F
    Chabi, AH
    Ben Ahmed, M
    EIGHTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS 1 AND 2, PROCEEDINGS, 2005, : 1237 - 1241
  • [35] A demonstration of handprinted symbol recognition
    Parker, JR
    Pivovarov, J
    EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, 2001, : 740 - 740
  • [36] Public participation methods: A framework for evaluation
    Rowe, G
    Frewer, LJ
    SCIENCE TECHNOLOGY & HUMAN VALUES, 2000, 25 (01) : 3 - 29
  • [37] GENERAL METHODS OF CORROSION EVALUATION.
    Dean, Sheldon W.
    Standardization News, 1986, 14 (03): : 40 - 44
  • [38] A performance evaluation protocol for symbol spotting systems in terms of recognition and location indices
    Rusinol, Marcal
    Llados, Josep
    INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION, 2009, 12 (02) : 83 - 96
  • [39] A performance evaluation protocol for symbol spotting systems in terms of recognition and location indices
    Marçal Rusiñol
    Josep Lladós
    International Journal on Document Analysis and Recognition (IJDAR), 2009, 12 : 83 - 96
  • [40] A framework for performance evaluation of face recognition algorithms
    Black, JA
    Gargesha, M
    Kahol, K
    Kuchi, P
    Panchanathan, S
    INTERNET MULTIMEDIA MANAGEMENT SYSTEMS III, 2002, 4862 : 163 - 174
12345