A general framework for the evaluation of symbol recognition methods

被引：15
|
作者：
Valveny, E.
Dosch, P.
Winstanley, Adam
Zhou, Yu
Yang, Su
Yan, Luo
Wenyin, Liu
Elliman, Dave
Delalandre, Mathieu
Trupin, Eric
Adam, Sebastien
Ogier, Jean-Marc
机构：
[1] Ctr Vis Comp, Barcelona 08193, Spain
[2] LORIA, F-54602 Villers Les Nancy, France
[3] Natl Univ Ireland, Maynooth, Kildare, Ireland
[4] Fudan Univ, Dept Comp Sci & Engn, Shanghai 200433, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[6] Univ Nottingham, Nottingham NG7 2RD, England
[7] Univ Rouen, LITIS Lab, Rouen, France
[8] La Rochelle Univ, L3i Lab, Rochelle, France
来源：
INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION | 2007年 / 9卷 / 01期
关键词：
performance evaluation; symbol recognition;
D O I：
10.1007/s10032-006-0033-x
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Performance evaluation is receiving increasing interest in graphics recognition. In this paper, we discuss some questions regarding the definition of a general framework for evaluation of symbol recognition methods. The discussion is centered on three key elements in performance evaluation: test data, evaluation metrics and protocols of evaluation. As a result of this discussion we state some general principles to be taken into account for the definition of such a framework. Finally, we describe the application of this framework to the organization of the first contest on symbol recognition in GREC'03, along with the results obtained by the participants.
引用
收藏
页码：59 / 74
页数：16
相关论文
共 50 条
  • [21] ON PROPERTIES OF SYMBOL RECOGNITION
    BARABASH, YL
    ENGINEERING CYBERNETICS, 1965, (05): : 71 - &
  • [22] General methods and development actuality of gait recognition
    Li, Yi-Bo
    Jiang, Tian-Xiao
    Qiao, Zhi-Hua
    Qian, Hong-Juan
    2007 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1-4, PROCEEDINGS, 2007, : 1333 - 1340
  • [23] A General Evaluation Framework for Topical Crawlers
    P. Srinivasan
    F. Menczer
    G. Pant
    Information Retrieval, 2005, 8 : 417 - 447
  • [24] Generation of synthetic documents for performance evaluation of symbol recognition & spotting systems
    Mathieu Delalandre
    Ernest Valveny
    Tony Pridmore
    Dimosthenis Karatzas
    International Journal on Document Analysis and Recognition (IJDAR), 2010, 13 : 187 - 207
  • [25] Generation of synthetic documents for performance evaluation of symbol recognition & spotting systems
    Delalandre, Mathieu
    Valveny, Ernest
    Pridmore, Tony
    Karatzas, Dimosthenis
    INTERNATIONAL JOURNAL ON DOCUMENT ANALYSIS AND RECOGNITION, 2010, 13 (03) : 187 - 207
  • [26] Hammer: A General Blockchain Evaluation Framework
    Wang, Gang
    Zhang, Yanfeng
    Ying, Chenhao
    Li, Xiaohua
    Yu, Ge
    2024 IEEE 44TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, ICDCS 2024, 2024, : 391 - 402
  • [27] A general evaluation framework for topical crawlers
    Srinivasan, P
    Menczer, F
    Pant, G
    INFORMATION RETRIEVAL, 2005, 8 (03): : 417 - 447
  • [28] Multi-subject human activities: A survey of recognition and evaluation methods based on a formal framework
    Arrotta, Luca
    Civitarese, Gabriele
    Chen, Xi
    Cumin, Julien
    Bettini, Claudio
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 267
  • [29] General framework of continuation methods for complementarity problems
    Kojima, Masakazu
    Megiddo, Nimrod
    Mizuno, Shinji
    Mathematics of Operations Research, 1993, 18 (04)
  • [30] Instance GNN: A Learning Framework for Joint Symbol Segmentation and Recognition in Online Handwritten Diagrams
    Yun, Xiao-Long
    Zhang, Yan-Ming
    Yin, Fei
    Liu, Cheng-Lin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2580 - 2594
12345