A general framework for the evaluation of symbol recognition methods

被引:15
|
作者
Valveny, E.
Dosch, P.
Winstanley, Adam
Zhou, Yu
Yang, Su
Yan, Luo
Wenyin, Liu
Elliman, Dave
Delalandre, Mathieu
Trupin, Eric
Adam, Sebastien
Ogier, Jean-Marc
机构
[1] Ctr Vis Comp, Barcelona 08193, Spain
[2] LORIA, F-54602 Villers Les Nancy, France
[3] Natl Univ Ireland, Maynooth, Kildare, Ireland
[4] Fudan Univ, Dept Comp Sci & Engn, Shanghai 200433, Peoples R China
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[6] Univ Nottingham, Nottingham NG7 2RD, England
[7] Univ Rouen, LITIS Lab, Rouen, France
[8] La Rochelle Univ, L3i Lab, Rochelle, France
关键词
performance evaluation; symbol recognition;
D O I
10.1007/s10032-006-0033-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Performance evaluation is receiving increasing interest in graphics recognition. In this paper, we discuss some questions regarding the definition of a general framework for evaluation of symbol recognition methods. The discussion is centered on three key elements in performance evaluation: test data, evaluation metrics and protocols of evaluation. As a result of this discussion we state some general principles to be taken into account for the definition of such a framework. Finally, we describe the application of this framework to the organization of the first contest on symbol recognition in GREC'03, along with the results obtained by the participants.
引用
收藏
页码:59 / 74
页数:16
相关论文
共 50 条
  • [41] Vector templates for symbol recognition
    Parker, JR
    Pivovarov, J
    Royko, D
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 602 - 605
  • [42] ORIENTATION AND TACTILE SYMBOL RECOGNITION
    HELLER, MA
    PERCEPTUAL AND MOTOR SKILLS, 1981, 53 (02) : 394 - 394
  • [43] A Framework to Evaluate Fusion Methods for Multimodal Emotion Recognition
    Pena, Diego
    Aguilera, Ana
    Dongo, Irvin
    Heredia, Juanpablo
    Cardinale, Yudith
    IEEE ACCESS, 2023, 11 : 10218 - 10237
  • [44] Symbol recognition using graphs
    Lladós, J
    Sánchez, G
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 2, PROCEEDINGS, 2003, : 49 - 52
  • [45] SYMBOL RECOGNITION IN SCIENTIFIC COMMUNICATION
    DAVIS, WV
    HESTER, WR
    HAGEN, DH
    HARTLEY, JL
    JOURNAL OF DENTAL RESEARCH, 1961, 40 (04) : 759 - &
  • [46] HANDPRINTED SYMBOL RECOGNITION SYSTEM
    BROWN, RM
    FAY, TH
    WALKER, CL
    PATTERN RECOGNITION, 1988, 21 (02) : 91 - 118
  • [47] On the Scalability of Graphic Symbol Recognition
    Salmon, Jean-Pierre
    Wendling, Laurent
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 533 - 537
  • [48] Graphic symbol recognition: An overview
    Chhabra, AK
    GRAPHICS RECOGNITION: ALGORITHMS AND SYSTEMS, 1998, 1389 : 68 - 79
  • [49] Symbol recognition contest: A synthesis
    Valveny, E
    Dosch, P
    GRAPHICS RECOGNITION: RECENT ADVANCES AND PERSPECTIVES, 2004, 3088 : 368 - 385
  • [50] A General Framework for the Evaluation of Clinical Trial Quality
    Berger, Vance W.
    Alperson, Sunny Y.
    REVIEWS ON RECENT CLINICAL TRIALS, 2009, 4 (02) : 79 - 88