Minimal classification method with error-correcting codes for multiclass recognition

被引:2
|
作者
Sivalingam, DM
Pandian, N
Ben-Arie, J [1 ]
机构
[1] Univ Illinois, Machine Vis Labs, ECE Dept, Chicago, IL 60607 USA
[2] Univ Illinois, ECE Dept, Chicago, IL 60607 USA
基金
美国国家科学基金会;
关键词
multiclass recognition; binary classifiers; Minimal Classification Method; Support Vector Machines; object recognition;
D O I
10.1142/S0218001405004241
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we develop an efficient technique to transform a multiclass recognition problem into a minimal binary classification problem using the Minimal Classification Method (MCM). The MCM requires only log(2) N classifications whereas the other methods require much more. For the classification, we use Support Vector Machine (SVM) based binary classifiers since they have superior generalization performance. Unlike the prevalent one-versus-one strategy (the bottom-up one-versus-one strategy is called tournament method) that separates only two classes at each classification, the binary classifiers in our method have to separate two groups of multiple classes. As a result, the probability of generalization error increases. This problem is alleviated by utilizing error correcting codes, which results only in a marginal increase in the required number of classifications. However, in comparison to the tournament method, our method requires only 50% of the classifications and still similar performance can be attained. The proposed solution is tested with the Columbia Object Image Library (COIL). We also test the performance under conditions of noise and occlusion.
引用
收藏
页码:663 / 680
页数:18
相关论文
共 50 条
  • [1] Efficient Decoding of Ternary Error-Correcting Output Codes for Multiclass Classification
    Park, Sang-Hyeun
    Fuernkranz, Johannes
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT II, 2009, 5782 : 189 - 204
  • [2] Optimisation of multiclass supervised classification based on using output codes with error-correcting
    Ryazanov V.V.
    [J]. Pattern Recognition and Image Analysis, 2016, 26 (2) : 262 - 265
  • [3] System Evaluation of Ternary Error-Correcting Output Codes for Multiclass Classification Problems
    Hirasawa, Shigeichi
    Kumoi, Gendo
    Yagi, Hideki
    Kobayashi, Manabu
    Goto, Masayuki
    Sakai, Tetsuya
    Inazumi, Hiroshige
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2893 - 2898
  • [4] Minimal design of error-correcting output codes
    Angel Bautista, Miguel
    Escalera, Sergio
    Baro, Xavier
    Radeva, Petia
    Vitria, Jordi
    Pujol, Oriol
    [J]. PATTERN RECOGNITION LETTERS, 2012, 33 (06) : 693 - 702
  • [5] MINIMAL REDUNDANCY OF BINARY ERROR-CORRECTING CODES
    LEVENSHTEIN, VI
    [J]. INFORMATION AND CONTROL, 1975, 28 (04): : 268 - 291
  • [6] Using SVM and Error-correcting Codes for Multiclass Dialog Act Classification in Meeting Corpus
    Liu, Yang
    [J]. INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1938 - 1941
  • [7] Multiclass Learning for Writer Identification using Error-Correcting Codes
    Porwal, Utkarsh
    Ramaiah, Chetan
    Kumar, Ashish
    Govindaraju, Venu
    [J]. 2014 11TH IAPR INTERNATIONAL WORKSHOP ON DOCUMENT ANALYSIS SYSTEMS (DAS 2014), 2014, : 16 - 20
  • [8] The Horace method for error-correcting codes
    Ballico, Edoardo
    Fontanari, Claudio
    [J]. APPLICABLE ALGEBRA IN ENGINEERING COMMUNICATION AND COMPUTING, 2006, 17 (02) : 135 - 139
  • [9] The Horace Method for Error-Correcting Codes
    Edoardo Ballico
    Claudio Fontanari
    [J]. Applicable Algebra in Engineering, Communication and Computing, 2006, 17 : 135 - 139
  • [10] Binary Error-Correcting Codes with Minimal Noiseless Feedback
    Gupta, Meghal
    Guruswami, Venkatesan
    Zhang, Rachel Yun
    [J]. PROCEEDINGS OF THE 55TH ANNUAL ACM SYMPOSIUM ON THEORY OF COMPUTING, STOC 2023, 2023, : 1475 - 1487