An empirical comparison of ensemble classification algorithms with support vector machines

被引:0
|
作者
Hu, ZH [1 ]
Li, YG [1 ]
Cai, YZ [1 ]
Xu, XM [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200030, Peoples R China
关键词
ensemble classification; boosting; bagging; support vector machines;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An ensemble classifier often has better performance than any of the single learned classifiers in the ensemble. In this paper, the trained support vector machine (SVM) classifiers are used as basic classifiers. The ensemble methods for creating ensemble classifier, such as Bagging and Boosting, etc., are evaluated on two data sets. Some conclusions are obtained. Bagging with SVM can stably improve classification accuracy, while the improvement obtained by Boosting with SVM is not obvious. These two methods largely increase space complexity and time complexity. Comparatively, the multiple SVM decision model, training individual SVM classifiers using training subsets obtained by partitioning the original training set, has a better trade-off between the classification accuracy and efficiency.
引用
收藏
页码:3520 / 3523
页数:4
相关论文
共 50 条
  • [1] A comparison of support vector machines ensemble for classification
    He, Ling-Min
    Yang, Xiao-Bing
    Lu, Hui-Juan
    [J]. PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 3613 - 3617
  • [2] Ensemble of Support Vector Machines for Heartbeat Classification
    Huang, Huifang
    Hu, Guangshu
    LiZhu
    [J]. 2010 IEEE 10TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS (ICSP2010), VOLS I-III, 2010, : 1327 - 1330
  • [3] Ensemble of support vector machines for land cover classification
    Pal, M.
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2008, 29 (10) : 3043 - 3049
  • [4] Ensemble approaches of support vector machines for multiclass classification
    Min, Jun-Ki
    Hong, Jin-Hyuk
    Cho, Sung-Bae
    [J]. PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PROCEEDINGS, 2007, 4815 : 1 - 10
  • [5] Stochastic Optimization Algorithms for Support Vector Machines Classification
    Bartkute-Norkuniene, Vaida
    [J]. INFORMATICA, 2009, 20 (02) : 173 - 186
  • [6] Support Vector Machines Ensemble Based on Choquet Integral for Classification
    Chen Pu
    Zhang Dayong
    Jiang Zhenhuan
    [J]. 2011 INTERNATIONAL CONFERENCE ON COMPUTER, ELECTRICAL, AND SYSTEMS SCIENCES, AND ENGINEERING (CESSE 2011), 2011, : 55 - +
  • [7] Novel algorithm for constructing support vector machines classification ensemble
    Chen, Pu
    Zhang, Dayong
    Jiang, Zhenhuan
    Wu, Chong
    [J]. Journal of Computational Information Systems, 2011, 7 (13): : 4890 - 4897
  • [8] Support vector machines ensemble based on fuzzy integral for classification
    Yan, Genting
    Ma, Guangfu
    Zhu, Liangkuan
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 974 - 980
  • [9] Selective Ensemble Algorithms of Support Vector Machines Based on Constraint Projection
    Wang, Lei
    Yang, Yong
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 2, PROCEEDINGS, 2009, 5552 : 287 - +
  • [10] Genetic algorithms and support vector machines for time series classification
    Eads, D
    Hill, D
    Davis, S
    Perkins, S
    Ma, JS
    Porter, R
    Theiler, J
    [J]. APPLICATIONS AND SCIENCE OF NEURAL NETWORKS, FUZZY SYSTEMS, AND EVOLUTIONARY COMPUTATION V, 2002, 4787 : 74 - 85