A New Diversity Measure for Classifier Fusion

被引:0
|
作者
Li, Ye [1 ]
Xu, Li [2 ]
Wang, Ya Gang [1 ]
Xu, Xiao Ming [1 ]
机构
[1] Shanghai Univ Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[2] Akita Prefectural Univ, Dept Elect & Informat Syst, Akita 0150055, Japan
来源
关键词
pattern recognition; classifier fusion/combination; ensemble learning; diversity measure; genetic algorithm; majority vote; ENSEMBLES; STATISTICS;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The combination of multiple classifiers is one of the important topics in recent pattern recognition research. It is deemed that the diversity among the classifiers is a key issue in classifier combination. There are different diversity measures presented in the literature. In this paper, we first analyze several measures based on the oracle outputs of base classifiers while majority vote is taken as the combination method. Afterwards, we propose a new measure which overcomes the defects of the diversity measures analyzed. In order to illustrate the effectiveness of the proposed measure, a genetic algorithm based ensemble learning method is designed and compared on some UCI standard datasets to Bagging and Adaboost. The simulation shows that the proposed ensemble learning method gains better generalization performance over Bagging and Adaboost.
引用
收藏
页码:396 / +
页数:2
相关论文
共 50 条
  • [1] A new measure of classifier diversity in multiple classifier system
    Fan, Tie-Gang
    Zhu, Ying
    Chen, Jun-Min
    [J]. PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 18 - +
  • [2] Diversity measure for multiple classifier systems
    Hu, QH
    Yu, DR
    [J]. FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, PT 1, PROCEEDINGS, 2005, 3613 : 1261 - 1265
  • [3] An empirical research of multi-classifier fusion methods and diversity measure in remote sensing classification
    Ma, Hongchao
    Zhou, We
    Dong, Xinyi
    Xu, Honggen
    [J]. FIRST INTERNATIONAL WORKSHOP ON KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2007, : 90 - +
  • [4] A DYNAMIC FUZZY MEASURE FOR MULTIPLE CLASSIFIER FUSION
    Li, Xue-Fei
    Feng, Hui-Min
    Chen, Jun-Fen
    Zhang, Ya-Jing
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 504 - +
  • [5] New measure of classifier dependency in multiple classifier systems
    Ruta, D
    Gabrys, B
    [J]. MULTIPLE CLASSIFIER SYSTEMS, 2002, 2364 : 127 - 136
  • [6] An Updatable Classifier Diversity Measure Based on the ER Rule
    Xu, Cong
    Tang, Shuai-Wen
    He, Wei
    Zhu, Hai-Long
    [J]. NEURAL PROCESSING LETTERS, 2022, 54 (05) : 4247 - 4263
  • [7] An Updatable Classifier Diversity Measure Based on the ER Rule
    Cong Xu
    Shuai-Wen Tang
    Wei He
    Hai-Long Zhu
    [J]. Neural Processing Letters, 2022, 54 : 4247 - 4263
  • [8] Controlling the diversity in classifier ensembles through a measure of agreement
    Zouari, H
    Heutte, L
    Lecourtier, Y
    [J]. PATTERN RECOGNITION, 2005, 38 (11) : 2195 - 2199
  • [9] An Ensemble Classifier Based on Attribute Selection and Diversity Measure
    Shi, Hongbo
    Lv, Yali
    [J]. FIFTH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, VOL 2, PROCEEDINGS, 2008, : 106 - 110
  • [10] A Ranking Distance Based Diversity Measure for Multiple Classifier Systems
    Yang, Yi
    Han, Deqiang
    Dezert, Jean
    [J]. 2018 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND INFORMATION SCIENCES (ICCAIS), 2018, : 55 - 60