A selective ensemble learning approach based on evolutionary algorithm

被引:6
|
作者
Zhang, Yong [1 ,2 ]
Liu, Bo [1 ]
Yu, Jiaxin [1 ]
机构
[1] Liaoning Normal Univ, Sch Comp & Informat Technol, 1 Liushu South St, Dalian 116081, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Extreme learning machine; evolutionary algorithm; ensemble learning; classification; DIFFERENTIAL EVOLUTION; MACHINE; OPTIMIZATION;
D O I
10.3233/JIFS-16332
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an evolutionary-based selective ensemble learning framework for solving classification problem. In the proposed ensemble learning framework, extreme learning machine (ELM) is selected as base learner and evolutionary algorithms are employed to optimize the weights of base learners in the ensemble. Then, some base learners, that their weights are larger than the threshold, are selected for making decision. The proposed ensemble learning framework is evaluated on 20 benchmark data sets from KEEL repository through four different evolutionary algorithms. Results show that the proposed evolutionary-based ensemble learning framework outperforms the simple voting based ensemble method in terms of classification performance. In four evolutionary optimization algorithms, PSOGA-based and DE-based weight optimization algorithms can effectively improve the classification accuracy and generalization ability.
引用
收藏
页码:2365 / 2373
页数:9
相关论文
共 50 条
  • [1] Parallel learning evolutionary algorithm based on neural network ensemble
    Xiao, Sha
    Yu, Dong
    Li, Yibin
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 70 - 74
  • [2] Virus-evolutionary Genetic Algorithm Based Selective Ensemble for Steganalysis
    Di Fuqiang
    Zhang Minqing
    Liu Jia
    [J]. 2014 NINTH INTERNATIONAL CONFERENCE ON P2P, PARALLEL, GRID, CLOUD AND INTERNET COMPUTING (3PGCIC), 2014, : 553 - 558
  • [3] Improved ensemble learning classification based surrogate-assisted evolutionary algorithm
    Gu, Qing-Hua
    Zhang, Xiao-Yue
    Chen, Lu
    [J]. Kongzhi yu Juece/Control and Decision, 2022, 37 (10): : 2456 - 2466
  • [4] Virus-Evolutionary Genetic Algorithm Based Selective Ensemble Classifier for Pedestrian Detection
    Ning, B.
    Cao, X. B.
    Xu, Y. W.
    Zhang, J.
    [J]. WORLD SUMMIT ON GENETIC AND EVOLUTIONARY COMPUTATION (GEC 09), 2009, : 437 - 442
  • [5] Selective Ensemble Learning Algorithm for Imbalanced Dataset
    Du, Hongle
    Zhang, Yan
    Zhang, Lin
    Chen, Yeh-Cheng
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2023, 20 (02) : 831 - 856
  • [6] A selective ensemble learning algorithm for imbalanced dataset
    Hongle, Du
    Yan, Zhang
    Gang, Ke
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021,
  • [7] A selective evolutionary heterogeneous ensemble algorithm for classifying imbalanced data
    An, Xiaomeng
    Xu, Sen
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2023, 31 (05): : 2733 - 2757
  • [8] Fault Diagnosis of Gearbox by Selective Ensemble Learning Based on Artificial Immune Algorithm
    Liu, Tianyu
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2016, : 460 - 464
  • [9] A Genetic Algorithm Based Clustering Ensemble Approach to Learning Relational Databases
    Alfred, Rayner
    Chiye, Gabriel Jong
    Obit, Joe Henry
    Hijazi, Mohd Hanafi Ahmad
    Chin, Kim On
    Lau, HuiKeng
    [J]. ADVANCED SCIENCE LETTERS, 2015, 21 (10) : 3313 - 3317
  • [10] An Evolutionary Algorithm Based Optimization of Neural Ensemble Classifiers
    Chiu, Chien-Yuan
    Verma, Brijesh
    [J]. NEURAL INFORMATION PROCESSING, PT III, 2011, 7064 : 292 - 298