Self-adaptive extreme learning machine

被引:125
|
作者
Wang, Gai-Ge [1 ,2 ,3 ]
Lu, Mei [1 ]
Dong, Yong-Quan [1 ]
Zhao, Xiang-Jun [1 ]
机构
[1] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[2] NE Normal Univ, Inst Algorithm & Big Data Anal, Changchun 130117, Peoples R China
[3] NE Normal Univ, Sch Comp Sci & Informat Technol, Changchun 130117, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2016年 / 27卷 / 02期
基金
中国国家自然科学基金;
关键词
Classification; Self-adaptive; Extreme learning machine; Back propagation; General regression neural network; KRILL HERD ALGORITHM; BIOGEOGRAPHY-BASED OPTIMIZATION; PARTICLE SWARM OPTIMIZATION; FIREFLY ALGORITHM; HARMONY SEARCH; BAT ALGORITHM; EVOLUTIONARY;
D O I
10.1007/s00521-015-1874-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to overcome the disadvantage of the traditional algorithm for SLFN (single-hidden layer feedforward neural network), an improved algorithm for SLFN, called extreme learning machine (ELM), is proposed by Huang et al. However, ELMis sensitive to the neuron number in hidden layer and its selection is a difficult-to-solve problem. In this paper, a self-adaptive mechanism is introduced into the ELM. Herein, a new variant of ELM, called self-adaptive extreme learning machine (SaELM), is proposed. SaELM is a self-adaptive learning algorithm that can always select the best neuron number in hidden layer to form the neural networks. There is no need to adjust any parameters in the training process. In order to prove the performance of the SaELM, it is used to solve the Italian wine and iris classification problems. Through the comparisons between SaELM and the traditional back propagation, basic ELM and general regression neural network, the results have proven that SaELM has a faster learning speed and better generalization performance when solving the classification problem.
引用
收藏
页码:291 / 303
页数:13
相关论文
共 50 条
  • [1] Self-adaptive extreme learning machine
    Gai-Ge Wang
    Mei Lu
    Yong-Quan Dong
    Xiang-Jun Zhao
    [J]. Neural Computing and Applications, 2016, 27 : 291 - 303
  • [2] Self-Adaptive Evolutionary Extreme Learning Machine
    Jiuwen Cao
    Zhiping Lin
    Guang-Bin Huang
    [J]. Neural Processing Letters, 2012, 36 : 285 - 305
  • [3] Self-Adaptive Evolutionary Extreme Learning Machine
    Cao, Jiuwen
    Lin, Zhiping
    Huang, Guang-Bin
    [J]. NEURAL PROCESSING LETTERS, 2012, 36 (03) : 285 - 305
  • [4] A self-adaptive evolutionary weighted extreme learning machine for binary imbalance learning
    Tang X.
    Chen L.
    [J]. Progress in Artificial Intelligence, 2018, 7 (2) : 95 - 118
  • [5] Self-Adaptive Hybrid Extreme Learning Machine for Heterogeneous Neural Networks
    Christou, Vasileios
    Ntritsos, Georgios
    Tzallas, Alexandros T.
    Tsipouras, Markos G.
    Giannakeas, Nikolaos
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Self-adaptive Weighted Extreme Learning Machine for Imbalanced Classification Problems
    Long, Hao
    He, Yulin
    Huang, Joshua Zhexue
    Wang, Qiang
    [J]. TRENDS AND APPLICATIONS IN KNOWLEDGE DISCOVERY AND DATA MINING, 2017, 2017, 10526 : 116 - 128
  • [7] Rational and self-adaptive evolutionary extreme learning machine for electricity price forecast
    Xiao, Chixin
    Dong, Zhaoyang
    Xu, Yan
    Meng, Ke
    Zhou, Xun
    Zhang, Xin
    [J]. MEMETIC COMPUTING, 2016, 8 (03) : 223 - 233
  • [8] Rational and self-adaptive evolutionary extreme learning machine for electricity price forecast
    Chixin Xiao
    Zhaoyang Dong
    Yan Xu
    Ke Meng
    Xun Zhou
    Xin Zhang
    [J]. Memetic Computing, 2016, 8 : 223 - 233
  • [9] Self-adaptive Differential Evolution Extreme Learning Machine for the Classification of Hyperspectral Images
    Ku, Junhua
    Cai, Zhihua
    Yang, Xiuying
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS, CONTROL AND ELECTRONIC ENGINEERING, 2014, 113 : 709 - 713
  • [10] Intrusion Detection Based on Self-adaptive Differential Evolutionary Extreme Learning Machine
    Ku, Junhua
    Yun, Dawei
    Zheng, Bing
    [J]. 2017 INTERNATIONAL CONFERENCE ON COMPUTER NETWORK, ELECTRONIC AND AUTOMATION (ICCNEA), 2017, : 94 - 100