The extreme learning machine learning algorithm with tunable activation function

被引:44
|
作者
Li, Bin [1 ,2 ]
Li, Yibin [1 ]
Rong, Xuewen [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Polytech Univ, Sch Sci, Jinan 250353, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2013年 / 22卷 / 3-4期
关键词
Extreme learning machine; Single hidden layer feed-forward neural networks; Tunable activation function; Differential evolution algorithm; APPROXIMATION; NETWORK;
D O I
10.1007/s00521-012-0858-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose an extreme learning machine (ELM) with tunable activation function (TAF-ELM) learning algorithm, which determines its activation functions dynamically by means of the differential evolution algorithm based on the input data. The main objective is to overcome the problem dependence of fixed slop of the activation function in ELM. We mainly considered the issue of processing of benchmark problems on function approximation and pattern classification. Compared with ELM and E-ELM learning algorithms with the same network size or compact network configuration, the proposed algorithm has improved generalization performance with good accuracy. In addition, the proposed algorithm also has very good performance in the TAF neural networks learning algorithms.
引用
收藏
页码:531 / 539
页数:9
相关论文
共 50 条
  • [1] The extreme learning machine learning algorithm with tunable activation function
    Bin Li
    Yibin Li
    Xuewen Rong
    [J]. Neural Computing and Applications, 2013, 22 : 531 - 539
  • [2] Regularization Activation Function for Extreme Learning Machine
    Ismail, Noraini
    Othman, Zulaiha Ali
    Samsudin, Noor Azah
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (03) : 240 - 247
  • [3] Extreme Learning Machine With Affine Transformation Inputs in an Activation Function
    Cao, Jiuwen
    Zhang, Kai
    Yong, Hongwei
    Lai, Xiaoping
    Chen, Badong
    Lin, Zhiping
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) : 2093 - 2107
  • [4] A Kind of Extreme Learning Machine Based on Memristor Activation Function
    Li, Hanman
    Wang, Lidan
    Duan, ShuKai
    [J]. PROCEEDINGS OF ELM-2017, 2019, 10 : 210 - 218
  • [5] A fast learning algorithm of neural network with tunable activation function
    Yanjun Shen
    Bingwen Wang
    [J]. Science in China Series F: Information Sciences, 2004, 47 : 126 - 136
  • [7] A fast learning algorithm of neural network with tunable activation function
    Shen, YJ
    Wang, BW
    [J]. SCIENCE IN CHINA SERIES F-INFORMATION SCIENCES, 2004, 47 (01): : 126 - 136
  • [8] A new learning algorithm for function approximation incorporating a priori information into extreme learning machine
    Han, Fei
    Lok, Tat-Ming
    Lyu, Michael R.
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 631 - 636
  • [9] An Adaptive Learning Algorithm for Regularized Extreme Learning Machine
    Zhang, Yuao
    Wu, Qingbiao
    Hu, Jueliang
    [J]. IEEE ACCESS, 2021, 9 : 20736 - 20745
  • [10] A Pruning Algorithm for Extreme Learning Machine
    Li Ying
    Li Fan-jun
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2013, 2013, 8206 : 1 - 7