Parameter Optimization in a Leaky Integrator Echo State Network with an Improved Gravitational Search Algorithm

被引:3
|
作者
Lun, Shuxian [1 ]
Zhang, Zhenqian [1 ]
Li, Ming [1 ]
Lu, Xiaodong [2 ]
机构
[1] Bohai Univ, Sch Control Sci & Engn, Jinzhou 121013, Peoples R China
[2] Suqian Univ, Sch Informat Engn, Suqian 223800, Peoples R China
基金
中国国家自然科学基金;
关键词
leaky integrator echo state network (leaky-ESN); gravitational search algorithm (GSA); differential mutation; time series prediction;
D O I
10.3390/math11061514
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In the prediction of a nonlinear time series based on a leaky integrator echo state network (leaky-ESN), building a reservoir related to the specific problem is a key step. For problems such as poor performance of randomly generated reservoirs, it is tough to determine the parameter values of the reservoirs. The work in this paper uses the gravitational search algorithm (GSA) to optimize the global parameters of a leaky-ESN, such as the leaking rate, the spectral radius, and the input scaling factor. The basic GSA has some problems, such as slow convergence and poor balance between exploration and exploitation, and it cannot solve some complex optimization problems well. To solve these problems, an improved gravitational search algorithm (IGSA) is proposed in this paper. First, the best agent and elite agents were archived and utilized to accelerate the exploration phase and improve the convergence rate in the exploitation phase. Second, to improve the effect of the poor fitness agents on the optimization result, a differential mutation strategy was proposed, which generated new individuals to replace original agents with worse fitness, increasing the diversity of the population and improving the global optimization ability of the algorithm. Finally, two simulation experiments showed that the leaky-ESN optimized by the IGSA had better prediction accuracy.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] The modified sufficient conditions for echo state property and parameter optimization of leaky integrator echo state network
    Lun, Shu-xian
    Hu, Hai-feng
    Yao, Xian-shuang
    [J]. APPLIED SOFT COMPUTING, 2019, 77 : 750 - 760
  • [2] Optimization and applications of echo state networks with leaky-integrator neurons
    Jaegera, Herbert
    Lukosevicius, Mantas
    Popovici, Dan
    Siewert, Udo
    [J]. NEURAL NETWORKS, 2007, 20 (03) : 335 - 352
  • [3] Parameters Relation of the Leaky Integrator Echo State Network for Time Series
    Qi, Hongyun
    Lun, Shuxian
    [J]. 2015 CHINESE AUTOMATION CONGRESS (CAC), 2015, : 782 - 786
  • [4] Parameters Selection Method of the Leaky Integrator Echo State Network for Time Series
    Yao, Xianshuang
    Lun, Shuxian
    [J]. 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS AND CONTROL (ICMC), 2014, : 1288 - 1293
  • [5] Echo State Network prediction based on Backtracking Search Optimization Algorithm
    Wu, Shihong
    Wang, Zhigang
    Ling, Darong
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 661 - 664
  • [6] An Improved Gravitational Search Algorithm for Optimization Problems
    Li, Wei
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 2605 - 2608
  • [7] An improved gravitational search algorithm for global optimization
    Yu Xiaobing
    Yu Xianrui
    Chen Hong
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 37 (04) : 5039 - 5047
  • [8] A novel model of leaky integrator echo state network for time-series prediction
    Lun, Shu-Xian
    Yao, Xian-Shuang
    Qi, Hong-Yun
    Hu, Hai-Feng
    [J]. NEUROCOMPUTING, 2015, 159 : 58 - 66
  • [9] A Fast Parametric and Structural Transfer Leaky Integrator Echo State Network for Reservoir Computing
    Lin, Jiawei
    Chung, Fu-Lai
    Wang, Shitong
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (05): : 3257 - 3269
  • [10] Chaotic System Parameter Estimation with Improved Gravitational Search Algorithm
    Wang, Jiarong
    Huang, Yu
    Liang, Weiping
    [J]. INDUSTRIAL ENGINEERING, MACHINE DESIGN AND AUTOMATION (IEMDA 2014) & COMPUTER SCIENCE AND APPLICATION (CCSA 2014), 2015, : 374 - 379