Error-feedback three-phase optimization to configurable convolutional echo state network for time series forecasting

被引:0
|
作者
Zhang, Xinze [1 ]
He, Kun [2 ]
Sima, Qi [1 ]
Bao, Yukun [1 ]
机构
[1] Huazhong Univ Sci & Technol, Ctr Modern Informat Management, Sch Management, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
关键词
Convolutional echo state network; Error-feedback three-phase optimization; Time series forecasting; NEURAL-NETWORKS;
D O I
10.1016/j.asoc.2024.111715
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series forecasting is critical for many real -world applications. Convolutional echo state networks (CESNs) have shown intriguing time series modeling efficacy by combining convolutional neural network (CNN) and echo state network (ESN). However, current CESN models are tailored for the classification tasks and rely on elaborately designed neural architectures. To this end, we propose a novel configurable convolutional echo state network (CCESN) with an innovative error -feedback three-phase optimization (ETO) strategy for time series forecasting. The network is progressively constructed with heterogeneous modular subnetworks, including ESN, CNN, CESN, and reversed CESN modules. This scheme leverages the complementary feature extraction capabilities of convolutional and recurrent neural architectures. To adaptively evolve the CCESN, we propose a novel error -feedback three-phase optimization (ETO) strategy by selecting optimal subnetwork modules while step -wise tuning parameters. Comprehensive experiments are conducted on representative simulated and real -world datasets. The results indicate that ETO-CCESN can adaptively select and evolve heterogeneous subnetworks to acclimatize to varied scenarios, and thus demonstrate significant performance improvements, achieving a 45.69% average enhancement in forecasting accuracy compared to the existing CESN model, and surpassing the best baseline by 8.79% in terms of symmetric mean absolute percentage error across diverse forecasting tasks.
引用
收藏
页数:14
相关论文
共 38 条
  • [1] Error-feedback stochastic modeling strategy for time series forecasting with convolutional neural networks
    Zhang, Xinze
    He, Kun
    Bao, Yukun
    [J]. Neurocomputing, 2021, 459 : 234 - 248
  • [2] Error-feedback stochastic modeling strategy for time series forecasting with convolutional neural networks
    Zhang, Xinze
    He, Kun
    Bao, Yukun
    [J]. NEUROCOMPUTING, 2021, 459 : 234 - 248
  • [3] Optimizing echo state network with backtracking search optimization algorithm for time series forecasting
    Wang, Zhigang
    Zeng, Yu-Rong
    Wang, Sirui
    Wang, Lin
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2019, 81 : 117 - 132
  • [4] Ridge Polynomial Neural Network with Error Feedback for Time Series Forecasting
    Waheeb, Waddah
    Ghazali, Rozaida
    Herawan, Tutut
    [J]. PLOS ONE, 2016, 11 (12):
  • [5] Adaptive Broad Echo State Network for Nonstationary Time Series Forecasting
    Liu, Wen-Jie
    Bai, Yu-Ting
    Jin, Xue-Bo
    Su, Ting-Li
    Kong, Jian-Lei
    [J]. MATHEMATICS, 2022, 10 (17)
  • [7] Time Series Forecasting Using Ridge Polynomial Neural Network with Error Feedback
    Waheeb, Waddah
    Ghazali, Rozaida
    Herawan, Tutut
    [J]. RECENT ADVANCES ON SOFT COMPUTING AND DATA MINING, 2017, 549 : 189 - 200
  • [8] Spiking Echo State Convolutional Neural Network for Robust Time Series Classification
    Zhang, Anguo
    Zhu, Wei
    Li, Junyu
    [J]. IEEE ACCESS, 2019, 7 : 4927 - 4935
  • [9] Time series forecasting based on echo state network and empirical wavelet transformation
    Gao, Ruobin
    Du, Liang
    Duru, Okan
    Yuen, Kum Fai
    [J]. APPLIED SOFT COMPUTING, 2021, 102
  • [10] Echo state network and classical statistical techniques for time series forecasting: A review
    Cardoso, Fabian Correa
    Berri, Rafael Alceste
    Borges, Eduardo Nunes
    Dalmazo, Bruno Lopes
    Lucca, Giancarlo
    de Mattos, Viviane Leite Dias
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 293