An Adaptive Learning Time Series Forecasting Model Based on Decoder Framework

被引:0
|
作者
Hao, Jianlong [1 ]
Sun, Qiwei [1 ]
机构
[1] Shanxi Univ Finance & Econ, Sch Informat, Taiyuan 030006, Peoples R China
关键词
time series forecasting; Transformer; decoder-only; concept drift; low-rank decomposition;
D O I
10.3390/math13030490
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Time series forecasting constitutes a fundamental technique for analyzing dynamic alterations within temporal datasets and predicting future trends in various domains. Nevertheless, achieving effective modeling faces challenges arising from complex factors such as accurately capturing the relationships among temporally distant data points and accommodating rapid shifts in data distributions over time. While Transformer-based models have demonstrated remarkable capabilities in handling long-range dependencies recently, directly applying them to address the evolving distributions within temporal datasets remains a challenging task. To tackle these issues, this paper presents an innovative sequence-to-sequence adaptive learning approach centered on decoder framework for addressing temporal modeling tasks. An end-to-end deep learning architecture-based Transformer decoding framework is introduced, which is capable of adaptively discerning the interdependencies within temporal datasets. Experiments carried out on multiple datasets indicate that the time series adaptive learning model based on the decoder achieved an overall reduction of 2.6% in MSE (Mean Squared Error) loss and 1.8% in MAE (Mean Absolute Error) loss when compared with the most advanced Transformer-based time series forecasting model.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Fast and Adaptive Cointegration Based Model for Forecasting High Frequency Financial Time Series
    Paola Arce
    Jonathan Antognini
    Werner Kristjanpoller
    Luis Salinas
    Computational Economics, 2019, 54 : 99 - 112
  • [22] ARIMA Based Time Series Forecasting Model
    Xue, Dong-mei
    Hua, Zhi-qiang
    RECENT ADVANCES IN ELECTRICAL & ELECTRONIC ENGINEERING, 2016, 9 (02) : 93 - 98
  • [23] SHARE: A Distributed Learning Framework For Multivariate Time-Series Forecasting
    Yet, Wei
    Khandurit, Prashant
    Pengt, Jiangweizhi
    Tiant, Feng
    Gao, Jun
    Dingt, Jie
    Zhi-Li Zhangt
    Hongt, Mingyi
    2024 IEEE 25TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS, SPAWC 2024, 2024, : 76 - 80
  • [24] Deep learning-based time series forecasting
    Song, Xiaobao
    Deng, Liwei
    Wang, Hao
    Zhang, Yaoan
    He, Yuxin
    Cao, Wenming
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 58 (01)
  • [25] Adaptive learning-based time series prediction framework for building energy management
    Schachinger, Daniel
    Pannosch, Juergen
    Kastner, Wolfgang
    2018 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ELECTRONICS FOR SUSTAINABLE ENERGY SYSTEMS (IESES), 2018, : 453 - 458
  • [26] Deep Learning Ensemble Based Model for Time Series Forecasting Across Multiple Applications
    Okwuchi, Ifeanyi
    Nassar, Lobna
    Karray, Fakhri
    Ponnambalam, Kumaraswamy
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3077 - 3083
  • [27] Financial Time Series Forecasting with the Deep Learning Ensemble Model
    He, Kaijian
    Yang, Qian
    Ji, Lei
    Pan, Jingcheng
    Zou, Yingchao
    MATHEMATICS, 2023, 11 (04)
  • [28] Frequency-based ensemble forecasting model for time series forecasting
    Saeed, Waddah
    COMPUTATIONAL & APPLIED MATHEMATICS, 2022, 41 (02):
  • [29] Frequency-based ensemble forecasting model for time series forecasting
    Waddah Saeed
    Computational and Applied Mathematics, 2022, 41
  • [30] Adaptive GA-based AR-Hidden Markov Model for Time Series Forecasting
    Toriyama, Naoki
    Ono, Keiko
    Orito, Yukiko
    2017 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2017, : 665 - 672