An Adaptive Learning Time Series Forecasting Model Based on Decoder Framework

被引:0
|
作者
Hao, Jianlong [1 ]
Sun, Qiwei [1 ]
机构
[1] Shanxi Univ Finance & Econ, Sch Informat, Taiyuan 030006, Peoples R China
关键词
time series forecasting; Transformer; decoder-only; concept drift; low-rank decomposition;
D O I
10.3390/math13030490
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Time series forecasting constitutes a fundamental technique for analyzing dynamic alterations within temporal datasets and predicting future trends in various domains. Nevertheless, achieving effective modeling faces challenges arising from complex factors such as accurately capturing the relationships among temporally distant data points and accommodating rapid shifts in data distributions over time. While Transformer-based models have demonstrated remarkable capabilities in handling long-range dependencies recently, directly applying them to address the evolving distributions within temporal datasets remains a challenging task. To tackle these issues, this paper presents an innovative sequence-to-sequence adaptive learning approach centered on decoder framework for addressing temporal modeling tasks. An end-to-end deep learning architecture-based Transformer decoding framework is introduced, which is capable of adaptively discerning the interdependencies within temporal datasets. Experiments carried out on multiple datasets indicate that the time series adaptive learning model based on the decoder achieved an overall reduction of 2.6% in MSE (Mean Squared Error) loss and 1.8% in MAE (Mean Absolute Error) loss when compared with the most advanced Transformer-based time series forecasting model.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] A new adaptive grey seasonal model for time series forecasting tasks
    Wang, Ran
    Xu, Yunbao
    Yang, Qinwen
    GREY SYSTEMS-THEORY AND APPLICATION, 2024, 14 (02) : 360 - 373
  • [32] SVR-Wavelet Adaptive Model for Forecasting Financial Time Series
    Raimundo, Milton Saulo
    Okamoto, Jun, Jr.
    CONFERENCE PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMPUTER TECHNOLOGIES (ICICT), 2018, : 111 - 114
  • [33] SimpleTS: An Efficient and Universal Model Selection Framework for Time Series Forecasting
    Yao, Yuanyuan
    Li, Dimeng
    Jie, Hailiang
    Chen, Lu
    Li, Tianyi
    Chen, Jie
    Wang, Jiaqi
    Li, Feifei
    Gao, Yunjun
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (12): : 3741 - 3753
  • [34] An adaptive selection decomposition hybrid model for stock time series forecasting
    Ge, Shuhan
    Lin, Aijing
    NONLINEAR DYNAMICS, 2024, : 4647 - 4669
  • [35] A multiset based forecasting model for fuzzy time series
    Vamitha, V.
    Rajaram, S.
    HACETTEPE JOURNAL OF MATHEMATICS AND STATISTICS, 2015, 44 (04): : 965 - 973
  • [36] A Set of Time Series Forecasting Model Based on the Difference
    Feng, Hao
    Wang, Hongxu
    Yin, Chengguo
    Lu, Xiaoli
    Fu, Xiaofang
    PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELING AND SIMULATION (AMMS 2017), 2017, 153 : 132 - 134
  • [37] Adaptive Time Series Forecasting Model with Associate Rules From Time Series Application to Business and Financial
    Deekumpa, Pornsak
    Chanjarean, Itsared
    Audjai, Kissana
    2017 INTERNATIONAL CONFERENCE ON DIGITAL ARTS, MEDIA AND TECHNOLOGY (ICDAMT): DIGITAL ECONOMY FOR SUSTAINABLE GROWTH, 2017, : 320 - 324
  • [38] A Dilated Convolutional Based Model for Time Series Forecasting
    Mishra K.
    Basu S.
    Maulik U.
    SN Computer Science, 2021, 2 (2)
  • [39] Few-shot time series forecasting in a meta-learning framework
    Ma P.
    Ni Z.
    Ma, Ping (1533321767@qq.com), 1600, IOS Press BV (46): : 8903 - 8916
  • [40] Learning and integration of adaptive hybrid graph structures for multivariate time series forecasting
    Guo, Ting
    Hou, Feng
    Pang, Yan
    Jia, Xiaoyun
    Wang, Zhongwei
    Wang, Ruili
    INFORMATION SCIENCES, 2023, 648