An Adaptive Learning Time Series Forecasting Model Based on Decoder Framework

被引:0
|
作者
Hao, Jianlong [1 ]
Sun, Qiwei [1 ]
机构
[1] Shanxi Univ Finance & Econ, Sch Informat, Taiyuan 030006, Peoples R China
关键词
time series forecasting; Transformer; decoder-only; concept drift; low-rank decomposition;
D O I
10.3390/math13030490
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Time series forecasting constitutes a fundamental technique for analyzing dynamic alterations within temporal datasets and predicting future trends in various domains. Nevertheless, achieving effective modeling faces challenges arising from complex factors such as accurately capturing the relationships among temporally distant data points and accommodating rapid shifts in data distributions over time. While Transformer-based models have demonstrated remarkable capabilities in handling long-range dependencies recently, directly applying them to address the evolving distributions within temporal datasets remains a challenging task. To tackle these issues, this paper presents an innovative sequence-to-sequence adaptive learning approach centered on decoder framework for addressing temporal modeling tasks. An end-to-end deep learning architecture-based Transformer decoding framework is introduced, which is capable of adaptively discerning the interdependencies within temporal datasets. Experiments carried out on multiple datasets indicate that the time series adaptive learning model based on the decoder achieved an overall reduction of 2.6% in MSE (Mean Squared Error) loss and 1.8% in MAE (Mean Absolute Error) loss when compared with the most advanced Transformer-based time series forecasting model.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Hybrid Transfer Learning Framework for Enhanced Oil Production Time Series Forecasting
    AL-Alimi, Dalal
    Al-qaness, Mohammed A. A.
    Damasevicius, Robertas
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 3539 - 3561
  • [42] Smoothing and stationarity enforcement framework for deep learning time-series forecasting
    Ioannis E. Livieris
    Stavros Stavroyiannis
    Lazaros Iliadis
    Panagiotis Pintelas
    Neural Computing and Applications, 2021, 33 : 14021 - 14035
  • [43] Smoothing and stationarity enforcement framework for deep learning time-series forecasting
    Livieris, Ioannis E.
    Stavroyiannis, Stavros
    Iliadis, Lazaros
    Pintelas, Panagiotis
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (20): : 14021 - 14035
  • [44] Weather Forecasting Framework for Time Series Data using Intelligent Learning Models
    Raksha, S.
    Jasmine, Graceline S.
    Anbarasi, Jani
    Prasanna, M.
    Kamaleshkumar, S.
    2021 5TH INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, COMMUNICATION, COMPUTER TECHNOLOGIES AND OPTIMIZATION TECHNIQUES (ICEECCOT), 2021, : 783 - 787
  • [45] Time Series Forecasting using Sequence-to-Sequence Deep Learning Framework
    Du, Shengdong
    Li, Tianrui
    Horng, Shi-Jinn
    2018 9TH INTERNATIONAL CONFERENCE ON PARALLEL ARCHITECTURES, ALGORITHMS AND PROGRAMMING (PAAP 2018), 2018, : 171 - 176
  • [46] Graph-Enabled Reinforcement Learning for Time Series Forecasting With Adaptive Intelligence
    Shaik, Thanveer
    Tao, Xiaohui
    Xie, Haoran
    Li, Lin
    Yong, Jianming
    Li, Yuefeng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (04): : 2908 - 2918
  • [47] Adaptive time-variant model optimization for fuzzy-time-series forecasting
    Khiabani, Khalil
    Aghabozorgi, Saeed Reza
    IAENG International Journal of Computer Science, 2015, 42 (02) : 107 - 116
  • [48] Time Series Forecasting Based on Deep Extreme Learning Machine
    Guo, Xuqi
    Pang, Yusong
    Yan, Gaowei
    Qiao, Tiezhu
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 6151 - 6156
  • [49] Forecasting on Trading: A Parameter Adaptive Framework Based on Q-learning
    Chen, Chao
    Li, Yelin
    Bu, Hui
    Wu, Junjie
    Xiong, Zhang
    2018 15TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2018,
  • [50] A contrastive learning based universal representation for time series forecasting
    Hu, Jie
    Hu, Zhanao
    Li, Tianrui
    Du, Shengdong
    INFORMATION SCIENCES, 2023, 635 : 86 - 98