GTformer: Graph-Based Temporal-Order-Aware Transformer for Long-Term Series Forecasting

被引:2
|
作者
Liang, Aobo [1 ]
Chai, Xiaolin [1 ]
Sun, Yan [1 ]
Guizani, Mohsen [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[2] Mohamed Bin Zayed Univ Artificial Intelligence, Machine Learning Dept, Abu Dhabi, U Arab Emirates
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 19期
基金
中国国家自然科学基金;
关键词
Time series analysis; Transformers; Predictive models; Forecasting; Data models; Task analysis; Internet of Things; Interseries dependencies; long-term time series forecasting; multivariate time series (MTS); strict temporal order; transformer; INTERNET; NETWORK;
D O I
10.1109/JIOT.2024.3419768
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the production environment of the Internet of Things (IoT), sensors of various qualities generate a large amount of multivariate time series (MTS) data. The long-term prediction of time series data generated by various IoT devices provides longer foresight and helps execute necessary resource scheduling or fault alarms in advance, thus improving the efficiency of system operation and ensuring system security. In recent years, deep learning models like Transformers have achieved advanced performance in multivariate long-term time series forecasting (MLTSF) tasks. However, many previous research attempts either overlooked the interseries dependencies or ignored the need to model the strict temporal order of MTS data. In this article, we introduce GTformer, a graph-based temporal-order-aware transformer model. We propose an adaptive graph learning method specifically designed for MTS data to capture both uni-directional and bi-directional relations. In addition, we generate positional encoding in a sequential way to emphasize the strict temporal order of time series. By adopting these two components, our model can have a better understanding of the interseries and intraseries dependencies of MTS data. We conducted extensive experiments on eight real-world data sets, and the results show that our model achieves better predictions compared with state-of-the-art methods.
引用
收藏
页码:31467 / 31478
页数:12
相关论文
共 50 条
  • [11] DTSFormer: Decoupled temporal-spatial diffusion transformer for enhanced long-term time series forecasting
    Zhu, Jiaming
    Liu, Dezhi
    Chen, Huayou
    Liu, Jinpei
    Tao, Zhifu
    KNOWLEDGE-BASED SYSTEMS, 2025, 309
  • [12] MEAformer: An all-MLP transformer with temporal external attention for long-term time series forecasting
    Huang, Siyuan
    Liu, Yepeng
    Cui, Haoyi
    Zhang, Fan
    Li, Jinjiang
    Zhang, Xiaofeng
    Zhang, Mingli
    Zhang, Caiming
    INFORMATION SCIENCES, 2024, 669
  • [13] DTAFORMER: Directional Time Attention Transformer For Long-Term Series Forecasting
    Chang, Jiang
    Yue, Luhui
    Liu, Qingshan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT IV, 2025, 15034 : 162 - 180
  • [14] FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting
    Zhou, Tian
    Ma, Ziqing
    Wen, Qingsong
    Wang, Xue
    Sun, Liang
    Jin, Rong
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [15] Robformer: A robust decomposition transformer for long-term time series forecasting
    Yu, Yang
    Ma, Ruizhe
    Ma, Zongmin
    PATTERN RECOGNITION, 2024, 153
  • [16] Long-term wind power forecasting with series decomposition and spatio-temporal graph neural network
    Yang, Yujie
    Chen, Junhong
    Zheng, Wenbin
    Zhang, Fan
    INTERNATIONAL JOURNAL OF GREEN ENERGY, 2024, 21 (15) : 3470 - 3484
  • [17] LCDFormer: Long-term correlations dual-graph transformer for traffic forecasting
    Cai, Jiongbiao
    Wang, Chia -Hung
    Hu, Kun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 249
  • [18] SmartFormer: Graph-based transformer model for energy load forecasting
    Saeed, Faisal
    Rehman, Abdul
    Shah, Hasnain Ali
    Diyan, Muhammad
    Chen, Jie
    Kang, Jae-Mo
    SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2025, 73
  • [19] DESTformer: A Transformer Based on Explicit Seasonal-Trend Decomposition for Long-Term Series Forecasting
    Wang, Yajun
    Zhu, Jianping
    Kang, Renke
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [20] Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal Transformer
    Zhang, Yang
    Liu, Lingbo
    Xiong, Xinyu
    Li, Guanbin
    Wang, Guoli
    Lin, Liang
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 6308 - 6316