GTformer: Graph-Based Temporal-Order-Aware Transformer for Long-Term Series Forecasting

被引:2
|
作者
Liang, Aobo [1 ]
Chai, Xiaolin [1 ]
Sun, Yan [1 ]
Guizani, Mohsen [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Comp Sci, Natl Pilot Software Engn Sch, Beijing 100876, Peoples R China
[2] Mohamed Bin Zayed Univ Artificial Intelligence, Machine Learning Dept, Abu Dhabi, U Arab Emirates
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 19期
基金
中国国家自然科学基金;
关键词
Time series analysis; Transformers; Predictive models; Forecasting; Data models; Task analysis; Internet of Things; Interseries dependencies; long-term time series forecasting; multivariate time series (MTS); strict temporal order; transformer; INTERNET; NETWORK;
D O I
10.1109/JIOT.2024.3419768
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the production environment of the Internet of Things (IoT), sensors of various qualities generate a large amount of multivariate time series (MTS) data. The long-term prediction of time series data generated by various IoT devices provides longer foresight and helps execute necessary resource scheduling or fault alarms in advance, thus improving the efficiency of system operation and ensuring system security. In recent years, deep learning models like Transformers have achieved advanced performance in multivariate long-term time series forecasting (MLTSF) tasks. However, many previous research attempts either overlooked the interseries dependencies or ignored the need to model the strict temporal order of MTS data. In this article, we introduce GTformer, a graph-based temporal-order-aware transformer model. We propose an adaptive graph learning method specifically designed for MTS data to capture both uni-directional and bi-directional relations. In addition, we generate positional encoding in a sequential way to emphasize the strict temporal order of time series. By adopting these two components, our model can have a better understanding of the interseries and intraseries dependencies of MTS data. We conducted extensive experiments on eight real-world data sets, and the results show that our model achieves better predictions compared with state-of-the-art methods.
引用
收藏
页码:31467 / 31478
页数:12
相关论文
共 50 条
  • [41] Short-term wind speed forecasting based on spatial-temporal graph transformer networks
    Pan, Xiaoxin
    Wang, Long
    Wang, Zhongju
    Huang, Chao
    ENERGY, 2022, 253
  • [42] Hybrid Spatial-Temporal Graph Convolutional Network for Long-Term Traffic Flow Forecasting
    Wu, Zihao
    Lou, Ping
    2023 IEEE 8TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS, ICBDA, 2023, : 224 - 229
  • [43] Representing Multiview Time-Series Graph Structures for Multivariate Long-Term Time-Series Forecasting
    Wang Z.
    Fan J.
    Wu H.
    Sun D.
    Wu J.
    IEEE Transactions on Artificial Intelligence, 5 (06): : 2651 - 2662
  • [44] New Graph-Based and Transformer Deep Learning Models for River Dissolved Oxygen Forecasting
    Rocha, Paulo Alexandre Costa
    Santos, Victor Oliveira
    The, Jesse Van Griensven
    Gharabaghi, Bahram
    ENVIRONMENTS, 2023, 10 (12)
  • [45] Long-term online multi-session graph-based SPLAM with memory management
    Mathieu Labbé
    François Michaud
    Autonomous Robots, 2018, 42 : 1133 - 1150
  • [46] Long-term online multi-session graph-based SPLAM with memory management
    Labbe, Mathieu
    Michaud, Francois
    AUTONOMOUS ROBOTS, 2018, 42 (06) : 1133 - 1150
  • [47] TrajGAT: A Graph-based Long-term Dependency Modeling Approach for Trajectory Similarity Computation
    Yao, Di
    Hu, Haonan
    Du, Lun
    Cong, Gao
    Han, Shi
    Bi, Jingping
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2275 - 2285
  • [48] A pose graph-based localization system for long-term navigation in CAD floor plans
    Boniardi, Federico
    Caselitz, Tim
    Kuemmerle, Rainer
    Burgard, Wolfram
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 112 : 84 - 97
  • [49] An Efficient Graph-based Method for Long-term Land-use Change Statistics
    Zhang, Yipeng
    Gao, Yunbing
    Gao, Bingbo
    Pan, Yuchun
    Yan, Mingyang
    SUSTAINABILITY, 2016, 8 (01)
  • [50] Long-term multivariate time series forecasting in data centers based on multi-factor separation evolutionary spatial-temporal graph neural networks
    Shen, Fang
    Wang, Jialong
    Zhang, Ziwei
    Wang, Xin
    Li, Yue
    Geng, Zhaowei
    Pan, Bing
    Lu, Zengyi
    Zhao, Wendy
    Zhu, Wenwu
    KNOWLEDGE-BASED SYSTEMS, 2023, 280