SageFormer: Series-Aware Framework for Long-Term Multivariate Time-Series Forecasting

被引:2
|
作者
Zhang, Zhenwei [1 ]
Meng, Linghang [1 ]
Gu, Yuantao [1 ]
机构
[1] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Dept Elect Engn, Beijing 100084, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 10期
基金
中国国家自然科学基金;
关键词
Interseries dependencies; time-series forecasting; transformer;
D O I
10.1109/JIOT.2024.3363451
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the burgeoning ecosystem of Internet of Things, multivariate time-series (MTS) data has become ubiquitous, highlighting the fundamental role of time-series forecasting across numerous applications. The crucial challenge of long-term MTS forecasting requires adept models capable of capturing both intra- and inter-series dependencies. Recent advancements in deep learning, notably Transformers, have shown promise. However, many prevailing methods either marginalize interseries dependencies or overlook them entirely. To bridge this gap, this article introduces a novel series-aware framework, explicitly designed to emphasize the significance of such dependencies. At the heart of this framework lies our specific implementation: the SageFormer. As a series-aware graph-enhanced Transformer model, SageFormer proficiently discerns and models the intricate relationships between series using graph structures. Beyond capturing diverse temporal patterns, it also curtails redundant information across series. Notably, the series-aware framework seamlessly integrates with existing Transformer-based models, enriching their ability to comprehend interseries relationships. Extensive experiments on real-world and synthetic data sets validate the superior performance of SageFormer against contemporary state-of-the-art approaches.
引用
收藏
页码:18435 / 18448
页数:14
相关论文
共 50 条
  • [1] Representing Multiview Time-Series Graph Structures for Multivariate Long-Term Time-Series Forecasting
    Wang, Zehao
    Fan, Jin
    Wu, Huifeng
    Sun, Danfeng
    Wu, Jia
    [J]. IEEE Transactions on Artificial Intelligence, 2024, 5 (06): : 2651 - 2662
  • [2] CALTM: A Context-Aware Long-Term Time-Series Forecasting Model
    Jin, Canghong
    Chen, Jiapeng
    Wu, Shuyu
    Wu, Hao
    Wang, Shuoping
    Ying, Jing
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 139 (01): : 873 - 891
  • [3] Gaussian Process for Long-Term Time-Series Forecasting
    Yan, Weizhong
    Qiu, Hai
    Xue, Ya
    [J]. IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1031 - 1038
  • [4] GCformer: An Efficient Framework for Accurate and Scalable Long-Term Multivariate Time Series Forecasting
    Zhao, Yanjun
    Ma, Ziqing
    Zhou, Tian
    Ye, Mengni
    Sun, Liang
    Qian, Yi
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3464 - 3473
  • [5] Hierarchical attention network for multivariate time series long-term forecasting
    Bi, Hongjing
    Lu, Lilei
    Meng, Yizhen
    [J]. APPLIED INTELLIGENCE, 2023, 53 (05) : 5060 - 5071
  • [6] Hierarchical attention network for multivariate time series long-term forecasting
    Hongjing Bi
    Lilei Lu
    Yizhen Meng
    [J]. Applied Intelligence, 2023, 53 : 5060 - 5071
  • [7] Information-aware attention dynamic synergetic network for multivariate time series long-term forecasting
    He, Xiaoyu
    Shi, Suixiang
    Geng, Xiulin
    Xu, Lingyu
    [J]. NEUROCOMPUTING, 2022, 500 : 143 - 154
  • [9] VAECGAN: a generating framework for long-term prediction in multivariate time series
    Xiang Yin
    Yanni Han
    Zhen Xu
    Jie Liu
    [J]. Cybersecurity, 4
  • [10] VAECGAN: a generating framework for long-term prediction in multivariate time series
    Yin, Xiang
    Han, Yanni
    Xu, Zhen
    Liu, Jie
    [J]. CYBERSECURITY, 2021, 4 (01)