Multivariate Time Series Forecasting With Dynamic Graph Neural ODEs

被引:47
|
作者
Jin, Ming [1 ]
Zheng, Yu [2 ]
Li, Yuan-Fang [1 ]
Chen, Siheng [3 ]
Yang, Bin [4 ]
Pan, Shirui [5 ]
机构
[1] Monash Univ, Fac IT, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[3] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[4] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200050, Peoples R China
[5] Griffith Univ, Sch Informat & Commun Technol, Southport, Qld 4222, Australia
关键词
Multivariate time series forecasting; graph neural networks; neural ordinary differential equations;
D O I
10.1109/TKDE.2022.3221989
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multivariate time series forecasting has long received significant attention in real-world applications, such as energy consumption and traffic prediction. While recent methods demonstrate good forecasting abilities, they have three fundamental limitations. (i). Discrete neural architectures: Interlacing individually parameterized spatial and temporal blocks to encode rich underlying patterns leads to discontinuous latent state trajectories and higher forecasting numerical errors. (ii). High complexity: Discrete approaches complicate models with dedicated designs and redundant parameters, leading to higher computational and memory overheads. (iii). Reliance on graph priors: Relying on predefined static graph structures limits their effectiveness and practicability in real-world applications. In this paper, we address all the above limitations by proposing a continuous model to forecast Multivariate Time series with dynamic Graph neural Ordinary Differential Equations (MTGODE). Specifically, we first abstract multivariate time series into dynamic graphs with time-evolving node features and unknown graph structures. Then, we design and solve a neural ODE to complement missing graph topologies and unify both spatial and temporal message passing, allowing deeper graph propagation and fine-grained temporal information aggregation to characterize stable and precise latent spatial-temporal dynamics. Our experiments demonstrate the superiorities of MTGODE from various perspectives on five time series benchmark datasets.
引用
收藏
页码:9168 / 9180
页数:13
相关论文
共 50 条
  • [41] Dynamic Hypergraph Structure Learning for Multivariate Time Series Forecasting
    Wang, Shun
    Zhang, Yong
    Lin, Xuanqi
    Hu, Yongli
    Huang, Qingming
    Yin, Baocai
    IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (04) : 556 - 567
  • [42] Forecasting multivariate time series
    Athanasopoulos, George
    Vahid, Farshid
    INTERNATIONAL JOURNAL OF FORECASTING, 2015, 31 (03) : 680 - 681
  • [43] Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecasting
    Shao, Zezhi
    Zhang, Zhao
    Wang, Fei
    Xu, Yongjun
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1567 - 1577
  • [44] TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting
    Hao Miao
    Yilin Zhang
    Zefei Ning
    Zhuolun Jiang
    Li Wang
    Applied Intelligence, 2023, 53 : 28254 - 28267
  • [45] TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting
    Miao, Hao
    Zhang, Yilin
    Ning, Zefei
    Jiang, Zhuolun
    Wang, Li
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28254 - 28267
  • [46] Time-aware personalized graph convolutional network for multivariate time series forecasting
    Li, Zhuolin
    Gao, Ziheng
    Zhang, Xiaolin
    Zhang, Gaowei
    Xu, Lingyu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 240
  • [47] TimeGNN: Temporal Dynamic Graph Learning for Time Series Forecasting
    Xu, Nancy
    Kosma, Chrysoula
    Vazirgiannis, Michalis
    COMPLEX NETWORKS & THEIR APPLICATIONS XII, VOL 1, COMPLEX NETWORKS 2023, 2024, 1141 : 87 - 99
  • [48] Heterogeneous Graph Transformer Auto-Encoder for multivariate time series forecasting
    Ye, Hongjiang
    Sun, Ying
    Gao, Yu
    Xu, Feiyi
    Qi, Jin
    COMPUTERS & ELECTRICAL ENGINEERING, 2025, 122
  • [49] Learning and integration of adaptive hybrid graph structures for multivariate time series forecasting
    Guo, Ting
    Hou, Feng
    Pang, Yan
    Jia, Xiaoyun
    Wang, Zhongwei
    Wang, Ruili
    INFORMATION SCIENCES, 2023, 648
  • [50] FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspective
    Yi, Kun
    Zhang, Qi
    Fan, Wei
    He, Hui
    Hu, Liang
    Wang, Pengyang
    An, Ning
    Cao, Longbing
    Niu, Zhendong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,