Multi-Task Time Series Forecasting Based on Graph Neural Networks

被引:4
|
作者
Han, Xiao [1 ]
Huang, Yongjie [1 ]
Pan, Zhisong [1 ]
Li, Wei [1 ]
Hu, Yahao [1 ]
Lin, Gengyou [1 ]
机构
[1] Army Engn Univ PLA, Command Control Engn Coll, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; cross-timestep feature sharing; dynamic dependency; attention mechanism; graph neural network;
D O I
10.3390/e25081136
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Accurate time series forecasting is of great importance in real-world scenarios such as health care, transportation, and finance. Because of the tendency, temporal variations, and periodicity of the time series data, there are complex and dynamic dependencies among its underlying features. In time series forecasting tasks, the features learned by a specific task at the current time step (such as predicting mortality) are related to the features of historical timesteps and the features of adjacent timesteps of related tasks (such as predicting fever). Therefore, capturing dynamic dependencies in data is a challenging problem for learning accurate future prediction behavior. To address this challenge, we propose a cross-timestep feature-sharing multi-task time series forecasting model that can capture global and local dynamic dependencies in time series data. Initially, the global dynamic dependencies of features within each task are captured through a self-attention mechanism. Furthermore, an adaptive sparse graph structure is employed to capture the local dynamic dependencies inherent in the data, which can explicitly depict the correlation between features across timesteps and tasks. Lastly, the cross-timestep feature sharing between tasks is achieved through a graph attention mechanism, which strengthens the learning of shared features that are strongly correlated with a single task. It is beneficial for improving the generalization performance of the model. Our experimental results demonstrate that our method is significantly competitive compared to baseline methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Correlated Time Series Forecasting using Multi-Task Deep Neural Networks
    Cirstea, Razvan-Gabriel
    Micu, Darius-Valer
    Muresan, Gabriel-Marcel
    Guo, Chenjuan
    Yang, Bin
    [J]. CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 1527 - 1530
  • [2] MDG: A Multi-Task Dynamic Graph Generation Framework for Multivariate Time Series Forecasting
    Huang, Longhao
    Yuan, Jidong
    Chen, Shengbo
    Li, Xu
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1337 - 1349
  • [3] Multi-Task Time Series Forecasting With Shared Attention
    Chen, Zekai
    Jiaze, E.
    Zhang, Xiao
    Sheng, Hao
    Cheng, Xiuzheng
    [J]. 20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2020), 2020, : 917 - 925
  • [4] Multi-task Learning Method for Hierarchical Time Series Forecasting
    Yang, Maoxin
    Hu, Qinghua
    Wang, Yun
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: TEXT AND TIME SERIES, PT IV, 2019, 11730 : 474 - 485
  • [5] All in One: Multi-Task Prompting for Graph Neural Networks
    Sun, Xiangguo
    Cheng, Hong
    Li, Jia
    Liu, Bo
    Guan, Jihong
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2120 - 2131
  • [6] Passenger Demand Forecasting with Multi-Task Convolutional Recurrent Neural Networks
    Bai, Lei
    Yao, Lina
    Kanhere, Sala S.
    Yang, Zheng
    Chu, Jing
    Wang, Xianzhi
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT II, 2019, 11440 : 29 - 42
  • [7] Multiple Stock Time Series Jointly Forecasting with Multi-Task Learning
    Ma, Tao
    Tan, Ying
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [8] Multi-Task Mixture Density Graph Neural Networks for Predicting Catalyst Performance
    Liang, Chen
    Wang, Bowen
    Hao, Shaogang
    Chen, Guangyong
    Heng, Pheng-Ann
    Zou, Xiaolong
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2024,
  • [9] A Multi-Task Learning Based Runoff Forecasting Model for Multi-Scale Chaotic Hydrological Time Series
    Hui Zuo
    Gaowei Yan
    Ruochen Lu
    Rong Li
    Shuyi Xiao
    Yusong Pang
    [J]. Water Resources Management, 2024, 38 : 481 - 503
  • [10] A Multi-Task Learning Based Runoff Forecasting Model for Multi-Scale Chaotic Hydrological Time Series
    Zuo, Hui
    Yan, Gaowei
    Lu, Ruochen
    Li, Rong
    Xiao, Shuyi
    Pang, Yusong
    [J]. WATER RESOURCES MANAGEMENT, 2024, 38 (01) : 235 - 250