Multi-Task Time Series Forecasting Based on Graph Neural Networks

被引:4
|
作者
Han, Xiao [1 ]
Huang, Yongjie [1 ]
Pan, Zhisong [1 ]
Li, Wei [1 ]
Hu, Yahao [1 ]
Lin, Gengyou [1 ]
机构
[1] Army Engn Univ PLA, Command Control Engn Coll, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; cross-timestep feature sharing; dynamic dependency; attention mechanism; graph neural network;
D O I
10.3390/e25081136
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Accurate time series forecasting is of great importance in real-world scenarios such as health care, transportation, and finance. Because of the tendency, temporal variations, and periodicity of the time series data, there are complex and dynamic dependencies among its underlying features. In time series forecasting tasks, the features learned by a specific task at the current time step (such as predicting mortality) are related to the features of historical timesteps and the features of adjacent timesteps of related tasks (such as predicting fever). Therefore, capturing dynamic dependencies in data is a challenging problem for learning accurate future prediction behavior. To address this challenge, we propose a cross-timestep feature-sharing multi-task time series forecasting model that can capture global and local dynamic dependencies in time series data. Initially, the global dynamic dependencies of features within each task are captured through a self-attention mechanism. Furthermore, an adaptive sparse graph structure is employed to capture the local dynamic dependencies inherent in the data, which can explicitly depict the correlation between features across timesteps and tasks. Lastly, the cross-timestep feature sharing between tasks is achieved through a graph attention mechanism, which strengthens the learning of shared features that are strongly correlated with a single task. It is beneficial for improving the generalization performance of the model. Our experimental results demonstrate that our method is significantly competitive compared to baseline methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Forecasting of Smart Meter Time Series Based on Neural Networks
    Zufferey, Thierry
    Ulbig, Andreas
    Koch, Stephan
    Hug, Gabriela
    [J]. DATA ANALYTICS FOR RENEWABLE ENERGY INTEGRATION (DARE 2016), 2017, 10097 : 10 - 21
  • [32] Multi-task neural networks for dealing with missing inputs
    Garcia-Laencina, Pedro J.
    Serrano, Jesus
    Figueiras-Vidal, Anibal R.
    Sancho-Gomez, Jose-Luis
    [J]. BIO-INSPIRED MODELING OF COGNITIVE TASKS, PT 1, PROCEEDINGS, 2007, 4527 : 282 - +
  • [33] Metric-Based Multi-Task Grouping Neural Network for Traffic Flow Forecasting
    Hong, Haikun
    Huang, Wenhao
    Song, Guojie
    Xie, Kunqing
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2014, 2014, 8866 : 499 - 507
  • [34] Multi-task neural networks by learned contextual inputs
    Sandnes, Anders T.
    Grimstad, Bjarne
    Kolbjornsen, Odd
    [J]. NEURAL NETWORKS, 2024, 179
  • [35] Integrated Perception with Recurrent Multi-Task Neural Networks
    Bilen, Hakan
    Vedaldi, Andrea
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [36] Mixture of Graph Enhanced Expert Networks for Multi-task Recommendation
    Hu, Binbin
    Shen, Bin
    Wu, Ruize
    Zhang, Zhigiang
    Cao, Yuetian
    He, Yong
    Zhang, Liang
    Mo, Linjian
    Zhou, Jun
    [J]. PRICAI 2022: TRENDS IN ARTIFICIAL INTELLIGENCE, PT III, 2022, 13631 : 3 - 16
  • [37] Forecasting Time Series by an Ensemble of Artificial Neural Networks based on transforming the Time Series
    Gutierrez, German
    Paz Sesmero, M.
    Sanchis, Araceli
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 4769 - 4774
  • [38] Machining feature and topological relationship recognition based on a multi-task graph neural network
    Xia, Mingyuan
    Zhao, Xianwen
    Hu, Xiaofeng
    [J]. ADVANCED ENGINEERING INFORMATICS, 2024, 62
  • [39] Multi-task recommendation based on dynamic knowledge graph
    Wen, Minwei
    Mei, Hongyan
    Wang, Wei
    Xue, Xiaorong
    Zhang, Xing
    [J]. APPLIED INTELLIGENCE, 2024, 54 (13-14) : 7151 - 7169
  • [40] Face Detection Based on Improved Multi-task Cascaded Convolutional Neural Networks
    Jia, Siyu
    Tian, Ying
    [J]. IAENG International Journal of Computer Science, 2024, 51 (02) : 67 - 74