Multi-Task Time Series Forecasting Based on Graph Neural Networks

被引:4
|
作者
Han, Xiao [1 ]
Huang, Yongjie [1 ]
Pan, Zhisong [1 ]
Li, Wei [1 ]
Hu, Yahao [1 ]
Lin, Gengyou [1 ]
机构
[1] Army Engn Univ PLA, Command Control Engn Coll, Nanjing 210007, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; cross-timestep feature sharing; dynamic dependency; attention mechanism; graph neural network;
D O I
10.3390/e25081136
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Accurate time series forecasting is of great importance in real-world scenarios such as health care, transportation, and finance. Because of the tendency, temporal variations, and periodicity of the time series data, there are complex and dynamic dependencies among its underlying features. In time series forecasting tasks, the features learned by a specific task at the current time step (such as predicting mortality) are related to the features of historical timesteps and the features of adjacent timesteps of related tasks (such as predicting fever). Therefore, capturing dynamic dependencies in data is a challenging problem for learning accurate future prediction behavior. To address this challenge, we propose a cross-timestep feature-sharing multi-task time series forecasting model that can capture global and local dynamic dependencies in time series data. Initially, the global dynamic dependencies of features within each task are captured through a self-attention mechanism. Furthermore, an adaptive sparse graph structure is employed to capture the local dynamic dependencies inherent in the data, which can explicitly depict the correlation between features across timesteps and tasks. Lastly, the cross-timestep feature sharing between tasks is achieved through a graph attention mechanism, which strengthens the learning of shared features that are strongly correlated with a single task. It is beneficial for improving the generalization performance of the model. Our experimental results demonstrate that our method is significantly competitive compared to baseline methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Multi-Task Data Imputation for Time-Series Forecasting in Turbomachinery Health Prognostics
    Chen, Xudong
    Ding, Xudong
    Wang, Xiaofang
    Zhao, Yusong
    Liu, Changjun
    Liu, Haitao
    Chen, Kexuan
    [J]. MACHINES, 2023, 11 (01)
  • [22] Brain Networks Classification Based on an Adaptive Multi-Task Convolutional Neural Networks
    Xing, Xinying
    Ji, Junzhong
    Yao, Yao
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (07): : 1449 - 1459
  • [23] SpreadGNN: Decentralized Multi-Task Federated Learning for Graph Neural Networks on Molecular Data
    He, Chaoyang
    Ceyani, Emir
    Balasubramanian, Keshav
    Annavaram, Murali
    Avestimehr, Salman
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6865 - 6873
  • [24] Graph-based Multi-task Learning
    Li, Ya
    Tian, Xinmei
    [J]. 2015 IEEE 16TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2015, : 730 - 733
  • [25] A Deep Neural Networks Based on Multi-task Learning and Its Application
    Zhao, Mengru
    Zhang, Yuxian
    Qiao, Likui
    Sun, Deyuan
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 6201 - 6206
  • [26] Time series forecasting with neural networks
    Chatfield, C
    [J]. NEURAL NETWORKS FOR SIGNAL PROCESSING VIII, 1998, : 419 - 427
  • [27] Forecasting of time series with neural networks
    Schwerk, T
    [J]. ZEITSCHRIFT FUR ANGEWANDTE MATHEMATIK UND MECHANIK, 1996, 76 : 219 - 222
  • [28] Financial time series forecasting with multi-modality graph neural network
    Cheng, Dawei
    Yang, Fangzhou
    Xiang, Sheng
    Liu, Jin
    [J]. PATTERN RECOGNITION, 2022, 121
  • [29] Multi-Task Learning for Metaphor Detection with Graph Convolutional Neural Networks and Word Sense Disambiguation
    Duong Minh Le
    My Thai
    Thien Huu Nguyen
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8139 - 8146
  • [30] Multi-task graph neural networks for simultaneous prediction of global and atomic properties in ferromagnetic systems *
    Pasini, Massimiliano Lupo
    Zhang, Pei
    Reeve, Samuel Temple
    Choi, Jong Youl
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (02):