Multi-scale temporal features extraction based graph convolutional network with attention for multivariate time series prediction

被引:23
|
作者
Chen, Yawen [1 ]
Ding, Fengqian [1 ]
Zhai, Linbo [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Peoples R China
关键词
Multivariate time series prediction; Features extraction; Multi-head attention; Graph neural network; GAUSSIAN PROCESS; WAVELET ANALYSIS; MODEL; OPTIMIZATION; ENSEMBLE;
D O I
10.1016/j.eswa.2022.117011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modeling for multivariate time series have always been a meaningful subject. Multivariate time series forecasting is a fundamental problem attracting many researchers in various fields. However, most of the existing methods focused on univariate prediction and rarely take into account the potential spatial dependencies between mul-tiple variables. Multivariate time series forecasting can be naturally viewed from graph perspective, where each variable from multivariate time series can be viewed as a node in the graph, and they are interlinked through hidden dependencies. Therefore, a novel graph neural network model based on multi-scale temporal feature extraction and attention mechanism is proposed for multivariate time series prediction. Specifically, empirical modal decomposition is used to extract the time-domain features of multivariate time series at different time scales to form the node features of the graph. Meanwhile, the multi-head attention mechanism is applied to construct potential associations between nodes and enhance the rationality of relationships in the graph. Furthermore, the graph convolutional neural network is used to generate node embeddings that contain rich spatial relationships. Finally, the temporal convolutional network establishes temporal relationships for the node embedding to achieve multivariate time series prediction. The real data from the financial, traffic and medical fields confirm the effectiveness of the proposed model.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
    Chengjun Chen
    Xicong Zhao
    Jinlei Wang
    Dongnian Li
    Yuanlin Guan
    Jun Hong
    [J]. Scientific Reports, 12
  • [42] Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
    Chen, Chengjun
    Zhao, Xicong
    Wang, Jinlei
    Li, Dongnian
    Guan, Yuanlin
    Hong, Jun
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [43] Graph Convolutional Neural Network with Multi-Scale Attention Mechanism for EEG-Based Motion Imagery Classification
    Zhu, Jun
    Liu, Qingshan
    Xu, Chentao
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (14)
  • [44] Multi-Attention Generative Adversarial Network for Multivariate Time Series Prediction
    Yin, Xiang
    Han, Yanni
    Sun, Hongyu
    Xu, Zhen
    Yu, Haibo
    Duan, Xiaoyu
    [J]. IEEE ACCESS, 2021, 9 : 57351 - 57363
  • [45] Temporal self-attention-based Conv-LSTM network for multivariate time series prediction
    Fu, En
    Zhang, Yinong
    Yang, Fan
    Wang, Shuying
    [J]. NEUROCOMPUTING, 2022, 501 : 162 - 173
  • [46] LSTM-MFCN: A time series classifier based on multi-scale spatial–temporal features
    Zhao, Liang
    Mo, Chunyang
    Ma, Jiajun
    Chen, Zhikui
    Yao, Chenhui
    [J]. Computer Communications, 2022, 182 : 52 - 59
  • [47] MULTI-SCALE TEMPORAL FREQUENCY CONVOLUTIONAL NETWORK WITH AXIAL ATTENTION FOR MULTI-CHANNEL SPEECH ENHANCEMENT
    Zhang, Guochang
    Wang, Chunliang
    Yu, Libiao
    Wei, Jianqiang
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 9206 - 9210
  • [48] Multistage attention network for multivariate time series prediction
    Hu, Jun
    Zheng, Wendong
    [J]. NEUROCOMPUTING, 2020, 383 : 122 - 137
  • [49] Multi-scale deep echo state network for time series prediction
    Li, Tao
    Guo, Zhijun
    Li, Qian
    Wu, Zhou
    [J]. Neural Computing and Applications, 2024, 36 (21) : 13305 - 13325
  • [50] Skin Lesion Segmentation Based on Multi-Scale Attention Convolutional Neural Network
    Jiang, Yun
    Cao, Simin
    Tao, Shengxin
    Zhang, Hai
    [J]. IEEE ACCESS, 2020, 8 : 122811 - 122825