Multi-scale temporal features extraction based graph convolutional network with attention for multivariate time series prediction

被引:23
|
作者
Chen, Yawen [1 ]
Ding, Fengqian [1 ]
Zhai, Linbo [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Peoples R China
关键词
Multivariate time series prediction; Features extraction; Multi-head attention; Graph neural network; GAUSSIAN PROCESS; WAVELET ANALYSIS; MODEL; OPTIMIZATION; ENSEMBLE;
D O I
10.1016/j.eswa.2022.117011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modeling for multivariate time series have always been a meaningful subject. Multivariate time series forecasting is a fundamental problem attracting many researchers in various fields. However, most of the existing methods focused on univariate prediction and rarely take into account the potential spatial dependencies between mul-tiple variables. Multivariate time series forecasting can be naturally viewed from graph perspective, where each variable from multivariate time series can be viewed as a node in the graph, and they are interlinked through hidden dependencies. Therefore, a novel graph neural network model based on multi-scale temporal feature extraction and attention mechanism is proposed for multivariate time series prediction. Specifically, empirical modal decomposition is used to extract the time-domain features of multivariate time series at different time scales to form the node features of the graph. Meanwhile, the multi-head attention mechanism is applied to construct potential associations between nodes and enhance the rationality of relationships in the graph. Furthermore, the graph convolutional neural network is used to generate node embeddings that contain rich spatial relationships. Finally, the temporal convolutional network establishes temporal relationships for the node embedding to achieve multivariate time series prediction. The real data from the financial, traffic and medical fields confirm the effectiveness of the proposed model.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Multi-scale Attention Convolutional Neural Network for time series classification
    Chen, Wei
    Shi, Ke
    [J]. NEURAL NETWORKS, 2021, 136 : 126 - 140
  • [2] An attention-based multi-scale temporal convolutional network for remaining useful life prediction
    Xu, Zhiqiang
    Zhang, Yujie
    Miao, Qiang
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 250
  • [3] Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting
    Chen, Ling
    Chen, Donghui
    Shang, Zongjiang
    Wu, Binqing
    Zheng, Cen
    Wen, Bo
    Zhang, Wei
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10) : 10748 - 10761
  • [4] Attention-Based Multi-Scale Prediction Network for Time-Series Data
    Junjie Li
    Lin Zhu
    Yong Zhang
    Da Guo
    Xingwen Xia
    [J]. China Communications, 2022, 19 (05) : 286 - 301
  • [5] Attention-Based Multi-Scale Prediction Network for Time-Series Data
    Li, Junjie
    Zhu, Lin
    Zhang, Yong
    Guo, Da
    Xia, Xingwen
    [J]. CHINA COMMUNICATIONS, 2022, 19 (05) : 286 - 301
  • [6] Time Series Prediction Based on Multi-Scale Feature Extraction
    Zhang, Ruixue
    Hao, Yongtao
    [J]. MATHEMATICS, 2024, 12 (07)
  • [7] A Multivariate Temporal Convolutional Attention Network for Time-Series Forecasting
    Wan, Renzhuo
    Tian, Chengde
    Zhang, Wei
    Deng, Wendi
    Yang, Fan
    [J]. ELECTRONICS, 2022, 11 (10)
  • [8] Multi-scale attention graph convolutional recurrent network for traffic forecasting
    Xiong, Liyan
    Hu, Zhuyi
    Yuan, Xinhua
    Ding, Weihua
    Huang, Xiaohui
    Lan, Yuanchun
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3277 - 3291
  • [9] Dynamic multi-scale spatial-temporal graph convolutional network for traffic flow prediction
    Hu, Na
    Zhang, Dafang
    Xie, Kun
    Liang, Wei
    Li, Kuan-Ching
    Zomaya, Albert Y.
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 158 : 323 - 332
  • [10] Dynamic multi-scale spatial-temporal graph convolutional network for traffic flow prediction
    Gao, Ming
    Du, Zhuoran
    Qin, Hongmao
    Wang, Wei
    Jin, Guangyin
    Xie, Guotao
    [J]. Knowledge-Based Systems, 2024, 305