A deep learning model to effectively capture mutation information in multivariate time series prediction

被引:31
|
作者
Hu, Jun [1 ]
Zheng, Wendong [1 ,2 ]
机构
[1] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
关键词
Multivariate time series prediction; Mutation information; LSTM with transformation mechanism; Attention mechanism; NEURAL-NETWORKS; LSTM;
D O I
10.1016/j.knosys.2020.106139
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world complex multivariate time series data, mutation phenomena can significantly affect variation rules of target series. Meanwhile, there is no specific learning mechanism for the current deep learning model to capture mutation information in time series prediction. To this end, we propose a new deep learning model to capture mutation information between data. To capture the impact of mutation information on target series, a new function mapping is designed in the attention mechanism of the encoder to process the fusion of historical hidden state and cell state information; and an LSTM with transformation mechanism is proposed in the encoder to process the input information flow and learn the mutation information. In addition, an adaptive self-paced curriculum learning mechanism is designed to obtain mutation information that may be ignored among mini-batch samples. Finally, we define an objective function for multivariate time series prediction, which can extract the influence of temporal correlation information and mutation information within the data on target series. Our model can achieve superior performance than all baseline methods on five real-world datasets in different fields. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Multivariate Time Series Prediction of Pediatric ICU data using Deep Learning
    Adiba, Farzana Islam
    Sharwardy, Sharmin Nahar
    Rahman, Mohammad Zahidur
    [J]. 2021 INTERNATIONAL CONFERENCE ON INNOVATIVE TRENDS IN INFORMATION TECHNOLOGY (ICITIIT), 2021,
  • [2] Multivariate Time Series Prediction Based on Temporal Change Information Learning Method
    Zheng, Wendong
    Hu, Jun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7034 - 7048
  • [3] Neural additive time-series models: Explainable deep learning for multivariate time-series prediction
    Jo, Wonkeun
    Kim, Dongil
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 228
  • [4] ConvGRU-TSNet: A Novel Deep Learning Approach for Multivariate Time Series Prediction
    She, Jingke
    Gong, Shanshan
    Yang, Suyuan
    Shi, Tianzi
    Lu, Shaofei
    Wu, Heng
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 26 - 33
  • [5] Uncertainty Aware Deep Learning for Fault Prediction Using Multivariate Time Series Signals
    Rahman, Md Monibor
    Vidyaratne, L.
    Carpenter, A.
    Tennant, C.
    Iftekharuddin, K.
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [6] Multivariate Financial Time Series Forecasting with Deep Learning
    Martelo, Sebastian
    Leon, Diego
    Hernandez, German
    [J]. APPLIED COMPUTER SCIENCES IN ENGINEERING, WEA 2022, 2022, 1685 : 160 - 169
  • [7] A Hybrid Deep Representation Learning Model for Time Series Classification and Prediction
    Guo, Yang
    Wu, Zhenyu
    Ji, Yang
    [J]. 2017 3RD INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS (BIGCOM), 2017, : 226 - 231
  • [8] Deep Learning Model for Multivariate High-Frequency Time-Series Data: Financial Market Index Prediction
    Noh, Yoonjae
    Kim, Jong-Min
    Hong, Soongoo
    Kim, Sangjin
    [J]. MATHEMATICS, 2023, 11 (16)
  • [9] A deep learning approach for abnormal pore pressure prediction based on multivariate time series of kick
    Qingfeng, Li
    Jianhong, Fu
    Chi, Peng
    Fan, Min
    Xiaomin, Zhang
    Yun, Yang
    Zhaoyang, Xu
    Jing, Bai
    Ziqiang, Yu
    Hao, Wang
    [J]. GEOENERGY SCIENCE AND ENGINEERING, 2023, 226
  • [10] Comparison of deep learning models for multivariate prediction of time series wind power generation and temperature
    Mishra, Sambeet
    Bordin, Chiara
    Taharaguchi, Kota
    Palu, Ivo
    [J]. ENERGY REPORTS, 2020, 6 : 273 - 286