DESCINet: A hierarchical deep convolutional neural network with skip connection for long time series forecasting

被引:7
|
作者
Silva, Andre Quintiliano Bezerra [1 ]
Goncalves, Wesley Nunes [2 ]
Matsubara, Edson Takashi [2 ]
机构
[1] Fed Inst Educ Sci & Technol Mato Grosso Do Sul, BR-79240000 Campo Grande, MS, Brazil
[2] Univ Fed Mato Grosso do Sul, BR-79010210 Campo Grande, MS, Brazil
关键词
Long sequence time-series forecasting; Skip connections; Convolutional neural networks (CNNs); Deep learning (DL); SINGULARITIES; PREDICTION; DYNAMICS; LSTM;
D O I
10.1016/j.eswa.2023.120246
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series forecasting is the process of predicting future values of a time series from knowledge of its past data. Although there are several models for making short-term predictions, the problem of long temporal sequences can still receive new contributions. Recent studies have applied Transformers-based solutions to the long-time series forecasting task and achieved good results. When it comes to time series modeling, the goal is to capture the temporal relationships within a sequence of ordered and continuous points. While using positional encoding and embedding sub-series as tokens in Transformers can help to preserve some ordering information, the permutation-invariant self-attention mechanism used in these models can lead to loss of temporal information. In this paper, we used convolutional networks in a binary tree structure with skip connections between the levels of the tree that allowed greater precision and efficiency in the training. The proposed model was evaluated on five real-life datasets. Experimental results show that our model significantly improves forecast accuracy relative to existing solutions.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] HLNet: A Novel Hierarchical Deep Neural Network for Time Series Forecasting
    Jimenez-Navarro, M. J.
    Martinez-Alvarez, F.
    Troncoso, A.
    Asencio-Cortes, G.
    16TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING MODELS IN INDUSTRIAL AND ENVIRONMENTAL APPLICATIONS (SOCO 2021), 2022, 1401 : 717 - 727
  • [2] Image-based time series forecasting: A deep convolutional neural network approach
    Semenoglou, Artemios-Anargyros
    Spiliotis, Evangelos
    Assimakopoulos, Vassilios
    NEURAL NETWORKS, 2023, 157 : 39 - 53
  • [3] Free Energy of Bayesian Convolutional Neural Network with Skip Connection
    Nagayasu, Shuya
    Watanabe, Sumio
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [4] Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting
    Wan, Renzhuo
    Mei, Shuping
    Wang, Jun
    Liu, Min
    Yang, Fan
    ELECTRONICS, 2019, 8 (08)
  • [5] A long-term multivariate time series forecasting network combining series decomposition and convolutional neural networks
    Wang, Xingyu
    Liu, Hui
    Du, Junzhao
    Dong, Xiyao
    Yang, Zhihan
    APPLIED SOFT COMPUTING, 2023, 139
  • [6] Forecasting time series using convolutional neural network with multiplicative neuron
    Nigam, Shobhit
    APPLIED SOFT COMPUTING, 2025, 174
  • [7] Stock Forecasting for Time Series Data using Convolutional Neural Network
    Vijh, Surbhi
    Pandey, Adesh Kumar
    Vijh, Garima
    Kumar, Sumit
    2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, : 866 - 870
  • [8] Nonpooling Convolutional Neural Network Forecasting for Seasonal Time Series With Trends
    Liu, Shuai
    Ji, Hong
    Wang, Morgan C.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (08) : 2879 - 2888
  • [9] Image Denoising Using Dual Convolutional Neural Network with Skip Connection
    Mengnan L
    Xianchun Zhou
    Zhiting Du
    Yuze Chen
    Binxin Tang
    Instrumentation, 2024, 11 (03) : 74 - 85
  • [10] Skip-connection convolutional neural network for still image crowd counting
    Wang, Luyang
    Yin, Baoqun
    Guo, Aixin
    Ma, Hao
    Cao, Jie
    APPLIED INTELLIGENCE, 2018, 48 (10) : 3360 - 3371