DESCINet: A hierarchical deep convolutional neural network with skip connection for long time series forecasting

被引:7
|
作者
Silva, Andre Quintiliano Bezerra [1 ]
Goncalves, Wesley Nunes [2 ]
Matsubara, Edson Takashi [2 ]
机构
[1] Fed Inst Educ Sci & Technol Mato Grosso Do Sul, BR-79240000 Campo Grande, MS, Brazil
[2] Univ Fed Mato Grosso do Sul, BR-79010210 Campo Grande, MS, Brazil
关键词
Long sequence time-series forecasting; Skip connections; Convolutional neural networks (CNNs); Deep learning (DL); SINGULARITIES; PREDICTION; DYNAMICS; LSTM;
D O I
10.1016/j.eswa.2023.120246
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series forecasting is the process of predicting future values of a time series from knowledge of its past data. Although there are several models for making short-term predictions, the problem of long temporal sequences can still receive new contributions. Recent studies have applied Transformers-based solutions to the long-time series forecasting task and achieved good results. When it comes to time series modeling, the goal is to capture the temporal relationships within a sequence of ordered and continuous points. While using positional encoding and embedding sub-series as tokens in Transformers can help to preserve some ordering information, the permutation-invariant self-attention mechanism used in these models can lead to loss of temporal information. In this paper, we used convolutional networks in a binary tree structure with skip connections between the levels of the tree that allowed greater precision and efficiency in the training. The proposed model was evaluated on five real-life datasets. Experimental results show that our model significantly improves forecast accuracy relative to existing solutions.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] A Neural Network Approach to Time Series Forecasting
    Gheyas, Iffat A.
    Smith, Leslie S.
    WORLD CONGRESS ON ENGINEERING 2009, VOLS I AND II, 2009, : 1292 - 1296
  • [32] Time Series Neural Network Forecasting Methods
    WEN Xinhui
    CHEN Keizhou(The Centlal of Neural Netwolk
    JournalofSystemsScienceandSystemsEngineering, 1996, (01) : 24 - 32
  • [33] TIME SERIES NEURAL NETWORK FORECASTING METHODS
    文新辉
    陈开周
    JournalofElectronics(China), 1995, (01) : 1 - 8
  • [34] Time series forecasting with RBF neural network
    Yan, XB
    Wang, Z
    Yu, SH
    Li, YJ
    PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, 2005, : 4680 - 4683
  • [35] A Neural Network Scheme for Long-Term Forecasting of Chaotic Time Series
    Pilar Gómez-Gil
    Juan Manuel Ramírez-Cortes
    Saúl E. Pomares Hernández
    Vicente Alarcón-Aquino
    Neural Processing Letters, 2011, 33 : 215 - 233
  • [36] A Neural Network Scheme for Long-Term Forecasting of Chaotic Time Series
    Gomez-Gil, Pilar
    Manuel Ramirez-Cortes, Juan
    Pomares Hernandez, Saul E.
    Alarcon-Aquino, Vicente
    NEURAL PROCESSING LETTERS, 2011, 33 (03) : 215 - 233
  • [37] Temporal Convolutional Attention Neural Networks for Time Series Forecasting
    Lin, Yang
    Koprinska, Irena
    Rana, Mashud
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [38] A Novel Model Based on DA-RNN Network and Skip Gated Recurrent Neural Network for Periodic Time Series Forecasting
    Huang, Bingqing
    Zheng, Haonan
    Guo, Xinbo
    Yang, Yi
    Liu, Ximing
    SUSTAINABILITY, 2022, 14 (01)
  • [39] Hypertuned wavelet convolutional neural network with long short-term memory for time series forecasting in hydroelectric power plants
    Stefenon, Stefano Frizzo
    Seman, Laio Oriel
    da Silva, Evandro Cardozo
    Finardi, Erlon Cristian
    Coelho, Leandro dos Santos
    Mariani, Viviana Cocco
    ENERGY, 2024, 313
  • [40] ConvTimeNet: A Pre-trained Deep Convolutional Neural Network for Time Series Classification
    Kashiparekh, Kathan
    Narwariya, Jyoti
    Malhotra, Pankaj
    Vig, Lovekesh
    Shroff, Gautam
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,