DESCINet: A hierarchical deep convolutional neural network with skip connection for long time series forecasting

被引:7
|
作者
Silva, Andre Quintiliano Bezerra [1 ]
Goncalves, Wesley Nunes [2 ]
Matsubara, Edson Takashi [2 ]
机构
[1] Fed Inst Educ Sci & Technol Mato Grosso Do Sul, BR-79240000 Campo Grande, MS, Brazil
[2] Univ Fed Mato Grosso do Sul, BR-79010210 Campo Grande, MS, Brazil
关键词
Long sequence time-series forecasting; Skip connections; Convolutional neural networks (CNNs); Deep learning (DL); SINGULARITIES; PREDICTION; DYNAMICS; LSTM;
D O I
10.1016/j.eswa.2023.120246
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Time series forecasting is the process of predicting future values of a time series from knowledge of its past data. Although there are several models for making short-term predictions, the problem of long temporal sequences can still receive new contributions. Recent studies have applied Transformers-based solutions to the long-time series forecasting task and achieved good results. When it comes to time series modeling, the goal is to capture the temporal relationships within a sequence of ordered and continuous points. While using positional encoding and embedding sub-series as tokens in Transformers can help to preserve some ordering information, the permutation-invariant self-attention mechanism used in these models can lead to loss of temporal information. In this paper, we used convolutional networks in a binary tree structure with skip connections between the levels of the tree that allowed greater precision and efficiency in the training. The proposed model was evaluated on five real-life datasets. Experimental results show that our model significantly improves forecast accuracy relative to existing solutions.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms
    Ghimire, Sujan
    Deo, Ravinesh C.
    Raj, Nawin
    Mi, Jianchun
    APPLIED ENERGY, 2019, 253
  • [42] A Recurrent Neural Network based Generative Adversarial Network for Long Multivariate Time Series Forecasting
    Tang, Peiwang
    Zhang, Qinghua
    Zhang, Xianchao
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 181 - 189
  • [43] A spatio-temporal decomposition based deep neural network for time series forecasting
    Asadi, Reza
    Regan, Amelia C.
    APPLIED SOFT COMPUTING, 2020, 87
  • [44] HierNBeats: Hierarchical Neural Basis Expansion Analysis for Hierarchical Time Series Forecasting
    Sun, Haoran
    Tu, Wenting
    Zhan, Jiajie
    Zhao, Wanting
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT VI, 2024, 15021 : 251 - 266
  • [45] Volatility forecasting using deep neural network with time-series feature embedding
    Chen, Wei-Jie
    Yao, Jing-Jing
    Shao, Yuan-Hai
    ECONOMIC RESEARCH-EKONOMSKA ISTRAZIVANJA, 2023, 36 (01): : 1377 - 1401
  • [46] Consumer Price Index Forecasting Based on Univariate Time Series and a Deep Neural Network
    Rosado, Reynaldo
    Joan Abreu, Aldis
    Arencibia, Jose C.
    Gonzalez, Hector
    Hernandez, Yanio
    PROGRESS IN ARTIFICIAL INTELLIGENCE AND PATTERN RECOGNITION, 2021, 13055 : 33 - 42
  • [47] Time Series Load Forecasting Using Pooling Based Multitasking Deep Neural Network
    Kiruithiga, D.
    Manikandan, V
    2021 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2021,
  • [48] New deep recurrent hybrid artificial neural network for forecasting seasonal time series
    Karahasan O.
    Bas E.
    Egrioglu E.
    Granular Computing, 2024, 9 (01)
  • [49] A Deep Neural Network for Anomaly Detection and Forecasting for Multivariate Time Series in Smart City
    He, Junjie
    Dong, Min
    Bi, Sheng
    Zhao, Weijie
    Liao, Xutao
    2019 9TH IEEE ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER 2019), 2019, : 615 - 620
  • [50] ROI-Binarized Hyperbolic Region Segmentation and Characterization by Using Deep Residual Convolutional Neural Network with Skip Connection for GPR Imaging
    Zhang, Hua
    Dai, Qianwei
    Feng, Deshan
    Wang, Xun
    Zhang, Bin
    APPLIED SCIENCES-BASEL, 2024, 14 (11):