Attention-Based Multi-Scale Prediction Network for Time-Series Data

被引:0
|
作者
Li, Junjie [1 ,2 ]
Zhu, Lin [3 ]
Zhang, Yong [1 ,2 ]
Guo, Da [1 ,2 ]
Xia, Xingwen [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[2] Beijing Univ Posts & Telecommun, Beijing Key Lab Work Safety Intelligent Monitorin, Beijing 100876, Peoples R China
[3] China Mobile Res Inst, Beijing 100053, Peoples R China
基金
中国国家自然科学基金;
关键词
network traffic prediction; attention mechanism; neural network; machine learning; single point forecast;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Time series data is a kind of data accumulated over time, which can describe the change of phenomenon. This kind of data reflects the degree of change of a certain thing or phenomenon. The existing technologies such as LSTM and ARIMA are better than convolutional neural network in time series prediction, but they are not enough to mine the periodicity of data. In this article, we perform periodic analysis on two types of time series data, select time metrics with high periodic characteristics, and propose a multi-scale prediction model based on the attention mechanism for the periodic trend of the data. A loss calculation method for traffic time series characteristics is proposed as well. Multiple experiments have been conducted on actual data sets. The experiments show that the method proposed in this paper has better performance than commonly used traffic prediction methods (ARIMA, LSTM, etc.) and 3%-5% increase on MAPE.
引用
收藏
页码:286 / 301
页数:16
相关论文
共 50 条
  • [1] Attention-Based Multi-Scale Prediction Network for Time-Series Data
    Junjie Li
    Lin Zhu
    Yong Zhang
    Da Guo
    Xingwen Xia
    [J]. China Communications, 2022, 19 (05) : 286 - 301
  • [2] An attention-based multi-scale temporal convolutional network for remaining useful life prediction
    Xu, Zhiqiang
    Zhang, Yujie
    Miao, Qiang
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 250
  • [3] GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing
    Liu, Xiaohong
    Ma, Yongrui
    Shi, Zhihao
    Chen, Jun
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7313 - 7322
  • [4] MADC: Multi-scale Attention-based Deep Clustering for Workload Prediction
    Huang, Jiaming
    Xiao, Chuming
    Wu, Weigang
    Yin, Ye
    Chang, Hongli
    [J]. 19TH IEEE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED PROCESSING WITH APPLICATIONS (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2021), 2021, : 316 - 323
  • [5] AAANE: Attention-Based Adversarial Autoencoder for Multi-scale Network Embedding
    Sang, Lei
    Xu, Min
    Qian, Shengsheng
    Wu, Xindong
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT III, 2019, 11441 : 3 - 14
  • [6] Chaotic time series prediction based on multi-scale attention in a multi-agent environment
    Miao, Hua
    Zhu, Wei
    Dan, Yuanhong
    Yu, Nanxiang
    [J]. CHAOS SOLITONS & FRACTALS, 2024, 183
  • [7] Multi-scale temporal features extraction based graph convolutional network with attention for multivariate time series prediction
    Chen, Yawen
    Ding, Fengqian
    Zhai, Linbo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
  • [8] Multi-scale Temporal Memory for Clinical Event Time-Series Prediction
    Lee, Jeong Min
    Hauskrecht, Milos
    [J]. ARTIFICIAL INTELLIGENCE IN MEDICINE (AIME 2020), 2020, : 313 - 324
  • [9] Attention-based gating optimization network for multivariate time series prediction
    Geng, Xiulin
    He, Xiaoyu
    Xu, Lingyu
    Yu, Jie
    [J]. APPLIED SOFT COMPUTING, 2022, 126
  • [10] Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting
    Gao Changxia
    Zhang Ning
    Li Youru
    Lin Yan
    Wan Huaiyu
    [J]. Applied Intelligence, 2023, 53 : 28974 - 28993