MLGN: multi-scale local-global feature learning network for long-term series forecasting

被引:0
|
作者
Jiang, Maowei [1 ,2 ,3 ,4 ]
Wang, Kai [1 ,2 ,3 ]
Sun, Yue [1 ,2 ,3 ,4 ]
Chen, Wenbo [1 ,2 ,3 ,4 ]
Xia, Bingjie [1 ,2 ,3 ,4 ]
Li, Ruiqi [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Key Lab Networked Control Syst, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automation, Shenyang, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang, Peoples R China
[4] Univ Chinese Acad Sci, Shenyang, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
time series forecasting; multi-sale; local-global feature extraction; deep learning; machine learning; long-term sequence forecasting;
D O I
10.1088/2632-2153/ad1436
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Transformer-based methods have achieved remarkable performance in the field of long-term series forecasting, they can be computationally expensive and lack the ability to specifically model local features as CNNs. CNN-based methods, such as temporal convolutional network (TCN), utilize convolutional filters to capture local temporal features. However, the intermediate layers of TCN suffer from a limited effective receptive field, which can result in the loss of temporal relations during global feature extraction.To solve the above problems, we propose to combine local features and global correlations to capture the overall view of time series (e.g. fluctuations, trends). To fully exploit the underlying information in the time series, a multi-scale branch structure is adopted to model different potential patterns separately. Each pattern is extracted using a combination of interactive learning convolution and causal frequency enhancement to capture both local features and global correlations. Furthermore, our proposed method,multi-scale local-global feature learning network (MLGN), achieves a time and memory complexity of O(L) and consistently achieve state-of-the-art results on six benchmark datasets. In comparision with previous best method Fedformer, MLGN yields 12.98% and 11.38% relative improvements for multivariate and univariate time series, respectively. Our code and data are available on Github at https://github.com/Zero-coder/MLGN.
引用
收藏
页数:25
相关论文
共 50 条
  • [21] Multi-scale global context feature pyramid network for object detector
    Yunhao Li
    Mingwen Shao
    Bingbing Fan
    Wei Zhang
    Signal, Image and Video Processing, 2022, 16 : 705 - 713
  • [22] Multi-scale feature fusion network with local attention for lung segmentation
    Xie, Yinghua
    Zhou, Yuntong
    Wang, Chen
    Ma, Yanshan
    Yang, Ming
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119
  • [23] Multi-scale global context feature pyramid network for object detector
    Li, Yunhao
    Shao, Mingwen
    Fan, Bingbing
    Zhang, Wei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (03) : 705 - 713
  • [24] GLOBAL AND MULTI-SCALE FEATURE LEARNING FOR REMOTE SENSING SCENE CLASSIFICATION
    Xia, Ziying
    Gan, Guolong
    Liu, Siyu
    Cao, Wei
    Cheng, Jian
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 655 - 658
  • [25] STWave+: A Multi-Scale Efficient Spectral Graph Attention Network With Long-Term Trends for Disentangled Traffic Flow Forecasting
    Fang, Yuchen
    Qin, Yanjun
    Luo, Haiyong
    Zhao, Fang
    Zheng, Kai
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (06) : 2671 - 2685
  • [26] User Level Ultra-short-term Load Forecasting Based on Multi-scale Component Feature Learning
    Zang H.
    Chen Y.
    Cheng L.
    Zhu K.
    Zhang Y.
    Sun G.
    Wei Z.
    Dianwang Jishu/Power System Technology, 2024, 48 (06): : 2584 - 2592
  • [27] MS-MixVPR: Multi-scale Feature Mixing Approach for Long-Term Place Recognition
    Quach M.-D.
    Vo D.-M.
    Pham H.-A.
    SN Computer Science, 5 (6)
  • [28] Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting
    Chen L.
    Chen D.
    Shang Z.
    Wu B.
    Zheng C.
    Wen B.
    Zhang W.
    IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10) : 10748 - 10761
  • [29] Short-Term Load Forecasting Based on Multi-Scale Ensemble Deep Learning Neural Network
    Shen, Qin
    Mo, Li
    Liu, Guanjun
    Zhou, Jianzhong
    Zhang, Yongchuan
    Ren, Pinan
    IEEE ACCESS, 2023, 11 : 111963 - 111975
  • [30] MLFEN: Multi-scale Long-Distance Feature Extraction Network
    Wang, Yuhua
    Lian, Yuhao
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2023, PT I, 2023, 14134 : 189 - 199