FAITH: Frequency-domain Attention In Two Horizons for time series forecasting

被引:0
|
作者
Li, Ruiqi [1 ,2 ,3 ]
Jiang, Maowei [1 ,2 ,3 ]
Liu, Quangao [1 ,2 ,3 ]
Wang, Kai [1 ,2 ]
Feng, Kaiduo [1 ,2 ,3 ]
Sun, Yue [4 ]
Zhou, Xiufang [1 ,2 ,3 ]
机构
[1] Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, China
[2] Shenyang Institute of Automation, Chinese Academy of Sciences, China
[3] University of Chinese Academy of Sciences, China
[4] Shenyang University of Technology, School of Information Science and Engineering, Shenyang,110870, China
关键词
Linear transformations;
D O I
10.1016/j.knosys.2024.112790
中图分类号
学科分类号
摘要
Time Series Forecasting (TSF) plays a crucial role in various sectors, including industrial maintenance, weather prediction, energy management, traffic control, and financial planning. Current deep learning-based predictive models often exhibit significant deviations between their forecasting outcomes and the ground truth because they lack an efficient method to extract both the global frequency-domain information of each variable and the relationships between different variables. To tackle this challenge, we introduce an innovative model—Frequency-domain Attention In Two Horizons (FAITH). FAITH decomposes time series into trend and seasonal components using a multi-scale adaptive decomposition and fusion architecture and processes them separately. It utilizes two modules — the Frequency Channel Feature Extraction Module (FCEM) and the Frequency Temporal Feature Extraction Module (FTEM) — to capture inter-channel relationships at a finer granularity and to extract global temporal information from the frequency domain of different variables. This significantly enhances its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time–frequency domain transformation method, effectively reducing computational costs. Extensive experiments across six benchmarks for long-term forecasting and five benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in various domains, such as electricity, weather, and traffic. These results validate the effectiveness and superiority of FAITH in both long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH © 2024
引用
下载
收藏
相关论文
共 50 条
  • [31] WEIGHTED LEAST-SQUARES ESTIMATORS ON THE FREQUENCY-DOMAIN FOR THE PARAMETERS OF A TIME-SERIES
    CHIU, ST
    ANNALS OF STATISTICS, 1988, 16 (03): : 1315 - 1326
  • [32] Frequency-domain analysis of the static synchronous series compensator
    Pradhan, AC
    Lehn, PW
    IEEE TRANSACTIONS ON POWER DELIVERY, 2006, 21 (01) : 440 - 449
  • [33] Research On Frequency-Domain Kernel Identification Of Volterra Series
    Wu, Shihao
    Meng, Yafeng
    Wang, Bo
    PROCEEDINGS OF THE 2017 2ND JOINT INTERNATIONAL INFORMATION TECHNOLOGY, MECHANICAL AND ELECTRONIC ENGINEERING CONFERENCE (JIMEC 2017), 2017, 62 : 517 - 521
  • [34] Network self attention for forecasting time series
    Hu, Yuntong
    Xiao, Fuyuan
    Applied Soft Computing, 2022, 124
  • [35] A COMPARISON OF TIME AND FREQUENCY-DOMAIN GEOMAGNETIC SOUNDING
    BEAMISH, D
    GEOPHYSICAL JOURNAL OF THE ROYAL ASTRONOMICAL SOCIETY, 1983, 73 (03): : 689 - 704
  • [36] Simultaneous time- and frequency-domain extrapolation
    Adve, RS
    Sarkar, TK
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 1998, 46 (04) : 484 - 493
  • [37] VISCOELASTIC FORMULATIONS OF BEM IN TIME AND FREQUENCY-DOMAIN
    GAUL, L
    SCHANZ, M
    FIEDLER, C
    ENGINEERING ANALYSIS WITH BOUNDARY ELEMENTS, 1992, 10 (02) : 137 - 141
  • [38] TIME AND FREQUENCY-DOMAIN IMPLEMENTATIONS OF DATA WINDOWS
    PRABHU, KMM
    AGRAWAL, JP
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 1979, 33 (05): : 224 - 226
  • [39] FEDAF: frequency enhanced decomposed attention free transformer for long time series forecasting
    Yang X.
    Li H.
    Huang X.
    Feng X.
    Neural Computing and Applications, 2024, 36 (26) : 16271 - 16288
  • [40] TIME AND FREQUENCY-DOMAIN ANALYSES OF HYDROLOGICAL SYSTEMS
    HUTHMANN, G
    WILKE, K
    JOURNAL OF HYDROLOGY, 1982, 55 (1-4) : 347 - 369