FAITH: Frequency-domain Attention In Two Horizons for time series forecasting

被引:0
|
作者
Li, Ruiqi [1 ,2 ,3 ]
Jiang, Maowei [1 ,2 ,3 ]
Liu, Quangao [1 ,2 ,3 ]
Wang, Kai [1 ,2 ]
Feng, Kaiduo [1 ,2 ,3 ]
Sun, Yue [4 ]
Zhou, Xiufang [1 ,2 ,3 ]
机构
[1] Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, China
[2] Shenyang Institute of Automation, Chinese Academy of Sciences, China
[3] University of Chinese Academy of Sciences, China
[4] Shenyang University of Technology, School of Information Science and Engineering, Shenyang,110870, China
关键词
Linear transformations;
D O I
10.1016/j.knosys.2024.112790
中图分类号
学科分类号
摘要
Time Series Forecasting (TSF) plays a crucial role in various sectors, including industrial maintenance, weather prediction, energy management, traffic control, and financial planning. Current deep learning-based predictive models often exhibit significant deviations between their forecasting outcomes and the ground truth because they lack an efficient method to extract both the global frequency-domain information of each variable and the relationships between different variables. To tackle this challenge, we introduce an innovative model—Frequency-domain Attention In Two Horizons (FAITH). FAITH decomposes time series into trend and seasonal components using a multi-scale adaptive decomposition and fusion architecture and processes them separately. It utilizes two modules — the Frequency Channel Feature Extraction Module (FCEM) and the Frequency Temporal Feature Extraction Module (FTEM) — to capture inter-channel relationships at a finer granularity and to extract global temporal information from the frequency domain of different variables. This significantly enhances its ability to handle long-term dependencies and complex patterns. Furthermore, FAITH achieves theoretically linear complexity by modifying the time–frequency domain transformation method, effectively reducing computational costs. Extensive experiments across six benchmarks for long-term forecasting and five benchmarks for short-term forecasting demonstrate that FAITH outperforms existing models in various domains, such as electricity, weather, and traffic. These results validate the effectiveness and superiority of FAITH in both long-term and short-term time series forecasting tasks. Our codes and data are available at https://github.com/LRQ577/FAITH © 2024
引用
下载
收藏
相关论文
共 50 条
  • [1] Frequency-domain MLPs are More Effective Learners in Time Series Forecasting
    Yi, Kun
    Zhang, Qi
    Fan, Wei
    Wang, Shoujin
    Wang, Pengyang
    He, Hui
    Lian, Defu
    An, Ning
    Cao, Longbing
    Niu, Zhendong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] A FREQUENCY-DOMAIN MEDIAN TIME-SERIES
    ZEGER, SL
    HURVICH, CM
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1987, 82 (399) : 832 - 835
  • [3] Testing Frequency-Domain Causality in Multivariate Time Series
    Faes, Luca
    Porta, Alberto
    Nollo, Giandomenico
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (08) : 1897 - 1906
  • [4] FLRNN-FGA: Fractional-Order Lipschitz Recurrent Neural Network with Frequency-Domain Gated Attention Mechanism for Time Series Forecasting
    Zhao, Chunna
    Ye, Junjie
    Zhu, Zelong
    Huang, Yaqun
    FRACTAL AND FRACTIONAL, 2024, 8 (07)
  • [5] Forecasting solar irradiance at short horizons: Frequency and time domain models
    Reikard, Gordon
    Hansen, Clifford
    RENEWABLE ENERGY, 2019, 135 : 1270 - 1290
  • [6] Domain Adaptation for Time Series Forecasting via Attention Sharing
    Jin, Xiaoyong
    Park, Youngsuk
    Maddix, Danielle C.
    Wang, Hao
    Wang, Yuyang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022, : 10280 - 10297
  • [8] Segmented Frequency-Domain Correlation Prediction Model for Long-Term Time Series Forecasting Using Transformer
    Tong, Haozhuo
    Kong, Lingyun
    Liu, Jie
    Gao, Shiyan
    Xu, Yilu
    Chen, Yuezhe
    IET SOFTWARE, 2024, 2024
  • [9] Time and frequency-domain feature fusion network for multivariate time series classification
    Lei, Tianyang
    Li, Jichao
    Yang, Kewei
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 252
  • [10] TIME TO FREQUENCY-DOMAIN TRANSFORMS
    HAVRILIAK, S
    HAVRILIAK, SJ
    POLYMER, 1995, 36 (14) : 2675 - 2680