Saliency-Aware Dual Embedded Attention Network for Multivariate Time-Series Forecasting in Information Technology Operations

被引:2
|
作者
Li, Jiajia [1 ,2 ,3 ]
Tan, Feng [3 ]
He, Cheng [4 ]
Wang, Zikai [3 ]
Song, Haitao [3 ]
Hu, Pengwei [5 ]
Luo, Xin [6 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Chem & Chem Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Shanghai 200240, Peoples R China
[3] Shanghai Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[4] Shanghai Dingmao Informat Technol Inc, Shanghai 200061, Peoples R China
[5] Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 12381, Peoples R China
[6] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
关键词
Attention mechanism; deep neural network (DNN); feature fusion; multivariate time series; time-series prediction; NEURAL-NETWORK; MACHINE;
D O I
10.1109/TII.2023.3315369
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of artificial intelligence for information technology operations, operational data are often modeled as aperiodic multivariate time series, which contain rich multidimensional and nonlinear patterns. However, the existing approaches are unable to effectively acquire knowledge and recognize patterns due to their reliance on processing and modeling periodic patterns. To address this issue, this article proposes a novel deep-saliency-aware dual embedded attention network for aperiodic multivariate time-series forecasting. Our network consists of three main components: 1) a convolutional-neural-network- and transformer-based component for saliency representation of the aperiodic patterns; 2) a lightweight recurrent neural network component for capturing long-term dependence features; and 3) an attention mechanism for fusing the latent representations from the former components. Extensive empirical studies are conducted on a real-world dataset and five other public datasets to evaluate the proposed network against four state-of-the-art models. The results show that our method achieves impressive high performance on most evaluation metrics. Furthermore, the data and code used in this study are publicly available, which can facilitate progress in the community.
引用
收藏
页码:4206 / 4217
页数:12
相关论文
共 50 条
  • [1] StackDA: A Stacked Dual Attention Neural Network for Multivariate Time-Series Forecasting
    Hong, Jungsoo
    Park, Jinuk
    Park, Sanghyun
    IEEE ACCESS, 2021, 9 : 145955 - 145967
  • [2] A Multivariate Temporal Convolutional Attention Network for Time-Series Forecasting
    Wan, Renzhuo
    Tian, Chengde
    Zhang, Wei
    Deng, Wendi
    Yang, Fan
    ELECTRONICS, 2022, 11 (10)
  • [3] Interpretable Fuzzy Embedded Neural Network for Multivariate Time-Series Forecasting
    La, Hoang-Loc
    Tran, Vi Ngoc-Nha
    La, Hung Manh
    Ha, Phuong Hoai
    INTELLIGENT INFORMATION AND DATABASE SYSTEMS, PT II, ACIIDS 2024, 2024, 14796 : 317 - 331
  • [4] Information-aware attention dynamic synergetic network for multivariate time series long-term forecasting
    He, Xiaoyu
    Shi, Suixiang
    Geng, Xiulin
    Xu, Lingyu
    NEUROCOMPUTING, 2022, 500 : 143 - 154
  • [5] DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting
    Huang, Siteng
    Wang, Donglin
    Wu, Xuehan
    Tang, Ao
    PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2129 - 2132
  • [6] Cluster-aware attentive convolutional recurrent network for multivariate time-series forecasting
    Bai, Simeng
    Zhang, Qi
    He, Hui
    Hu, Liang
    Wang, Shoujin
    Niu, Zhendong
    NEUROCOMPUTING, 2023, 558
  • [7] DEformer: Dual Embedded Transformer for Multivariate Time Series Forecasting
    Kim, Minje
    Lee, Suwon
    Choi, Sang-Min
    IEEE ACCESS, 2024, 12 : 153851 - 153858
  • [8] MrCAN: Multi-relations aware convolutional attention network for multivariate time series forecasting
    Zhang, Jing
    Dai, Qun
    INFORMATION SCIENCES, 2023, 643
  • [9] Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
    Cao, Defu
    Wang, Yujing
    Duan, Juanyong
    Zhang, Ce
    Zhu, Xia
    Huang, Conguri
    Tong, Yunhai
    Xu, Bixiong
    Bai, Jing
    Tong, Jie
    Zhang, Qi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [10] SageFormer: Series-Aware Framework for Long-Term Multivariate Time-Series Forecasting
    Zhang, Zhenwei
    Meng, Linghang
    Gu, Yuantao
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (10): : 18435 - 18448