Saliency-Aware Dual Embedded Attention Network for Multivariate Time-Series Forecasting in Information Technology Operations

被引:2
|
作者
Li, Jiajia [1 ,2 ,3 ]
Tan, Feng [3 ]
He, Cheng [4 ]
Wang, Zikai [3 ]
Song, Haitao [3 ]
Hu, Pengwei [5 ]
Luo, Xin [6 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Chem & Chem Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Shanghai 200240, Peoples R China
[3] Shanghai Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[4] Shanghai Dingmao Informat Technol Inc, Shanghai 200061, Peoples R China
[5] Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 12381, Peoples R China
[6] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
关键词
Attention mechanism; deep neural network (DNN); feature fusion; multivariate time series; time-series prediction; NEURAL-NETWORK; MACHINE;
D O I
10.1109/TII.2023.3315369
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of artificial intelligence for information technology operations, operational data are often modeled as aperiodic multivariate time series, which contain rich multidimensional and nonlinear patterns. However, the existing approaches are unable to effectively acquire knowledge and recognize patterns due to their reliance on processing and modeling periodic patterns. To address this issue, this article proposes a novel deep-saliency-aware dual embedded attention network for aperiodic multivariate time-series forecasting. Our network consists of three main components: 1) a convolutional-neural-network- and transformer-based component for saliency representation of the aperiodic patterns; 2) a lightweight recurrent neural network component for capturing long-term dependence features; and 3) an attention mechanism for fusing the latent representations from the former components. Extensive empirical studies are conducted on a real-world dataset and five other public datasets to evaluate the proposed network against four state-of-the-art models. The results show that our method achieves impressive high performance on most evaluation metrics. Furthermore, the data and code used in this study are publicly available, which can facilitate progress in the community.
引用
收藏
页码:4206 / 4217
页数:12
相关论文
共 50 条
  • [31] TC-GATN: Temporal Causal Graph Attention Networks With Nonlinear Paradigm for Multivariate Time-Series Forecasting in Industrial Processes
    Li, Jince
    Shi, Yilin
    Li, Hongguang
    Yang, Bo
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (06) : 7592 - 7601
  • [32] An electric power forecasting method based on dual time series attention mechanism neural network structure
    Zhan, Xianghao
    Lei, Lifeng
    Kou, Liang
    2021 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C 2021), 2021, : 918 - 925
  • [33] Multi-attention network with redundant information filtering for multi-horizon in multivariate time series
    Geng, Xiulin
    He, Xiaoyu
    Hu, Miao
    Bi, Meihua
    Teng, Xuyang
    Wu, Chao
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 257
  • [34] A decoupled network with variable graph convolution and temporal external attention for long-term multivariate time series forecasting
    Liu, Yepeng
    Huang, Zhigen
    Zhang, Fan
    Zhang, Xiaofeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 271
  • [35] A Dual Attention Convolutional Neural Network for Crop Classification Using Time-Series Sentinel-2 Imagery
    Seydi, Seyd Teymoor
    Amani, Meisam
    Ghorbanian, Arsalan
    REMOTE SENSING, 2022, 14 (03)
  • [36] A dual-stage attention-based Bi-LSTM network for multivariate time series prediction
    Qi Cheng
    Yixin Chen
    Yuteng Xiao
    Hongsheng Yin
    Weidong Liu
    The Journal of Supercomputing, 2022, 78 : 16214 - 16235
  • [37] A dual-stage attention-based Bi-LSTM network for multivariate time series prediction
    Cheng, Qi
    Chen, Yixin
    Xiao, Yuteng
    Yin, Hongsheng
    Liu, Weidong
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (14): : 16214 - 16235
  • [38] Personalized Graph Attention Network for Multivariate Time-series Change Analysis: A Case Study on Long-term Maternal Monitoring
    Wang, Yuning
    Azimi, Iman
    Feli, Mohammad
    Rahmani, Amir M.
    Liljeberg, Pasi
    38TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2023, 2023, : 593 - 598
  • [39] Multi-attention Generative Adversarial Network for multi-step vegetation indices forecasting using multivariate time series
    Ferchichi, Aya
    Abbes, Ali Ben
    Barra, Vincent
    Rhif, Manel
    Farah, Imed Riadh
    Engineering Applications of Artificial Intelligence, 2024, 128
  • [40] Multi-attention Generative Adversarial Network for multi-step vegetation indices forecasting using multivariate time series
    Ferchichi, Aya
    Ben Abbes, Ali
    Barra, Vincent
    Rhif, Manel
    Farah, Imed Riadh
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 128