Saliency-Aware Dual Embedded Attention Network for Multivariate Time-Series Forecasting in Information Technology Operations

被引:2
|
作者
Li, Jiajia [1 ,2 ,3 ]
Tan, Feng [3 ]
He, Cheng [4 ]
Wang, Zikai [3 ]
Song, Haitao [3 ]
Hu, Pengwei [5 ]
Luo, Xin [6 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Chem & Chem Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Shanghai 200240, Peoples R China
[3] Shanghai Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[4] Shanghai Dingmao Informat Technol Inc, Shanghai 200061, Peoples R China
[5] Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 12381, Peoples R China
[6] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
关键词
Attention mechanism; deep neural network (DNN); feature fusion; multivariate time series; time-series prediction; NEURAL-NETWORK; MACHINE;
D O I
10.1109/TII.2023.3315369
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of artificial intelligence for information technology operations, operational data are often modeled as aperiodic multivariate time series, which contain rich multidimensional and nonlinear patterns. However, the existing approaches are unable to effectively acquire knowledge and recognize patterns due to their reliance on processing and modeling periodic patterns. To address this issue, this article proposes a novel deep-saliency-aware dual embedded attention network for aperiodic multivariate time-series forecasting. Our network consists of three main components: 1) a convolutional-neural-network- and transformer-based component for saliency representation of the aperiodic patterns; 2) a lightweight recurrent neural network component for capturing long-term dependence features; and 3) an attention mechanism for fusing the latent representations from the former components. Extensive empirical studies are conducted on a real-world dataset and five other public datasets to evaluate the proposed network against four state-of-the-art models. The results show that our method achieves impressive high performance on most evaluation metrics. Furthermore, the data and code used in this study are publicly available, which can facilitate progress in the community.
引用
收藏
页码:4206 / 4217
页数:12
相关论文
共 50 条
  • [41] DBFF-GRU: dual-branch temporal feature fusion network with fast GRU for multivariate time series forecasting
    Li, Jinglei
    Liu, Dongsheng
    Ma, Guofang
    Chen, Yaning
    Jiang, Hongwei
    APPLIED INTELLIGENCE, 2025, 55 (07)
  • [42] A new multivariate decomposition-ensemble approach with denoised neighborhood rough set for stock price forecasting over time-series information system
    Bai, Juncheng
    Sun, Bingzhen
    Guo, Yuqi
    Chu, Xiaoli
    APPLIED INTELLIGENCE, 2025, 55 (04)
  • [43] Multivariate Bayesian Time-Series Model with Multi-temporal Convolution Network for Forecasting Stock Market During COVID-19 Pandemic
    Ray, Paramita
    Ganguli, Bhaswati
    Chakrabarti, Amlan
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
  • [44] SDVS-Net: A spatial dilated convolution and variable self-attention network for multivariate long-term time series forecasting
    Tian, Xiaoyi
    Huang, Siyuan
    Xiao, Jinjie
    Wang, Han
    Liu, Yepeng
    NEUROCOMPUTING, 2025, 619
  • [45] W-FENet: Wavelet-based Fourier-Enhanced Network Model Decomposition for Multivariate Long-Term Time-Series Forecasting
    Wang, Hai-Kun
    Zhang, Xuewei
    Long, Haicheng
    Yao, Shunyu
    Zhu, Pengjin
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [46] W-FENet: Wavelet-based Fourier-Enhanced Network Model Decomposition for Multivariate Long-Term Time-Series Forecasting
    Hai-Kun Wang
    Xuewei Zhang
    Haicheng Long
    Shunyu Yao
    Pengjin Zhu
    Neural Processing Letters, 56
  • [47] A detection based on particle filtering and multivariate time-series anomaly detection via graph attention network for automatic voltage control attack in smart grid
    Lu, Zhigang
    Zhao, Guangxuan
    Kong, Xiangxing
    Chen, Jianhua
    Guo, Xiaoqiang
    Zhang, Jiangfeng
    SUSTAINABLE ENERGY GRIDS & NETWORKS, 2024, 40
  • [48] Online state of health estimation for lithium-ion batteries based on a dual self-attention multivariate time series prediction network
    Wang, Huanyu
    Li, Jun
    Liu, Xiaoxi
    Rao, Jun
    Fan, Yuqian
    Tan, Xiaojun
    ENERGY REPORTS, 2022, 8 : 8953 - 8964
  • [49] A dual-stage attention-based Conv-LSTM network for spatio-temporal correlation and multivariate time series prediction
    Xiao, Yuteng
    Yin, Hongsheng
    Zhang, Yudong
    Qi, Honggang
    Zhang, Yundong
    Liu, Zhaoyang
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (05) : 2036 - 2057
  • [50] A Hybrid Framework for Multivariate Time Series Forecasting of Daily Urban Water Demand Using Attention-Based Convolutional Neural Network and Long Short-Term Memory Network
    Zhou, Shengwen
    Guo, Shunsheng
    Du, Baigang
    Huang, Shuo
    Guo, Jun
    SUSTAINABILITY, 2022, 14 (17)