Saliency-Aware Dual Embedded Attention Network for Multivariate Time-Series Forecasting in Information Technology Operations

被引:2
|
作者
Li, Jiajia [1 ,2 ,3 ]
Tan, Feng [3 ]
He, Cheng [4 ]
Wang, Zikai [3 ]
Song, Haitao [3 ]
Hu, Pengwei [5 ]
Luo, Xin [6 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Chem & Chem Engn, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Natl Ctr Translat Med, Shanghai 200240, Peoples R China
[3] Shanghai Artificial Intelligence Res Inst, Shanghai 200240, Peoples R China
[4] Shanghai Dingmao Informat Technol Inc, Shanghai 200061, Peoples R China
[5] Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 12381, Peoples R China
[6] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
关键词
Attention mechanism; deep neural network (DNN); feature fusion; multivariate time series; time-series prediction; NEURAL-NETWORK; MACHINE;
D O I
10.1109/TII.2023.3315369
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of artificial intelligence for information technology operations, operational data are often modeled as aperiodic multivariate time series, which contain rich multidimensional and nonlinear patterns. However, the existing approaches are unable to effectively acquire knowledge and recognize patterns due to their reliance on processing and modeling periodic patterns. To address this issue, this article proposes a novel deep-saliency-aware dual embedded attention network for aperiodic multivariate time-series forecasting. Our network consists of three main components: 1) a convolutional-neural-network- and transformer-based component for saliency representation of the aperiodic patterns; 2) a lightweight recurrent neural network component for capturing long-term dependence features; and 3) an attention mechanism for fusing the latent representations from the former components. Extensive empirical studies are conducted on a real-world dataset and five other public datasets to evaluate the proposed network against four state-of-the-art models. The results show that our method achieves impressive high performance on most evaluation metrics. Furthermore, the data and code used in this study are publicly available, which can facilitate progress in the community.
引用
收藏
页码:4206 / 4217
页数:12
相关论文
共 50 条
  • [21] Long-Term Multivariate Time-Series Forecasting Model Based on Gaussian Fuzzy Information Granules
    Zhu, Chenglong
    Ma, Xueling
    D'Urso, Pierpaolo
    Qian, Yuhua
    Ding, Weiping
    Zhan, Jianming
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2024, 32 (11) : 6424 - 6438
  • [22] DAMixer: A dual-stage attention-based mixer model for multivariate time series forecasting
    Wan, Jiashan
    Xia, Na
    Cai, Bing
    Li, Gongwen
    Wei, Sizhou
    Pan, Xulei
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 274
  • [23] Recurrent Neural Network-Augmented Locally Adaptive Interpretable Regression for Multivariate Time-Series Forecasting
    Munkhdalai, Lkhagvadorj
    Munkhdalai, Tsendsuren
    Van-Huy Pham
    Li, Meijing
    Ryu, Keun Ho
    Theera-Umpon, Nipon
    IEEE ACCESS, 2022, 10 : 11871 - 11885
  • [24] Low-Rank Temporal Attention-Augmented Bilinear Network for financial time-series forecasting
    Shabani, Mostafa
    Iosifidis, Alexandros
    2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2020, : 2156 - 2161
  • [25] Multi-step forecasting of multivariate time series using multi-attention collaborative network
    He, Xiaoyu
    Shi, Suixiang
    Geng, Xiulin
    Yu, Jie
    Xu, Lingyu
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211
  • [26] Spatiotemporal graph neural network for multivariate multi-step ahead time-series forecasting of sea temperature
    Kim, Jinah
    Kim, Taekyung
    Ryu, Joon-Gyu
    Kim, Jaeil
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [27] Clustering-property Matters: A Cluster-aware Network for Large Scale Multivariate Time Series Forecasting
    Wang, Yuan
    Shao, Zezhi
    Sun, Tao
    Yu, Chengqing
    Xu, Yongjun
    Wang, Fei
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 4340 - 4344
  • [28] DATA-GRU: Dual-Attention Time-Aware Gated Recurrent Unit for Irregular Multivariate Time Series
    Tan, Qingxiong
    Ye, Mang
    Yang, Baoyao
    Liu, Si-Qi
    Ma, Andy Jinhua
    Yip, Terry Cheuk-Fung
    Wong, Grace Lai-Hung
    Yuen, Pong C.
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 930 - 937
  • [29] A dual-topological graph memory network for anti-noise multivariate time series forecasting
    Zhang, Minglan
    Sun, Linfu
    Zou, Yisheng
    Yang, Jing
    INFORMATION SCIENCES, 2024, 681
  • [30] AComNN: Attention enhanced Compound Neural Network for financial time-series forecasting with cross-regional features
    Yang, Zhen
    Keung, Jacky
    Kabir, Md Alamgir
    Yu, Xiao
    Tang, Yutian
    Zhang, Miao
    Feng, Shuo
    APPLIED SOFT COMPUTING, 2021, 111