MFAM-AD: an anomaly detection model for multivariate time series using attention mechanism to fuse multi-scale features

被引:0
|
作者
Xia, Shengjie [1 ]
Sun, Wu [1 ]
Zou, Xiaofeng [1 ]
Chen, Panfeng [1 ]
Ma, Dan [1 ]
Xu, Huarong [1 ]
Chen, Mei [1 ]
Li, Hui [1 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Multi-scale; Convolutional neural networks; Bi-directional long short-term memory; Attention mechanism;
D O I
10.7717/peerj-cs.2201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multivariate time series anomaly detection has garnered significant attention in fields such as IT operations, finance, medicine, and industry. However, a key challenge lies in the fact that anomaly patterns often exhibit multi-scale temporal variations, which existing detection models often fail to capture effectively. This limitation significantly impacts detection accuracy. To address this issue, we propose the MFAM-AD model, which combines the strengths of convolutional neural networks (CNNs) and bidirectional long short-term memory (Bi-LSTM). The MFAM-AD model is designed to enhance anomaly detection accuracy by seamlessly integrating temporal dependencies and multi-scale spatial features. Specifically, it utilizes parallel convolutional layers to extract features across different scales, employing an attention mechanism for optimal feature fusion. Additionally, Bi-LSTM is leveraged to capture time-dependent information, reconstruct the time series and enable accurate anomaly detection based on reconstruction errors. In contrast to existing algorithms that struggle with inadequate feature fusion or are confined to single-scale feature analysis, MFAMAD effectively addresses the unique challenges of multivariate time series anomaly detection. Experimental results on five publicly available datasets demonstrate the superiority of the proposed model. Specifically, on the datasets SMAP, MSL, and SMD11, our MFAM-AD model has the second-highest F1 score after the current state-ofthe-art DCdetector model. On the datasets NIPS-TS-SWAN and NIPS-TS-GECCO, the F1 scores of MAFM-AD are 0.046 (6.2%) and 0.09 (21.3%) higher than those of DCdetector, respectively(the value ranges from 0 to 1). These findings validate the MFAMAD model's efficacy in multivariate time series anomaly detection, highlighting its potential in various real-world applications.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] A Multi-scale Parallel Unsupervised Model for Multivariate Time Series Anomaly Detection
    Bao, Junpeng
    Gao, Han
    Zhang, Chengpu
    Jia, Wentao
    Gao, Junzhe
    Yang, Tongzhi
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, PT IV, AIAI 2024, 2024, 714 : 241 - 251
  • [2] Probabilistic autoencoder with multi-scale feature extraction for multivariate time series anomaly detection
    Guangyao Zhang
    Xin Gao
    Lei Wang
    Bing Xue
    Shiyuan Fu
    Jiahao Yu
    Zijian Huang
    Xu Huang
    Applied Intelligence, 2023, 53 : 15855 - 15872
  • [3] Probabilistic autoencoder with multi-scale feature extraction for multivariate time series anomaly detection
    Zhang, Guangyao
    Gao, Xin
    Wang, Lei
    Xue, Bing
    Fu, Shiyuan
    Yu, Jiahao
    Huang, Zijian
    Huang, Xu
    APPLIED INTELLIGENCE, 2023, 53 (12) : 15855 - 15872
  • [4] ACAM-AD: Autocorrelation and attention mechanism-based anomaly detection in multivariate time series
    He, Qiang
    Wang, Guanqun
    Huo, Lianzhi
    Wang, Hengyou
    Zhang, Changlun
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (06) : 9039 - 9051
  • [5] Salient Object Detection Using Multi-Scale Features with Attention Recurrent Mechanism
    Lu S.
    Guo Q.
    Wang R.
    Zhang C.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (12): : 1926 - 1937
  • [6] MST-VAE: Multi-Scale Temporal Variational Autoencoder for Anomaly Detection in Multivariate Time Series
    Pham, Tuan-Anh
    Lee, Jong-Hoon
    Park, Choong-Shik
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [7] Multi-scale temporal features extraction based graph convolutional network with attention for multivariate time series prediction
    Chen, Yawen
    Ding, Fengqian
    Zhai, Linbo
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 200
  • [8] GCFormer: Granger Causality based Attention Mechanism for Multivariate Time Series Anomaly Detection
    Xing, Shiwang
    Niu, Jianwei
    Ren, Tao
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1433 - 1438
  • [9] Multi-Instance Attention Network for Anomaly Detection from Multivariate Time Series
    Jang, Gye-Bong
    Cho, Sung-Bae
    CYBERNETICS AND SYSTEMS, 2024, 55 (06) : 1417 - 1440
  • [10] A Multivariate Time Series Anomaly Detection Model Based on Graph Attention Mechanism in Energy Consumption of Intelligent Buildings
    Zhang, Zhe
    Chen, Yuhao
    Wang, Huixue
    Wang, Yunzhe
    Fu, Qiming
    Lu, You
    2022 TENTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA, CBD, 2022, : 122 - 127