MFAM-AD: an anomaly detection model for multivariate time series using attention mechanism to fuse multi-scale features

被引:0
|
作者
Xia, Shengjie [1 ]
Sun, Wu [1 ]
Zou, Xiaofeng [1 ]
Chen, Panfeng [1 ]
Ma, Dan [1 ]
Xu, Huarong [1 ]
Chen, Mei [1 ]
Li, Hui [1 ]
机构
[1] Guizhou Univ, Coll Comp Sci & Technol, State Key Lab Publ Big Data, Guiyang, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Multi-scale; Convolutional neural networks; Bi-directional long short-term memory; Attention mechanism;
D O I
10.7717/peerj-cs.2201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multivariate time series anomaly detection has garnered significant attention in fields such as IT operations, finance, medicine, and industry. However, a key challenge lies in the fact that anomaly patterns often exhibit multi-scale temporal variations, which existing detection models often fail to capture effectively. This limitation significantly impacts detection accuracy. To address this issue, we propose the MFAM-AD model, which combines the strengths of convolutional neural networks (CNNs) and bidirectional long short-term memory (Bi-LSTM). The MFAM-AD model is designed to enhance anomaly detection accuracy by seamlessly integrating temporal dependencies and multi-scale spatial features. Specifically, it utilizes parallel convolutional layers to extract features across different scales, employing an attention mechanism for optimal feature fusion. Additionally, Bi-LSTM is leveraged to capture time-dependent information, reconstruct the time series and enable accurate anomaly detection based on reconstruction errors. In contrast to existing algorithms that struggle with inadequate feature fusion or are confined to single-scale feature analysis, MFAMAD effectively addresses the unique challenges of multivariate time series anomaly detection. Experimental results on five publicly available datasets demonstrate the superiority of the proposed model. Specifically, on the datasets SMAP, MSL, and SMD11, our MFAM-AD model has the second-highest F1 score after the current state-ofthe-art DCdetector model. On the datasets NIPS-TS-SWAN and NIPS-TS-GECCO, the F1 scores of MAFM-AD are 0.046 (6.2%) and 0.09 (21.3%) higher than those of DCdetector, respectively(the value ranges from 0 to 1). These findings validate the MFAMAD model's efficacy in multivariate time series anomaly detection, highlighting its potential in various real-world applications.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Anomaly detection for multivariate times series through the multi-scale convolutional recurrent variational autoencoder
    Xie, Tianming
    Xu, Qifa
    Jiang, Cuixia
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 231
  • [22] SA2E-AD: A Stacked Attention Autoencoder for Anomaly Detection in Multivariate Time Series
    Li, Mengyao
    Li, Zhiyong
    Yang, Zhibang
    Zhou, Xu
    Li, Yifan
    Wu, Ziyan
    Kong, Lingzhao
    Nai, Ke
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2024, 18 (07)
  • [23] A graph attention network-based model for anomaly detection in multivariate time series
    Zhang, Wei
    He, Ping
    Qin, Chuntian
    Yang, Fan
    Liu, Ying
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (06): : 8529 - 8549
  • [24] UNSUPERVISED ANOMALY DETECTION FOR MULTIVARIATE TIME SERIES USING DIFFUSION MODEL
    Hu, Rongyao
    Yuan, Xinyu
    Qiao, Yan
    Zhang, BenChu
    Zhao, Pei
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2024), 2024, : 9606 - 9610
  • [25] Robust unsupervised anomaly detection via multi-time scale DCGANs with forgetting mechanism for industrial multivariate time series
    Liang, Haoran
    Song, Lei
    Wang, Jianxing
    Guo, Lili
    Li, Xuzhi
    Liang, Ji
    NEUROCOMPUTING, 2021, 423 : 444 - 462
  • [26] Unsupervised Multi-head Attention Autoencoder for Multivariate Time-Series Anomaly Detection
    Kim, Minseok
    Park, Sanghyun
    2024 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING, IEEE BIGCOMP 2024, 2024, : 1 - 7
  • [27] Automatic Brain Tumor Segmentation Using Multi-scale Features and Attention Mechanism
    Li, Zhaopei
    Shen, Zhiqiang
    Wen, Jianhui
    He, Tian
    Pan, Lin
    BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2021, PT I, 2022, 12962 : 216 - 226
  • [28] Multi-Scale Dynamic Graph Learning for Time Series Anomaly Detection (Student Abstract)
    Jin, Yixuan
    Wei, Yutao
    Cheng, Zhangtao
    Tai, Wenxin
    Xiao, Chunjing
    Zhong, Ting
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23523 - 23524
  • [29] Decomposition-based multi-scale transformer framework for time series anomaly detection
    Zhang, Wenxin
    Luo, Cuicui
    NEURAL NETWORKS, 2025, 187
  • [30] A Graph Recurrent Attention Network for Multivariate Time Series Anomaly Detection
    Cui, Tao
    Liu, Yao
    Zhu, Yueming
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 57 - 62