Hierarchical Context Representation and Self-Adaptive Thresholding for Multivariate Anomaly Detection

被引:1
|
作者
Lin, Chunming [1 ]
Du, Bowen [1 ]
Sun, Leilei [1 ]
Li, Linchao [2 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm SKLSDE, Beijing 100191, Peoples R China
[2] Shenzhen Univ, Natl Key Lab Green & Long Life Rd Engn Extreme Env, Shenzhen 518060, Peoples R China
关键词
Time series analysis; Anomaly detection; Feature extraction; Image reconstruction; Task analysis; Transformers; Spatiotemporal phenomena; self-adaptation threshold; multivariate time series;
D O I
10.1109/TKDE.2024.3360640
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection in multivariate time series is a critical research area, but it is also a challenging one due to its occurrence in various real-world scenarios, such as structural health monitoring and risk management. Traditional approaches for anomaly detection rely on deviating distribution and a static threshold that is set manually. However, static thresholds fail to detect contextual anomalies, leading to a high ratio of false anomalies. Therefore, a self-adaptive thresholding method is required to improve the accuracy of anomaly detection. In this study, we propose HCR-AdaAD, a multivariate anomaly detection framework that combines hierarchical context representation learning with deep learning methods. The core idea is to extract normal time-series patterns by transforming them into images, which can be used to extract spatial features and generate robust representations for normal time series. Next, we adopt Extreme Value Theory (EVT) to set self-adaptive thresholds in streaming time series, which can contribute to the ideal precision for anomaly detection and high interpretability with contextual information. We conducted evaluation experiments on three public datasets, and the results demonstrate the effectiveness and soundness of our proposed model. HCR-AdaAD offers a novel and effective approach to anomaly detection in multivariate time series that outperforms traditional methods, making it a promising solution for real-world applications in various domains.
引用
收藏
页码:3139 / 3150
页数:12
相关论文
共 50 条
  • [1] Self-adaptive cloud monitoring with online anomaly detection
    Wang, Tao
    Xu, Jiwei
    Zhang, Wenbo
    Gu, Zeyu
    Zhong, Hua
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 80 : 89 - 101
  • [2] Self-adaptive and dynamic clustering for online anomaly detection
    Lee, Seungmin
    Kim, Gisung
    Kim, Sehun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (12) : 14891 - 14898
  • [3] A self-adaptive negative selection approach for anomaly detection
    Gonzalez, LJ
    Cannady, J
    [J]. CEC2004: PROCEEDINGS OF THE 2004 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2004, : 1561 - 1568
  • [4] A self-adaptive negative selection algorithm used for anomaly detection
    Zeng, Jinquan
    Liu, Xiaojie
    Li, Tao
    Liu, Caiming
    Peng, Lingxi
    Sun, Feixian
    [J]. PROGRESS IN NATURAL SCIENCE-MATERIALS INTERNATIONAL, 2009, 19 (02) : 261 - 266
  • [6] A Wavelet-Based Self-adaptive Hierarchical Thresholding Algorithm and Its Application in Image Denoising
    Zhang, Jianhua
    Zhu, Qiang
    Song, Lin
    [J]. TRAITEMENT DU SIGNAL, 2019, 36 (06) : 539 - 547
  • [7] Detection of anomaly intrusion utilizing self-adaptive grasshopper optimization algorithm
    Alok Kumar Shukla
    [J]. Neural Computing and Applications, 2021, 33 : 7541 - 7561
  • [8] Self-adaptive statistical process control for anomaly detection in time series
    Zheng, Dequan
    Li, Fenghuan
    Zhao, Tiejun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 57 : 324 - 336
  • [9] Anomaly Detection of Network Traffic Based on Prediction and Self-Adaptive Threshold
    Wang, Haiyan
    [J]. INTERNATIONAL JOURNAL OF FUTURE GENERATION COMMUNICATION AND NETWORKING, 2015, 8 (06): : 205 - 214
  • [10] Detection of anomaly intrusion utilizing self-adaptive grasshopper optimization algorithm
    Shukla, Alok Kumar
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (13): : 7541 - 7561