A time series anomaly detection method based on contextual generative adversarial network

被引:0
|
作者
Hu Z. [1 ]
Yu X. [1 ]
Liu L. [1 ]
Zhang Y. [1 ]
Yu H. [1 ]
机构
[1] School of Cyberspace Science, Harbin Institute of Technology, Harbin
关键词
deep learning; GAN; generative model; model uncertainty; time series anomaly detection;
D O I
10.11918/202212029
中图分类号
学科分类号
摘要
Time series anomaly detection is a key technology relied upon in applications such as network service, data security, and system monitoring. In order to address the limitations of effectiveness, rationality and stability in anomaly detection results caused by the fuzziness of time series context, complexity of data distribution, and the uncertainty of anomaly detection models in practical scenarios, this paper proposes a new anomaly detection method (AdcGAN), based on contextual generative adversarial network. Firstly, AdcGAN extracts conditional context for generating time series data by processing historical data. Secondly, AdcGAN constructs a context generative adversarial network following conditional generative adversarial network strategy to achieve conditional distribution prediction of the data at any moment. Meanwhile, AdcGAN uses Dropout to approximate model uncertainty and replacing point estimates with probability distribution as prediction result. Then, anomalies are measured based on the differences in observations (represented by the expected deviations) and the uncertainty of the model (represented by prediction variances). Finally, an automatic method for setting anomaly thresholds based on statistical information of the time series data is proposed to reduce the number of manually adjusted parameters. Our experimental results on 47 real-time series data of the NAB dataset compared with baselines show that, compared to similar benchmark algorithms, the proposed AdcGAN method can effectively detect anomalies in time series data. It outperforms other benchmark methods in most evaluation metrics and achieves better stability. © 2024 Harbin Institute of Technology. All rights reserved.
引用
收藏
页码:1 / 11
页数:10
相关论文
共 37 条
  • [1] SOLDANI J, BROGI A., Anomaly detection and failure root cause analysis in (micro) service-based cloud applications: a survey, ACM Computing Surveys, 55, 3, (2022)
  • [2] CUI Lei, QU Youyang, XIE Gang, Et al., Security and privacy-enhanced federated learning for anomaly detection in IoT infrastructures, IEEE Transactions on Industrial Informatics, 18, 5, (2021)
  • [3] DING Xiaoou, YU Shengjian, WANG Muxian, Et al., Abnormal detection of industrial time series data based on correlation analysis, Journal of Software Science, 31, 3, (2020)
  • [4] FERRAG M A, MAGLARAS L, MOSCHOYIANNIS S, Et al., Deep learning for cyber security intrusion detection: approaches, datasets, and comparative study, Journal of Information Security and Applications, 50, (2020)
  • [5] YAN Xudong, ZHANG Huaidong, XU Xuemao, Et al., Learning semantic context from normal samples for unsupervised anomaly detection, Proceedings of the AAAI Conference on Artificial Intelligence, 35, 4, (2021)
  • [6] ERGEN T, KOZAT S S., Unsupervised anomaly detection with LSTM neural networks, IEEE Transactions on Neural Networks and Learning Systems, 31, 8, (2019)
  • [7] WELLS M., Applied econometric time series, Journal of the American Statistical Association, 90, 431, (1995)
  • [8] ZENG Jia, ZHANG Lei, SHI Gaotao, Et al., An ARIMA based real-time monitoring and warning algorithm for the anomaly detection, 2017 IEEE 23rd International Conference on Parallel and Distributed Systems (ICPADS), (2017)
  • [9] ESTER M, KRIEGEL H P, SANDER J, Et al., A density-based algorithm for discovering clusters in large spatial databases with noise, Proceedings of 2nd International Conference Knowledge Discovery and Data Mining, 96, 34, (1996)
  • [10] KEOGH E, CHAKRABARTI K, PAZZANI M, Et al., Locally adaptive dimensionality reduction for indexing large time series databases, Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, 30, 2, (2001)