Smart Meter Data Anomaly Detection Using Variational Recurrent Autoencoders with Attention

被引:2
|
作者
Dai, Wenjing [1 ]
Liu, Xiufeng [1 ]
Heller, Alfred [2 ]
Nielsen, Per Sieverts [1 ]
机构
[1] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Lyngby, Denmark
[2] Niras, OStre Havnegade 12, DK-9000 Aalborg, Denmark
来源
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
Anomaly detection; Variational autoencoder; Smart meter data; Attention mechanism; ENERGY-CONSUMPTION; PREDICTION;
D O I
10.1007/978-3-031-10525-8_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual events at an early stage, which can serve as a reference for timely initiation of appropriate actions and improving management. However, smart meter data from energy systems often lack labels and contain noise and various patterns without distinctively cyclical. Meanwhile, the vague definition of anomalies in different energy scenarios and highly complex temporal correlations pose a great challenge for anomaly detection. Many traditional unsupervised anomaly detection algorithms such as cluster-based or distance-based models are not robust to noise and not fully exploit the temporal dependency in a time series as well as other dependencies amongst multiple variables (sensors). This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. with "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training. This paper makes a quantitative comparison with the VAE-based baseline approach and four other unsupervised learning methods, demonstrating its effectiveness and superiority. This paper further validates the proposed method by a real case study of detecting the anomalies of water supply temperature from an industrial heating plant.
引用
收藏
页码:311 / 324
页数:14
相关论文
共 50 条
  • [1] Unsupervised Anomaly Detection in Energy Time Series Data using Variational Recurrent Autoencoders with Attention
    Pereira, Joao
    Silveira, Margarida
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 1275 - 1282
  • [2] Variational autoencoders for anomaly detection in the behaviour of the elderly using electricity consumption data
    Gonzalez, Daniel
    Patricio, Miguel A.
    Berlanga, Antonio
    Molina, Jose M.
    EXPERT SYSTEMS, 2022, 39 (04)
  • [3] Anomaly Detection of Disconnects Using SSTDR and Variational Autoencoders
    Edun, Ayobami S.
    LaFlamme, Cody
    Kingston, Samuel R.
    Furse, Cynthia M.
    Scarpulla, Michael A.
    Harley, Joel B.
    IEEE SENSORS JOURNAL, 2022, 22 (04) : 3484 - 3492
  • [4] Anomaly Detection in Beehives using Deep Recurrent Autoencoders
    Davidson, Padraig
    Steininger, Michael
    Lautenschlager, Florian
    Kobs, Konstantin
    Krause, Anna
    Hotho, Andreas
    PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON SENSOR NETWORKS (SENSORNETS), 2020, : 142 - 149
  • [5] Anomaly Detection in Time Series with Robust Variational Quasi-Recurrent Autoencoders
    Kieu, Tung
    Yang, Bin
    Guo, Chenjuan
    Cirstea, Razvan-Gabriel
    Zhao, Yan
    Song, Yale
    Jensen, Christian S.
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1342 - 1354
  • [6] Anomaly Detection in 5G using Variational Autoencoders
    Islam, Amanul
    Chang, Sang-Yoon
    Kim, Jinoh
    Kim, Jonghyun
    2024 SILICON VALLEY CYBERSECURITY CONFERENCE, SVCC 2024, 2024,
  • [7] Anomaly Detection in Industrial Software Systems Using Variational Autoencoders
    Kumarage, Tharindu
    De Silva, Nadun
    Ranawaka, Malsha
    Kuruppu, Chamal
    Ranathunga, Surangika
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM 2018), 2018, : 440 - 447
  • [8] Improving Data Generalization With Variational Autoencoders for Network Traffic Anomaly Detection
    Monshizadeh, Mehrnoosh
    Khatri, Vikramajeet
    Gamdou, Marah
    Kantola, Raimo
    Yan, Zheng
    IEEE ACCESS, 2021, 9 : 56893 - 56907
  • [9] Variational Autoencoders for Anomaly Detection in Respiratory Sounds
    Cozzatti, Michele
    Simonetta, Federico
    Ntalampiras, Stavros
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT IV, 2022, 13532 : 333 - 345
  • [10] Ultrasound Anomaly Detection Based on Variational Autoencoders
    Milkovic, Fran
    Filipovic, Branimir
    Subasic, Marko
    Petkovic, Tomislav
    Loncaric, Sven
    Budimir, Marko
    PROCEEDINGS OF THE 12TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2021), 2021, : 225 - 229