Smart Meter Data Anomaly Detection Using Variational Recurrent Autoencoders with Attention

被引:2
|
作者
Dai, Wenjing [1 ]
Liu, Xiufeng [1 ]
Heller, Alfred [2 ]
Nielsen, Per Sieverts [1 ]
机构
[1] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Lyngby, Denmark
[2] Niras, OStre Havnegade 12, DK-9000 Aalborg, Denmark
来源
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
Anomaly detection; Variational autoencoder; Smart meter data; Attention mechanism; ENERGY-CONSUMPTION; PREDICTION;
D O I
10.1007/978-3-031-10525-8_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual events at an early stage, which can serve as a reference for timely initiation of appropriate actions and improving management. However, smart meter data from energy systems often lack labels and contain noise and various patterns without distinctively cyclical. Meanwhile, the vague definition of anomalies in different energy scenarios and highly complex temporal correlations pose a great challenge for anomaly detection. Many traditional unsupervised anomaly detection algorithms such as cluster-based or distance-based models are not robust to noise and not fully exploit the temporal dependency in a time series as well as other dependencies amongst multiple variables (sensors). This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. with "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training. This paper makes a quantitative comparison with the VAE-based baseline approach and four other unsupervised learning methods, demonstrating its effectiveness and superiority. This paper further validates the proposed method by a real case study of detecting the anomalies of water supply temperature from an industrial heating plant.
引用
收藏
页码:311 / 324
页数:14
相关论文
共 50 条
  • [31] Robust Variational Autoencoders and Normalizing Flows for Unsupervised Network Anomaly Detection
    Najari, Naji
    Berlemont, Samuel
    Lefebvre, Gregoire
    Duffner, Stefan
    Garcia, Christophe
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, AINA-2022, VOL 2, 2022, 450 : 281 - 292
  • [32] Leveraging Federated Learning and Variational Autoencoders for an Enhanced Anomaly Detection System
    Nugraha, Beny
    Kota, Kavya
    Bauschert, Thomas
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON NETWORK SOFTWARIZATION, NETSOFT 2024, 2024, : 166 - 174
  • [33] Anomaly Detection Using Autoencoders for Movement Prediction
    Barbosa, L. J. L.
    Delis, A. L.
    Cotta, P. V. P.
    Silva, V. O.
    Araujo, M. D. C.
    Rocha, A.
    XXVII BRAZILIAN CONGRESS ON BIOMEDICAL ENGINEERING, CBEB 2020, 2022, : 1635 - 1640
  • [34] Anomaly Detection of a Reciprocating Compressor using Autoencoders
    Charoenchitt, Chittkasem
    Tangamchit, Poj
    2021 SECOND INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION, CONTROL, ARTIFICIAL INTELLIGENCE, AND ROBOTICS (ICA-SYMP), 2021, : 44 - 47
  • [35] Anomaly Detection for HTTP Using Convolutional Autoencoders
    Park, Seungyoung
    Kim, Myungjin
    Lee, Seokwoo
    IEEE ACCESS, 2018, 6 : 70884 - 70901
  • [36] Anomaly Detection for Agricultural Vehicles Using Autoencoders
    Mujkic, Esma
    Philipsen, Mark P.
    Moeslund, Thomas B.
    Christiansen, Martin P.
    Ravn, Ole
    SENSORS, 2022, 22 (10)
  • [37] Anomaly Detection in Surveillance Scenes Using Autoencoders
    Joshi K.V.
    Patel N.M.
    SN Computer Science, 4 (6)
  • [38] UAV Fault and Anomaly Detection Using Autoencoders
    Dhakal, Raju
    Bosma, Carly
    Chaudhary, Prachi
    Kandel, Laxima Niure
    2023 IEEE/AIAA 42ND DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2023,
  • [39] Unsupervised anomaly detection with LSTM autoencoders using statistical data-filtering
    Maleki, Sepehr
    Maleki, Sasan
    Jennings, Nicholas R.
    APPLIED SOFT COMPUTING, 2021, 108
  • [40] Unsupervised anomaly detection with LSTM autoencoders using statistical data-filtering
    Maleki, Sepehr
    Maleki, Sasan
    Jennings, Nicholas R.
    Applied Soft Computing, 2021, 108