Smart Meter Data Anomaly Detection Using Variational Recurrent Autoencoders with Attention

被引:2
|
作者
Dai, Wenjing [1 ]
Liu, Xiufeng [1 ]
Heller, Alfred [2 ]
Nielsen, Per Sieverts [1 ]
机构
[1] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Lyngby, Denmark
[2] Niras, OStre Havnegade 12, DK-9000 Aalborg, Denmark
来源
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
Anomaly detection; Variational autoencoder; Smart meter data; Attention mechanism; ENERGY-CONSUMPTION; PREDICTION;
D O I
10.1007/978-3-031-10525-8_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual events at an early stage, which can serve as a reference for timely initiation of appropriate actions and improving management. However, smart meter data from energy systems often lack labels and contain noise and various patterns without distinctively cyclical. Meanwhile, the vague definition of anomalies in different energy scenarios and highly complex temporal correlations pose a great challenge for anomaly detection. Many traditional unsupervised anomaly detection algorithms such as cluster-based or distance-based models are not robust to noise and not fully exploit the temporal dependency in a time series as well as other dependencies amongst multiple variables (sensors). This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. with "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training. This paper makes a quantitative comparison with the VAE-based baseline approach and four other unsupervised learning methods, demonstrating its effectiveness and superiority. This paper further validates the proposed method by a real case study of detecting the anomalies of water supply temperature from an industrial heating plant.
引用
收藏
页码:311 / 324
页数:14
相关论文
共 50 条
  • [21] Anomaly detection on household appliances based on variational autoencoders
    Castangia, Marco
    Sappa, Riccardo
    Girmay, Awet Abraha
    Camarda, Christian
    Macii, Enrico
    Patti, Edoardo
    Sustainable Energy, Grids and Networks, 2022, 32
  • [22] Anomaly detection in gravitational waves data using convolutional autoencoders
    Morawski F.
    Bejger M.
    Cuoco E.
    Petre L.
    Machine Learning: Science and Technology, 2021, 2 (04):
  • [23] Green Generative Modeling: Recycling Dirty Data using Recurrent Variational Autoencoders
    Wang, Yu
    Dai, Bin
    Hua, Gang
    Aston, John
    Wipf, David
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI2017), 2017,
  • [24] ANOMALY DETECTION THROUGH LATENT SPACE RESTORATION USING VECTOR QUANTIZED VARIATIONAL AUTOENCODERS
    Marimont, Sergio Naval
    Tarroni, Giacomo
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1764 - 1767
  • [25] Anomaly detection in Fourier transform infrared spectroscopy of geological specimens using variational autoencoders
    Gonzalez, C. M.
    Horrocks, T.
    Wedge, D.
    Holden, E. J.
    Hackman, N.
    Green, T.
    ORE GEOLOGY REVIEWS, 2023, 158
  • [26] Scalable prediction-based online anomaly detection for smart meter data
    Liu, Xiufeng
    Nielsen, Per Sieverts
    INFORMATION SYSTEMS, 2018, 77 : 34 - 47
  • [27] Electricity Theft Detection Using Smart Meter Data
    Sahoo, Sanujit
    Nikovski, Daniel
    Muso, Toru
    Tsuru, Kaoru
    2015 IEEE POWER & ENERGY SOCIETY INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE (ISGT), 2015,
  • [28] Anomaly detection based on LSTM and autoencoders using federated learning in smart electric grid
    Shrestha, Rakesh
    Mohammadi, Mohammadreza
    Sinaei, Sima
    Salcines, Alberto
    Pampliega, David
    Clemente, Raul
    Sanz, Ana Lourdes
    Nowroozi, Ehsan
    Lindgren, Anders
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2024, 193
  • [29] Variational Convolutional Autoencoders for Anomaly Detection in Scanning Transmission Electron Microscopy
    Prifti, Enea
    Buban, James P.
    Thind, Arashdeep Singh
    Klie, Robert F.
    SMALL, 2023, 19 (16)
  • [30] Leveraging Spatiotemporal Correlations With Recurrent Autoencoders for Sensor Anomaly Detection
    Allka, Xhensilda
    Ferrer-Cid, Pau
    Barcelo-Ordinas, Jose M.
    Garcia-Vidal, Jorge
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 31144 - 31152