Smart Meter Data Anomaly Detection Using Variational Recurrent Autoencoders with Attention

被引:2
|
作者
Dai, Wenjing [1 ]
Liu, Xiufeng [1 ]
Heller, Alfred [2 ]
Nielsen, Per Sieverts [1 ]
机构
[1] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Lyngby, Denmark
[2] Niras, OStre Havnegade 12, DK-9000 Aalborg, Denmark
来源
基金
芬兰科学院; 欧盟地平线“2020”;
关键词
Anomaly detection; Variational autoencoder; Smart meter data; Attention mechanism; ENERGY-CONSUMPTION; PREDICTION;
D O I
10.1007/978-3-031-10525-8_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digitization of energy systems, sensors and smart meters are increasingly being used to monitor production, operation and demand. Detection of anomalies based on smart meter data is crucial to identify potential risks and unusual events at an early stage, which can serve as a reference for timely initiation of appropriate actions and improving management. However, smart meter data from energy systems often lack labels and contain noise and various patterns without distinctively cyclical. Meanwhile, the vague definition of anomalies in different energy scenarios and highly complex temporal correlations pose a great challenge for anomaly detection. Many traditional unsupervised anomaly detection algorithms such as cluster-based or distance-based models are not robust to noise and not fully exploit the temporal dependency in a time series as well as other dependencies amongst multiple variables (sensors). This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism. with "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training. This paper makes a quantitative comparison with the VAE-based baseline approach and four other unsupervised learning methods, demonstrating its effectiveness and superiority. This paper further validates the proposed method by a real case study of detecting the anomalies of water supply temperature from an industrial heating plant.
引用
收藏
页码:311 / 324
页数:14
相关论文
共 50 条
  • [41] An Anomaly Detection and Explainability Framework using Convolutional Autoencoders for Data Storage Systems
    Assaf, Roy
    Giurgiu, Ioana
    Pfefferle, Jonas
    Monney, Serge
    Pozidis, Haris
    Schumann, Anika
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 5228 - 5230
  • [42] Self-Attention-Based Multivariate Anomaly Detection for CPS Time Series Data with Adversarial Autoencoders
    Li, Qiwen
    Yan, Tijin
    Yuan, Huanhuan
    Xia, Yuanqing
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 4251 - 4256
  • [43] Steps Towards Continual Learning in Multivariate Time-Series Anomaly Detection using Variational Autoencoders
    Garcia Gonzalez, Gaston
    Casas, Pedro
    Fernandez, A.
    Gomez, G.
    PROCEEDINGS OF THE 2022 22ND ACM INTERNET MEASUREMENT CONFERENCE, IMC 2022, 2022, : 774 - 775
  • [44] Network Anomaly Detection With Stacked Sparse Shrink Variational Autoencoders and Unbalanced XGBoost
    Bi, Jing
    Guan, Ziyue
    Yuan, Haitao
    Yang, Jinhong
    Zhang, Jia
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2025, 10 (01): : 28 - 38
  • [45] Variational Autoencoders for Anomaly Detection and Transfer Knowledge in Electricity and District Heating Consumption
    Shahid, Zahraa Khais
    Saguna, Saguna
    Ahlund, Christer
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2024, 60 (05) : 7437 - 7450
  • [46] Unsupervised anomaly detection for multilevel converters based on wavelet transform and variational autoencoders
    Ye, Shu
    Zhang, Feng
    2022 IEEE ENERGY CONVERSION CONGRESS AND EXPOSITION (ECCE), 2022,
  • [47] A Minimally Supervised Approach Based on Variational Autoencoders for Anomaly Detection in Autonomous Robots
    Azzalini, Davide
    Bonali, Luca
    Amigoni, Francesco
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02): : 2985 - 2992
  • [48] Including Sparse Production Knowledge into Variational Autoencoders to Increase Anomaly Detection Reliability
    Hammerbacher, Tom
    Lange-Hegermann, Markus
    Platz, Gorden
    2021 IEEE 17TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2021, : 1262 - 1267
  • [49] A locational false data injection attack detection method in smart grid based on adversarial variational autoencoders
    Wang, Yufeng
    Zhou, Yangming
    Ma, Jianhua
    Jin, Qun
    APPLIED SOFT COMPUTING, 2024, 151
  • [50] Securing the green grid: A data anomaly detection method for mitigating cyberattacks on smart meter measurements
    Farooq, Asma
    Shahid, Kamal
    Olsen, Rasmus Lovenstein
    INTERNATIONAL JOURNAL OF CRITICAL INFRASTRUCTURE PROTECTION, 2024, 46