Hierarchical Temporal Memory-Based One-Pass Learning for Real-Time Anomaly Detection and Simultaneous Data Prediction in Smart Grids

被引:12
|
作者
Barua, Anomadarshi [1 ]
Muthirayan, Deepan [1 ]
Khargonekar, Pramod P. [1 ]
Al Faruque, Mohammad Abdullah [1 ]
机构
[1] Univ Calif Irvine, Dept Elect Engn & Comp Sci, Irvine, CA 92697 USA
基金
美国国家科学基金会;
关键词
Smart grid; anomaly detection; simultaneous prediction; hierarchical temporal memory; sparse distributed representation; FRAMEWORK;
D O I
10.1109/TDSC.2020.3037054
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
A neuro-cognitive inspired architecture based on the Hierarchical Temporal Memory (HTM) is proposed for anomaly detection and simultaneous data prediction in real-time for smart grid mu PMU data. The key technical idea is that the HTM learns a sparse distributed temporal representation of sequential data that turns out to be very useful for anomaly detection and simultaneous data prediction in real-time. Our results show that the proposed HTM can predict anomalies within 83-90 percent accuracy for three different application profiles, namely Standard, Reward Few False Positive, Reward Few False Negative for two different datasets. We show that the HTM is competitive to five state-of-the-art algorithms for anomaly detection. Moreover, for the multi-step prediction in the online setting, the same HTM achieves a low 0.0001 normalized mean square error, a low negative log-likelihood score of 1.5 and is also competitive to six state-of-the-art prediction algorithms. We demonstrate that the same HTM model can be used for both the tasks and can learn online in one-pass, in an unsupervised fashion and adapt to changing statistics. The other state-of-the-art algorithms are either less accurate or are limited to one of the tasks or cannot learn online in one-pass, and adapt to changing statistics.
引用
收藏
页码:1770 / 1782
页数:13
相关论文
共 50 条
  • [21] Real-time tumor motion estimation using respiratory surrogate via memory-based learning
    Li, Ruijiang
    Lewis, John H.
    Berbeco, Ross I.
    Xing, Lei
    PHYSICS IN MEDICINE AND BIOLOGY, 2012, 57 (15): : 4771 - 4786
  • [22] Accurate Real-time Tumor Localization From Respiratory Surrogates via Memory-based Learning
    Li, R.
    Xing, L.
    INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2012, 84 (03): : S730 - S730
  • [23] A Real-Time DDoS Attack Detection and Classification S ystem Using Hierarchical Temporal Memory
    Lai, Yu-Kuen
    Manh-Hung Nguyen
    APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2023, 12 (02)
  • [24] Proposed Model for Real-Time Anomaly Detection in Big IoT Sensor Data for Smart City
    Hasani Z.
    Krrabaj S.
    Krasniqi M.
    International Journal of Interactive Mobile Technologies, 2024, 18 (03): : 32 - 44
  • [25] Using Federated Learning in Anomaly Detection and Analytics on Real-time Streaming Data of Healthcare
    Yogitha, M.
    Srinivas, K. S.
    PROCEEDINGS OF 2023 THE 7TH INTERNATIONAL CONFERENCE ON GRAPHICS AND SIGNAL PROCESSING, ICGSP, 2023, : 29 - 34
  • [26] Real-Time Sentiment-Based Anomaly Detection in Twitter Data Streams
    Patel, Khantil
    Hoeber, Orland
    Hamilton, Howard J.
    ADVANCES IN ARTIFICIAL INTELLIGENCE (AI 2015), 2015, 9091 : 196 - 203
  • [27] Real-time crash prediction on express managed lanes of Interstate highway with anomaly detection learning
    Yang, Samgyu
    Abdel-Aty, Mohamed
    Islam, Zubayer
    Wang, Dongdong
    ACCIDENT ANALYSIS AND PREVENTION, 2024, 201
  • [28] AREP: an adaptive, machine learning-based algorithm for real-time anomaly detection on network telemetry data
    Karoly Farkas
    Neural Computing and Applications, 2023, 35 : 6079 - 6094
  • [29] AREP: an adaptive, machine learning-based algorithm for real-time anomaly detection on network telemetry data
    Farkas, Karoly
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (08): : 6079 - 6094
  • [30] Real-Time Deep Learning-Based Anomaly Detection Approach for Multivariate Data Streams with Apache Flink
    Ha, Tae Wook
    Kang, Jung Mo
    Kim, Myoung Ho
    ICWE 2021 WORKSHOPS, ICWE 2021 INTERNATIONAL WORKSHOPS, 2022, 1508 : 39 - 49