Real-Time Outlier Detection with Dynamic Process Limits

被引:2
|
作者
Wadinger, Marek [1 ]
Kvasnica, Michal [1 ]
机构
[1] Slovak Univ Technol Bratislava, Inst Informat Engn Automat & Math, Bratislava, Slovakia
关键词
anomaly detection; interpretable machine learning; online machine learning; real-time systems; streaming analytics;
D O I
10.1109/PC58330.2023.10217717
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection methods are part of the systems where rare events may endanger an operation's profitability, safety, and environmental aspects. Although many state-of-the-art anomaly detection methods were developed to date, their deployment is limited to the operation conditions present during the model training. Online anomaly detection brings the capability to adapt to data drifts and change points that may not be represented during model development resulting in prolonged service life. This paper proposes an online anomaly detection algorithm for existing real-time infrastructures where low-latency detection is required and novel patterns in data occur unpredictably. The online inverse cumulative distribution-based approach is introduced to eliminate common problems of offline anomaly detectors, meanwhile providing dynamic process limits to normal operation. The benefit of the proposed method is the ease of use, fast computation, and deployability as shown in two case studies of real microgrid operation data.
引用
收藏
页码:138 / 143
页数:6
相关论文
共 50 条
  • [1] Real-time Outlier Detection over Streaming Data
    Yu, Kangqing
    Shi, Wei
    Santoro, Nicola
    Ma, Xiangyu
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 125 - 132
  • [2] Shape based kinetic outlier detection in real-time PCR
    Davide Sisti
    Michele Guescini
    Marco BL Rocchi
    Pasquale Tibollo
    Mario D'Atri
    Vilberto Stocchi
    BMC Bioinformatics, 11
  • [3] Shape based kinetic outlier detection in real-time PCR
    Sisti, Davide
    Guescini, Michele
    Rocchi, Marco B. L.
    Tibollo, Pasquale
    D'Atri, Mario
    Stocchi, Vilberto
    BMC BIOINFORMATICS, 2010, 11
  • [4] Real-Time Distance-Based Outlier Detection in Data Streams
    Tran, Luan
    Mun, Min Y.
    Shahabi, Cyrus
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2020, 14 (02): : 141 - 153
  • [5] RUTOD: real-time urban traffic outlier detection on streaming trajectory
    Shi, Juntian
    Pan, Zhicheng
    Fang, Junhua
    Chao, Pingfu
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (05): : 3625 - 3637
  • [6] RUTOD: real-time urban traffic outlier detection on streaming trajectory
    Juntian Shi
    Zhicheng Pan
    Junhua Fang
    Pingfu Chao
    Neural Computing and Applications, 2023, 35 : 3625 - 3637
  • [7] Real-time outlier detection for large datasets by RT-DetMCD
    De Ketelaere, Bart
    Hubert, Mia
    Raymaekers, Jakob
    Rousseeuw, Peter J.
    Vranckx, Iwein
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2020, 199
  • [8] Research on real-time outlier detection over big data streams
    Chen, Liangchen
    Gao, Shu
    Cao, Xiufeng
    International Journal of Computers and Applications, 2020, 42 (01): : 93 - 101
  • [9] Real-Time Dynamic Network Anomaly Detection
    Noble, Jordan
    Adams, Niall M.
    IEEE INTELLIGENT SYSTEMS, 2018, 33 (02) : 5 - 18
  • [10] Dynamic approach for real-time skin detection
    Bilal, Sara
    Akmeliawati, Rini
    Salami, Momoh Jimoh E.
    Shafie, Amir A.
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2015, 10 (02) : 371 - 385