Concept Drift Detection on Streaming Data with Dynamic Outlier Aggregation

被引:5
|
作者
Zellner, Ludwig [1 ]
Richter, Florian [1 ]
Sontheim, Janina [1 ]
Maldonado, Andrea [1 ]
Seidl, Thomas [1 ]
机构
[1] Ludwig Maximilians Univ Munchen, Munich, Germany
关键词
Concept drift detection; Local outlier factor; Micro-clusters;
D O I
10.1007/978-3-030-72693-5_16
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many processes no matter what kind are regularly changing over time, adapting themselves to external and internal circumstances. Analyzing them in a streaming context is a very demanding task. Particularly the detection and classification of significant deviations is important to be able to re-integrate these possible micro-processes. Assuming a deviation of a certain process, the significance is implicitly given when a high number of instances contain this deviation similarly. To enhance a process the integration of or preventive measures against those anomalies is of high interest for all stakeholders as the actual process core gets discovered more and more in detail. Considering various areas of application, we focus on previously neglected but potentially significant anomalies like small changes in the disease process of a virus infection that has to be discovered to develop an appropriate reaction mechanism. We concentrate on non-conforming traces of a stream on which we compute a local outlier factor. This allows us to detect relations between traces based on changing outlier scores. Hence, hereby connected traces are clusters with which we achieve the detection of concept drift. We evaluate our approach on a synthetic event log and a real-world dataset corresponding to a process representing building permit applications which emphasizes the extensive applicability.
引用
下载
收藏
页码:206 / 217
页数:12
相关论文
共 50 条
  • [31] Outlier Detection in Streaming Data for Telecommunications and Industrial Applications: A Survey
    Mfondoum, Roland N.
    Ivanov, Antoni
    Koleva, Pavlina
    Poulkov, Vladimir
    Manolova, Agata
    ELECTRONICS, 2024, 13 (16)
  • [32] Unsupervised Outlier Detection in Streaming Data Using Weighted Clustering
    Thakran, Yogita
    Toshniwal, Durga
    2012 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA), 2012, : 947 - 952
  • [33] Real-time Outlier Detection over Streaming Data
    Yu, Kangqing
    Shi, Wei
    Santoro, Nicola
    Ma, Xiangyu
    2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 125 - 132
  • [34] Parallel dynamic data-driven model for concept drift detection and prediction
    Lin, Szu-Yin
    Chiu, Yao-Ching
    Lewandowski, Jacek
    Chao, Kuo-Ming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2017, 32 (02) : 1413 - 1426
  • [35] Streaming Data Classification Based on Hierarchical Concept Drift and Online Ensemble
    Liu, Ning
    Zhao, Jianhua
    IEEE ACCESS, 2023, 11 : 126040 - 126051
  • [36] Tracking recurrent concept drift in streaming data using ensemble classifiers
    Ramamurthy, Sasthakumar
    Bhatnagar, Raj
    ICMLA 2007: SIXTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2007, : 404 - 409
  • [37] MODIFICATION OF RANDOM FOREST BASED APPROACH FOR STREAMING DATA WITH CONCEPT DRIFT
    Zhukov, A. V.
    Sidorov, D. N.
    BULLETIN OF THE SOUTH URAL STATE UNIVERSITY SERIES-MATHEMATICAL MODELLING PROGRAMMING & COMPUTER SOFTWARE, 2016, 9 (04): : 86 - 95
  • [38] A Novel Outlier Detection with Feature Selection Enabled Streaming Data Classification
    Rajakumar, R.
    Devi, S. Sathiya
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 35 (02): : 2101 - 2116
  • [39] A Hybrid PSO-MiLOF Approach for Outlier Detection in Streaming Data
    Karate, Ankita
    Lazarova, Milena
    Koleva, Pavlina
    Poulkov, Vladimir
    2020 43RD INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2020, : 474 - 479
  • [40] Concept Drift Detection for Evolving Stream Data
    Lee, Jeonghoon
    Lee, Yoon-Joon
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (11) : 2288 - 2292