Concept Drift Detection on Streaming Data with Dynamic Outlier Aggregation

被引:5
|
作者
Zellner, Ludwig [1 ]
Richter, Florian [1 ]
Sontheim, Janina [1 ]
Maldonado, Andrea [1 ]
Seidl, Thomas [1 ]
机构
[1] Ludwig Maximilians Univ Munchen, Munich, Germany
关键词
Concept drift detection; Local outlier factor; Micro-clusters;
D O I
10.1007/978-3-030-72693-5_16
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many processes no matter what kind are regularly changing over time, adapting themselves to external and internal circumstances. Analyzing them in a streaming context is a very demanding task. Particularly the detection and classification of significant deviations is important to be able to re-integrate these possible micro-processes. Assuming a deviation of a certain process, the significance is implicitly given when a high number of instances contain this deviation similarly. To enhance a process the integration of or preventive measures against those anomalies is of high interest for all stakeholders as the actual process core gets discovered more and more in detail. Considering various areas of application, we focus on previously neglected but potentially significant anomalies like small changes in the disease process of a virus infection that has to be discovered to develop an appropriate reaction mechanism. We concentrate on non-conforming traces of a stream on which we compute a local outlier factor. This allows us to detect relations between traces based on changing outlier scores. Hence, hereby connected traces are clusters with which we achieve the detection of concept drift. We evaluate our approach on a synthetic event log and a real-world dataset corresponding to a process representing building permit applications which emphasizes the extensive applicability.
引用
下载
收藏
页码:206 / 217
页数:12
相关论文
共 50 条
  • [21] A clustering-based method for outlier detection under concept drift
    Tahir, Mahjabeen
    Abdullah, Azizol
    Udzir, Nur Izura
    Kasmiran, Khairul Azhar
    MEHRAN UNIVERSITY RESEARCH JOURNAL OF ENGINEERING AND TECHNOLOGY, 2024, 43 (03) : 205 - 218
  • [22] Adapting to Concept Drift with Genetic Programming for Classifying Streaming Data
    Smith, Murray
    Ciesielski, Vie
    2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 5026 - 5033
  • [23] Incremental Learning of Concept Drift from Streaming Imbalanced Data
    Ditzler, Gregory
    Polikar, Robi
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (10) : 2283 - 2301
  • [24] Learning from streaming data with concept drift and imbalance: an overview
    Hoens, T. Ryan
    Polikar, Robi
    Chawla, Nitesh V.
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (01) : 89 - 101
  • [25] Concept drift in Streaming Data Classification: Algorithms, Platforms and Issues
    Janardan, Shikha Mehta
    5TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT, ITQM 2017, 2017, 122 : 804 - 811
  • [26] Learning from streaming data with concept drift and imbalance: an overview
    T. Ryan Hoens
    Robi Polikar
    Nitesh V. Chawla
    Progress in Artificial Intelligence, 2012, 1 (1) : 89 - 101
  • [27] Dynamical Targeted Ensemble Learning for Streaming Data With Concept Drift
    Guo, Husheng
    Zhang, Yang
    Wang, Wenjian
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 8023 - 8036
  • [28] Online Training from Streaming Data with Concept Drift on FPGAs
    Roorda, Esther
    Wilton, Steven J. E.
    2023 24TH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN, ISQED, 2023, : 724 - 731
  • [29] On the Improvement of the Isolation Forest Algorithm for Outlier Detection with Streaming Data
    Heigl, Michael
    Anand, Kumar Ashutosh
    Urmann, Andreas
    Fiala, Dalibor
    Schramm, Martin
    Hable, Robert
    ELECTRONICS, 2021, 10 (13)
  • [30] MEOD: Memory-Efficient Outlier Detection on Streaming Data
    Karale, Ankita
    Lazarova, Milena
    Koleva, Pavlina
    Poulkov, Vladimir
    SYMMETRY-BASEL, 2021, 13 (03):