Concept Drift Detection on Streaming Data with Dynamic Outlier Aggregation

被引:5
|
作者
Zellner, Ludwig [1 ]
Richter, Florian [1 ]
Sontheim, Janina [1 ]
Maldonado, Andrea [1 ]
Seidl, Thomas [1 ]
机构
[1] Ludwig Maximilians Univ Munchen, Munich, Germany
关键词
Concept drift detection; Local outlier factor; Micro-clusters;
D O I
10.1007/978-3-030-72693-5_16
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many processes no matter what kind are regularly changing over time, adapting themselves to external and internal circumstances. Analyzing them in a streaming context is a very demanding task. Particularly the detection and classification of significant deviations is important to be able to re-integrate these possible micro-processes. Assuming a deviation of a certain process, the significance is implicitly given when a high number of instances contain this deviation similarly. To enhance a process the integration of or preventive measures against those anomalies is of high interest for all stakeholders as the actual process core gets discovered more and more in detail. Considering various areas of application, we focus on previously neglected but potentially significant anomalies like small changes in the disease process of a virus infection that has to be discovered to develop an appropriate reaction mechanism. We concentrate on non-conforming traces of a stream on which we compute a local outlier factor. This allows us to detect relations between traces based on changing outlier scores. Hence, hereby connected traces are clusters with which we achieve the detection of concept drift. We evaluate our approach on a synthetic event log and a real-world dataset corresponding to a process representing building permit applications which emphasizes the extensive applicability.
引用
下载
收藏
页码:206 / 217
页数:12
相关论文
共 50 条
  • [1] Concept Drift Detection for Streaming Data
    Wang, Heng
    Abraham, Zubin
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [2] On the reliable detection of concept drift from streaming unlabeled data
    Sethi, Tegjyot Singh
    Kantardzic, Mehmed
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 : 77 - 99
  • [3] Concept Drift Detection on Streaming Data under Limited Labeling
    Kim, Young In
    Park, Cheong Hee
    2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (CIT), 2016, : 273 - 280
  • [4] SETL: a transfer learning based dynamic ensemble classifier for concept drift detection in streaming data
    Arora, Shruti
    Rani, Rinkle
    Saxena, Nitin
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3417 - 3432
  • [5] Streaming Data Classification with Concept Drift
    Althabiti, Mashail
    Abdullah, Manal
    BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2019, 12 (01): : 177 - 184
  • [6] Ensemble framework for concept-drift detection in multidimensional streaming data
    Prasad K.S.N.
    Rao A.S.
    Ramana A.V.
    International Journal of Computers and Applications, 2022, 44 (12) : 1193 - 1200
  • [7] Handling adversarial concept drift in streaming data
    Sethi, Tegjyot Singh
    Kantardzic, Mehmed
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 97 : 18 - 40
  • [8] Outlier Detection in Streaming Data A research Perspective
    Chugh, Neeraj
    Chugh, Mitali
    Agarwal, Alok
    2014 INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2014, : 429 - 432
  • [9] Temporal Attention for Few-Shot Concept Drift Detection in Streaming Data
    Lin, Ximing
    Chang, Longtao
    Nie, Xiushan
    Dong, Fei
    ELECTRONICS, 2024, 13 (11)
  • [10] No Free Lunch Theorem for concept drift detection in streaming data classification: A review
    Hu, Hanqing
    Kantardzic, Mehmed
    Sethi, Tegjyot S.
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 10 (02)