Online Anomaly Detection in Microbiological Data Sets

被引:0
|
作者
Hannig, Leonie [1 ]
Weise, Lukas [2 ]
Wittmann, Jochen [1 ]
机构
[1] Hsch Tech & Wirtschaft Berlin, Treskowallee 8, Berlin, Germany
[2] Berliner Wasserbetriebe, Neue Judenstr 1, D-10179 Berlin, Germany
关键词
Anomaly detection; Water monitoring; Cytometric fingerprinting; Machine learning; Waterborne bacteria; FLOW-CYTOMETRY;
D O I
10.1007/978-3-030-30862-9_11
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To prevent health risks caused by waterborne bacteria, significant changes of the bacterial community have to be detected as soon as possible. The aim of this study was to research suitable methods and implement a prototype of a system that can immediately detect such anomalous data points in microbiological data sets. The method chosen for the detection of anomalous cell counts was prediction-based out-lier detection: auto generated models were used to predict the expected number of cells in the next sample and the real number was compared to the prediction. Significant changes in bacterial communities were identified using Cytometric Fingerprinting, a method that provides functionalities to compare multivariate distributions and quantify their similarity. The prototype was implemented in R and tested. These tests showed that both methods were capable to detect anomalies but have to be optimized and further evaluated.
引用
收藏
页码:149 / 163
页数:15
相关论文
共 50 条
  • [21] Data-Driven Pathwise Sampling Approaches for Online Anomaly Detection
    Li, Dongmin
    Bai, Miao
    Xian, Xiaochen
    [J]. TECHNOMETRICS, 2024, : 600 - 613
  • [22] LOADED: Link-based outlier and anomaly detection in evolving data sets
    Ghoting, A
    Otey, ME
    Parthasarathy, S
    [J]. FOURTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2004, : 387 - 390
  • [23] Data Representation Based on Interval-Sets for Anomaly Detection in Time Series
    Ren, Huorong
    Li, Xixi
    Li, Zhiwu
    Pedrycz, Witold
    [J]. IEEE ACCESS, 2018, 6 : 27473 - 27479
  • [24] Ordinal Outlier Algorithm for Anomaly Detection of High-Dimensional Data Sets
    Chen, Gang
    Du, Linlin
    An, Baoran
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 5356 - 5361
  • [25] Fault and anomaly detection in district heating substations: A survey on methodology and data sets
    Neumayer, Martin
    Stecher, Dominik
    Grimm, Sebastian
    Maier, Andreas
    Buecker, Dominikus
    Schmidt, Jochen
    [J]. ENERGY, 2023, 276
  • [26] Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks
    Maciag, Piotr S.
    Kryszkiewicz, Marzena
    Bembenik, Robert
    Lobo, Jesus L.
    Del Ser, Javier
    [J]. NEURAL NETWORKS, 2021, 139 : 118 - 139
  • [27] Scalable prediction-based online anomaly detection for smart meter data
    Liu, Xiufeng
    Nielsen, Per Sieverts
    [J]. INFORMATION SYSTEMS, 2018, 77 : 34 - 47
  • [28] Model Agnostic Bayesian Framework for Online Anomaly/Event Detection in PMU Data
    Hossain, Kamij R.
    Mahapatra, Kaveri
    Ogle, James P.
    [J]. 2023 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, PESGM, 2023,
  • [29] Online Data-Centric Anomaly Detection Framework For Sensor Network Deployments
    Abuaitah, Giovani Rimon
    Wang, Bin
    [J]. 2014 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2014, : 599 - 604
  • [30] Online Privacy-Preserving Data-Driven Network Anomaly Detection
    Kurt, Mehmet Necip
    Yilmaz, Yasin
    Wang, Xiaodong
    Mosterman, Pieter J.
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (03) : 982 - 998