Online Anomaly Detection in Microbiological Data Sets

被引:0
|
作者
Hannig, Leonie [1 ]
Weise, Lukas [2 ]
Wittmann, Jochen [1 ]
机构
[1] Hsch Tech & Wirtschaft Berlin, Treskowallee 8, Berlin, Germany
[2] Berliner Wasserbetriebe, Neue Judenstr 1, D-10179 Berlin, Germany
关键词
Anomaly detection; Water monitoring; Cytometric fingerprinting; Machine learning; Waterborne bacteria; FLOW-CYTOMETRY;
D O I
10.1007/978-3-030-30862-9_11
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To prevent health risks caused by waterborne bacteria, significant changes of the bacterial community have to be detected as soon as possible. The aim of this study was to research suitable methods and implement a prototype of a system that can immediately detect such anomalous data points in microbiological data sets. The method chosen for the detection of anomalous cell counts was prediction-based out-lier detection: auto generated models were used to predict the expected number of cells in the next sample and the real number was compared to the prediction. Significant changes in bacterial communities were identified using Cytometric Fingerprinting, a method that provides functionalities to compare multivariate distributions and quantify their similarity. The prototype was implemented in R and tested. These tests showed that both methods were capable to detect anomalies but have to be optimized and further evaluated.
引用
收藏
页码:149 / 163
页数:15
相关论文
共 50 条
  • [1] Online Anomaly Detection in Big Data
    Balasingam, B.
    Sankavaram, M. S.
    Choi, K.
    Ayala, D. F. M.
    Sidoti, D.
    Pattipati, K.
    Willett, P.
    Lintz, C.
    Commeau, G.
    Dorigo, F.
    Fahrny, J.
    [J]. 2014 17TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2014,
  • [2] Video Anomaly Detection With Compact Feature Sets for Online Performance
    Leyva, Roberto
    Sanchez, Victor
    Li, Chang-Tsun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) : 3463 - 3478
  • [3] Semantic anomaly detection in online data sources
    Raz, O
    Koopman, P
    Shaw, M
    [J]. ICSE 2002: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, 2002, : 302 - 312
  • [4] OHODIN - Online Anomaly Detection for Data Streams
    Gruhl, Christian
    Tomforde, Sven
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING AND SELF-ORGANIZING SYSTEMS COMPANION (ACSOS-C 2021), 2021, : 193 - 197
  • [5] Online Clustering for Evolving Data Streams with Online Anomaly Detection
    Chenaghlou, Milad
    Moshtaghi, Masud
    Leckie, Christopher
    Salehi, Mahsa
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT II, 2018, 10938 : 506 - 519
  • [6] Ordinal anomaly probability algorithm for anomaly detection problems of massive data sets
    Chen, Gang
    Cai, Yuanli
    Mu, Jing
    Yang, Weili
    [J]. Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2011, 45 (04): : 36 - 40
  • [7] Online Video Anomaly Detection Methodology With Highly Descriptive Feature Sets
    Mahbod, Abbas
    Leung, Henry
    [J]. 2019 22ND INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION 2019), 2019,
  • [8] ONLINE REACTIVE ANOMALY DETECTION OVER STREAM DATA
    Fu, Yan
    Zhou, Jun-Lin
    Wu, Yue
    [J]. 2008 INTERNATIONAL CONFERENCE ON APPERCEIVING COMPUTING AND INTELLIGENCE ANALYSIS (ICACIA 2008), 2008, : 291 - 294
  • [9] Online Anomaly Detection over Big Data Streams
    Rettig, Laura
    Khayati, Mourad
    Cudre-Mauroux, Philippe
    Piorkowski, Michal
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1113 - 1122
  • [10] Tiresias: Online Anomaly Detection for Hierarchical Operational Network Data
    Hong, Chi-Yao
    Caesar, Matthew
    Duffield, Nick
    Wang, Jia
    [J]. 2012 IEEE 32ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2012, : 173 - 182