ONLINE REACTIVE ANOMALY DETECTION OVER STREAM DATA

被引:0
|
作者
Fu, Yan [1 ]
Zhou, Jun-Lin [1 ]
Wu, Yue [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Engn & Comp Sci, Chengdu 610054, Peoples R China
关键词
Outlier detection; data streams; neural network; local outlier factor;
D O I
10.1109/ICACIA.2008.4770026
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Outlier detection over data streams has attracted attention for many emerging applications, such as network intrusion detection, web click stream and aircraft health anomaly detection. Since the data stream is likely to change over time, it is important to be able to modify the outlier detection model appropriately with the evolution of the stream. Most existing approaches were using incremental or periodical models to deal with evolving stream data. However, in these approaches, model updates were either more frequently and risk wasting resources on insignificant changes or more infrequently and risk model inaccuracy. In this paper, a hybrid framework by combining LOF (Local outlier Factor) and BPNN (Back propagation Neural Network), appropriate for online detecting outliers in data streams, is proposed. The proposed framework provides equivalent detection performance as the iterated static LOF algorithm (applied after insertion of each data record), while requiring significantly less computational time.
引用
收藏
页码:291 / 294
页数:4
相关论文
共 50 条
  • [1] Data Stream Clustering for Online Anomaly Detection in Cloud Applications
    Sauvanaud, Carla
    Silvestre, Guthemberg
    Kaaniche, Mohamed
    Kanoun, Karama
    [J]. 2015 ELEVENTH EUROPEAN DEPENDABLE COMPUTING CONFERENCE (EDCC), 2015, : 120 - 131
  • [2] Online Anomaly Detection over Big Data Streams
    Rettig, Laura
    Khayati, Mourad
    Cudre-Mauroux, Philippe
    Piorkowski, Michal
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1113 - 1122
  • [3] Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks
    Maciag, Piotr S.
    Kryszkiewicz, Marzena
    Bembenik, Robert
    Lobo, Jesus L.
    Del Ser, Javier
    [J]. NEURAL NETWORKS, 2021, 139 : 118 - 139
  • [4] An online anomaly detection method for stream data using isolation principle and statistic histogram
    Ding, Zhiguo
    Fei, Minrui
    Du, Dajun
    [J]. INTERNATIONAL JOURNAL OF MODELING SIMULATION AND SCIENTIFIC COMPUTING, 2015, 6 (02)
  • [5] Online Anomaly Detection in Big Data
    Balasingam, B.
    Sankavaram, M. S.
    Choi, K.
    Ayala, D. F. M.
    Sidoti, D.
    Pattipati, K.
    Willett, P.
    Lintz, C.
    Commeau, G.
    Dorigo, F.
    Fahrny, J.
    [J]. 2014 17TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2014,
  • [6] Anomaly Detection for Time Series Data Stream
    Wang, Qifan
    Yan, Bo
    Su, Hongyi
    Zheng, Hong
    [J]. 2021 IEEE 6TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (ICBDA 2021), 2021, : 118 - 122
  • [7] Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream
    Yoon, Susik
    Lee, Youngjun
    Lee, Jae-Gil
    Lee, Byung Suk
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 2347 - 2357
  • [8] Online Anomaly Detection in Microbiological Data Sets
    Hannig, Leonie
    Weise, Lukas
    Wittmann, Jochen
    [J]. ADVANCES AND NEW TRENDS IN ENVIRONMENTAL INFORMATICS: ICT FOR SUSTAINABLE SOLUTIONS, 2020, : 149 - 163
  • [9] Anomaly detection model based on data stream clustering
    Yin, Chunyong
    Zhang, Sun
    Yin, Zhichao
    Wang, Jin
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 1): : 1729 - 1738
  • [10] Semantic anomaly detection in online data sources
    Raz, O
    Koopman, P
    Shaw, M
    [J]. ICSE 2002: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, 2002, : 302 - 312