ANOMALY PATTERN DETECTION IN STREAMING DATA BASED ON THE TRANSFORMATION TO MULTIPLE BINARY-VALUED DATA STREAMS

被引:4
|
作者
Kim, Taegong [1 ]
Park, Cheong Hee [1 ]
机构
[1] Chungnam Natl Univ, Dept Comp Sci & Engn, 220 Gung Dong, Daejeon, South Korea
关键词
anomaly pattern detection; multiple binary-valued streams; outlier detection; outlier score; OUTLIER;
D O I
10.2478/jaiscr-2022-0002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly pattern detection in a data stream aims to detect a time point where outliers begin to occur abnormally. Recently, a method for anomaly pattern detection has been proposed based on binary classification for outliers and statistical tests in the data stream of binary labels of normal or an outlier. It showed that an anomaly pattern can be detected accurately even when outlier detection performance is relatively low. However, since the anomaly pattern detection method is based on the binary classification for outliers, most well-known outlier detection methods, with the output of real-valued outlier scores, can not be used directly. In this paper, we propose an anomaly pattern detection method in a data stream using the transformation to multiple binary-valued data streams from real-valued outlier scores. By using three outlier detection methods, Isolation Forest(IF), Autoencoder-based outlier detection, and Local outlier factor(LOF), the proposed anomaly pattern detection method is tested using artificial and real data sets. The experimental results show that anomaly pattern detection using Isolation Forest gives the best performance.
引用
收藏
页码:19 / 27
页数:9
相关论文
共 50 条
  • [1] Anomaly pattern detection for streaming data
    Kim, Taegong
    Park, Cheong Hee
    EXPERT SYSTEMS WITH APPLICATIONS, 2020, 149
  • [2] Anomaly Pattern Detection on Data Streams
    Park, Cheong Hee
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2018, : 689 - 692
  • [3] Outlier and anomaly pattern detection on data streams
    Cheong Hee Park
    The Journal of Supercomputing, 2019, 75 : 6118 - 6128
  • [4] Outlier and anomaly pattern detection on data streams
    Park, Cheong Hee
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (09): : 6118 - 6128
  • [5] Solution Pattern for Anomaly Detection in Financial Data Streams
    Zakrzewicz, Maciej
    Wojciechowski, Marek
    Glawinski, Pawel
    NEW TRENDS IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2019, 2019, 1064 : 77 - 84
  • [6] Detection of data tampering attack in FIR system identification with binary-valued observations
    Jia, Ruizhe
    Su, Ruinan
    Yu, Peng
    Song, Yong
    Guo, Jin
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2025, 47 (02) : 390 - 401
  • [7] Autonomous anomaly detection for streaming data
    Basheer, Muhammad Yunus Iqbal
    Ali, Azliza Mohd
    Hamid, Nurzeatul Hamimah Abdul
    Ariffin, Muhammad Azizi Mohd
    Osman, Rozianawaty
    Nordin, Sharifalillah
    Gu, Xiaowei
    KNOWLEDGE-BASED SYSTEMS, 2024, 284
  • [8] System Identification With Binary-Valued Observations Under Data Tampering Attacks
    Guo, Jin
    Wang, Xuebin
    Xue, Wenchao
    Zhao, Yanlong
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (08) : 3825 - 3832
  • [9] Anomaly detection for smartphone data streams
    Mirsky, Yisroel
    Shabtai, Asaf
    Shapira, Bracha
    Elovici, Yuval
    Rokach, Lior
    PERVASIVE AND MOBILE COMPUTING, 2017, 35 : 83 - 107
  • [10] Anomaly Detection Guidelines for Data Streams in Big Data
    Rana, Annie Ibrahim
    Estrada, Giovani
    Sole, Marc
    Muntes, Victor
    2016 3RD INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE (ISCMI 2016), 2016, : 94 - 98