Anomaly detection of event sequences using multiple temporal resolutions and Markov chains

被引:7
|
作者
Boldt, Martin [1 ]
Borg, Anton [1 ]
Ickin, Selim [2 ]
Gustafsson, Jorgen [2 ]
机构
[1] Blekinge Inst Technol, Dept Comp Sci & Engn, S-37024 Karlskrona, Sweden
[2] Ericsson Res, Machine Intelligence & Automat, S-16440 Stockholm, Sweden
关键词
Anomaly detection; Markov Chains; Multiple temporal resolutions; Event sequences; Video-on-demand;
D O I
10.1007/s10115-019-01365-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Streaming data services, such as video-on-demand, are getting increasingly more popular, and they are expected to account for more than 80% of all Internet traffic in 2020. In this context, it is important for streaming service providers to detect deviations in service requests due to issues or changing end-user behaviors in order to ensure that end-users experience high quality in the provided service. Therefore, in this study we investigate to what extent sequence-based Markov models can be used for anomaly detection by means of the end-users' control sequences in the video streams, i.e., event sequences such as play, pause, resume and stop. This anomaly detection approach is further investigated over three different temporal resolutions in the data, more specifically: 1 h, 1 day and 3 days. The proposed anomaly detection approach supports anomaly detection in ongoing streaming sessions as it recalculates the probability for a specific session to be anomalous for each new streaming control event that is received. Two experiments are used for measuring the potential of the approach, which gives promising results in terms of precision, recall, F1-score and Jaccard index when compared to k-means clustering of the sessions.
引用
收藏
页码:669 / 686
页数:18
相关论文
共 50 条
  • [31] ENHANCING ANOMALY DETECTION USING TEMPORAL PATTERN DISCOVERY
    Jakkula, Vikramaditya R.
    Crandall, Aaron S.
    Cook, Diane J.
    ADVANCED INTELLIGENT ENVIRONMENTS, 2009, : 175 - 194
  • [32] Sleep Apnea Event Prediction Using Convolutional Neural Networks and Markov Chains
    Haidar, Rim
    Koprinska, Irena
    Jeffries, Bryn
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [33] CAT: Beyond Efficient Transformer for Content-Aware Anomaly Detection in Event Sequences
    Zhang, Shengming
    Liu, Yanchi
    Zhang, Xuchao
    Cheng, Wei
    Chen, Haifeng
    Xiong, Hui
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 4541 - 4550
  • [34] Edge Detection and Linking Pattern Analysis Using Markov Chains
    Kimm, Haklin
    Abolhassani, Neda
    Lee, Fenglien
    2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013), 2013, : 1146 - 1152
  • [35] Anomaly Detection for SOME/IP using Complex Event Processing
    Herold, Nadine
    Posselt, Stephan-A.
    Hanka, Oliver
    Carle, Georg
    NOMS 2016 - 2016 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2016, : 1221 - 1226
  • [36] Improving anomaly detection event analysis using the EventRank algorithm
    Begnum, Kyrre
    Burgess, Mark
    INTER-DOMAIN MANAGEMENT, PROCEEDINGS, 2007, 4543 : 145 - +
  • [37] Malware Detection Using Markov Blanket Based on Opcode Sequences
    Divandari, Hamid
    Pechaz, Bassir
    Jahan, Majid Vafaie
    SECOND INTERNATIONAL CONGRESS ON TECHNOLOGY, COMMUNICATION AND KNOWLEDGE (ICTCK 2015), 2015, : 564 - 569
  • [38] On distributions of multiple access interference for spread spectrum communication systems using M-phase spreading sequences of Markov chains
    Fujisaki, H
    2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 4, PROCEEDINGS, 2004, : 609 - 612
  • [39] Anomaly Detection Using Projective Markov Models in a Distributed Sensor Network
    Meyn, Sean
    Surana, Amit
    Lin, Yiqing
    Narayanan, Satish
    PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 4662 - 4669
  • [40] Unknown Anomaly Detection Using Hidden Markov Model and AreaSensing Techniques
    Kurahashi, Setsuya
    Ono, Isao
    TETSU TO HAGANE-JOURNAL OF THE IRON AND STEEL INSTITUTE OF JAPAN, 2020, 106 (02): : 91 - 99