Anomaly detection of event sequences using multiple temporal resolutions and Markov chains

被引:7
|
作者
Boldt, Martin [1 ]
Borg, Anton [1 ]
Ickin, Selim [2 ]
Gustafsson, Jorgen [2 ]
机构
[1] Blekinge Inst Technol, Dept Comp Sci & Engn, S-37024 Karlskrona, Sweden
[2] Ericsson Res, Machine Intelligence & Automat, S-16440 Stockholm, Sweden
关键词
Anomaly detection; Markov Chains; Multiple temporal resolutions; Event sequences; Video-on-demand;
D O I
10.1007/s10115-019-01365-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Streaming data services, such as video-on-demand, are getting increasingly more popular, and they are expected to account for more than 80% of all Internet traffic in 2020. In this context, it is important for streaming service providers to detect deviations in service requests due to issues or changing end-user behaviors in order to ensure that end-users experience high quality in the provided service. Therefore, in this study we investigate to what extent sequence-based Markov models can be used for anomaly detection by means of the end-users' control sequences in the video streams, i.e., event sequences such as play, pause, resume and stop. This anomaly detection approach is further investigated over three different temporal resolutions in the data, more specifically: 1 h, 1 day and 3 days. The proposed anomaly detection approach supports anomaly detection in ongoing streaming sessions as it recalculates the probability for a specific session to be anomalous for each new streaming control event that is received. Two experiments are used for measuring the potential of the approach, which gives promising results in terms of precision, recall, F1-score and Jaccard index when compared to k-means clustering of the sessions.
引用
收藏
页码:669 / 686
页数:18
相关论文
共 50 条
  • [21] MARKOV CHAINS AGGREGATION USING DISCRETE EVENT OPTIMIZATION VIA SIMULATION
    Capocchi, Laurent
    Santucci, Jean-Francois
    Zeigler, Bernard P.
    PROCEEDINGS OF THE 2019 SUMMER SIMULATION CONFERENCE (SUMMERSIM '19), 2019,
  • [22] Interpretable Anomaly Detection in Event Sequences via Sequence Matching and Visual Comparison
    Guo, Shunan
    Jin, Zhuochen
    Chen, Qing
    Gotz, David
    Zha, Hongyuan
    Cao, Nan
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (12) : 4531 - 4545
  • [23] TraLogAnomaly: A microservice system anomaly detection approach based on hybrid event sequences
    Wei, Xinjie
    Sun, Chang-ai
    Yang, Pengpeng
    Zhang, Xiao-Yi
    Towey, Dave
    SCIENCE OF COMPUTER PROGRAMMING, 2025, 245
  • [24] Modeling temporal pattern and event detection using Hidden Markov Model with application to a sludge bulking data
    Bansal, Naveen K.
    Feng, Xin
    Zhang, Wenjing
    Wei, Wutao
    Zhao, Yuanhao
    COMPLEX ADAPTIVE SYSTEMS 2012, 2012, 12 : 218 - 223
  • [25] ANOMALY NETWORK INTRUSION DETECTION USING HIDDEN MARKOV MODEL
    Chen, Chia-Mei
    Guan, Dah-Jyh
    Huang, Yu-Zhi
    Ou, Ya-Hui
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2016, 12 (02): : 569 - 580
  • [26] Fuzzy granular anomaly detection using Markov random walk
    Liu, Chang
    Yuan, Zhong
    Chen, Baiyang
    Chen, Hongmei
    Peng, Dezhong
    INFORMATION SCIENCES, 2023, 646
  • [27] Using Markov chains and temporal alignment to identify clinical patterns in Dementia
    Costa, Luisa Marote
    Colaco, Joao
    Carvalho, Alexandra M.
    Vinga, Susana
    Teixeira, Andreia Sofia
    JOURNAL OF BIOMEDICAL INFORMATICS, 2023, 140
  • [28] Unsupervised spatio-temporal detection of brain functional activation based on hidden Markov multiple event sequence models
    Faisan, S
    Thoraval, L
    Armspach, JP
    Heitz, F
    Foucher, J
    MEDICAL IMAGING 2005: IMAGE PROCESSING, PT 1-3, 2005, 5747 : 683 - 694
  • [29] Bayesian clustering of DNA sequences using Markov chains and a stochastic partition model
    Jaaskinen, Vaino
    Parkkinen, Ville
    Cheng, Lu
    Corander, Jukka
    STATISTICAL APPLICATIONS IN GENETICS AND MOLECULAR BIOLOGY, 2014, 13 (01) : 105 - 121
  • [30] Complex Event Processing Under Uncertainty Using Markov Chains, Constraints, and Sampling
    Rince, Romain
    Kervarc, Romain
    Leray, Philippe
    RULES AND REASONING (RULEML+RR 2018), 2018, 11092 : 147 - 163