An online Bayesian approach to change-point detection for categorical data

被引:6
|
作者
Fan, Yiwei [1 ,2 ]
Lu, Xiaoling [1 ,2 ]
机构
[1] Renmin Univ China, Ctr Appl Stat, Beijing, Peoples R China
[2] Renmin Univ China, Sch Stat, Beijing, Peoples R China
关键词
Bayes factor; Change-point detection; Dirichlet-multinomial mixtures; Online strategy; TIME-SERIES DATA; MULTINOMIAL DATA;
D O I
10.1016/j.knosys.2020.105792
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change-point detection for categorical data has wide applications in many fields. Existing methods either are distribution-free, not utilizing categorical information sufficiently, or have limited performance when there exists "rare events" (events that occur with low frequency). In this paper, we propose a Bayesian change-point detection model for categorical data based on Dirichlet-multinomial mixtures. Because of the introduction of prior information, our method performs well for the existence of "rare events". An online parameter estimation procedure and an online detection strategy are then designed to adapt to data streams. Monte Carlo simulations discuss the power of the proposed method and show advantages compared with existing algorithms. Applications in biomedical research, document analysis, health news case study and location monitoring indicate practical values of our method. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Latent change-point detection in ordinal categorical data
    Wang, Junjie
    Ding, Dong
    Su, Qin
    [J]. QUALITY AND RELIABILITY ENGINEERING INTERNATIONAL, 2019, 35 (02) : 504 - 516
  • [2] Directional Change-Point Detection for Process Control with Multivariate Categorical Data
    Li, Jian
    Tsung, Fugee
    Zou, Changliang
    [J]. NAVAL RESEARCH LOGISTICS, 2013, 60 (02) : 160 - 173
  • [3] Online common change-point detection in a set of nonstationary categorical time series
    Leyli-Abadi, Milad
    Same, Allou
    Oukhellou, Latifa
    Cheifetz, Nicolas
    Mandel, Pierre
    Feliers, Cedric
    Heim, Veronique
    [J]. NEUROCOMPUTING, 2021, 439 : 176 - 196
  • [4] ON THE OPTIMALITY OF BAYESIAN CHANGE-POINT DETECTION
    Han, Dong
    Tsung, Fugee
    Xian, Jinguo
    [J]. ANNALS OF STATISTICS, 2017, 45 (04): : 1375 - 1402
  • [5] Change-point detection in astronomical data by using a hierarchical model and a Bayesian sampling approach
    Dobigeon, Nicolas
    Tourneret, Jean-Yves
    Scargle, Jeffrey D.
    [J]. 2005 IEEE/SP 13th Workshop on Statistical Signal Processing (SSP), Vols 1 and 2, 2005, : 335 - 340
  • [6] Online change-point detection for a transient change
    Noonan, Jack
    [J]. STATISTICS AND ITS INTERFACE, 2023, 16 (02) : 163 - 179
  • [7] Online change-point detection with kernels
    Ferrari, Andre
    Richard, Cedric
    Bourrier, Anthony
    Bouchikhi, Ikram
    [J]. PATTERN RECOGNITION, 2023, 133
  • [8] Restarted Bayesian Online Change-point Detector achieves Optimal Detection Delay
    Alami, Reda
    Maillard, Odalric
    Feraud, Raphael
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [9] Multiple change-point detection of multivariate mean vectors with the Bayesian approach
    Cheon, Sooyoung
    Kim, Jaehee
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (02) : 406 - 415
  • [10] Change-Point Detection in Multivariate Categorical Processes With Variable Selection
    He, Qing
    Liu, Weiyan
    Wang, Junjie
    [J]. IEEE ACCESS, 2019, 7 : 73065 - 73075