An online Bayesian approach to change-point detection for categorical data

被引:6
|
作者
Fan, Yiwei [1 ,2 ]
Lu, Xiaoling [1 ,2 ]
机构
[1] Renmin Univ China, Ctr Appl Stat, Beijing, Peoples R China
[2] Renmin Univ China, Sch Stat, Beijing, Peoples R China
关键词
Bayes factor; Change-point detection; Dirichlet-multinomial mixtures; Online strategy; TIME-SERIES DATA; MULTINOMIAL DATA;
D O I
10.1016/j.knosys.2020.105792
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Change-point detection for categorical data has wide applications in many fields. Existing methods either are distribution-free, not utilizing categorical information sufficiently, or have limited performance when there exists "rare events" (events that occur with low frequency). In this paper, we propose a Bayesian change-point detection model for categorical data based on Dirichlet-multinomial mixtures. Because of the introduction of prior information, our method performs well for the existence of "rare events". An online parameter estimation procedure and an online detection strategy are then designed to adapt to data streams. Monte Carlo simulations discuss the power of the proposed method and show advantages compared with existing algorithms. Applications in biomedical research, document analysis, health news case study and location monitoring indicate practical values of our method. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Change-Point Detection in a Sequence of Bags-of-Data
    Koshijima, Kensuke
    Hino, Hideitsu
    Murata, Noboru
    [J]. 2016 32ND IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2016, : 1560 - 1561
  • [42] Online directed-structural change-point detection: A segment-wise time-varying dynamic Bayesian network approach
    Yang, Xing
    Zhang, Chen
    [J]. IISE TRANSACTIONS, 2024, 56 (05) : 527 - 540
  • [43] Nonparametric Change-Point Detection for Profiles with Binary Data
    Shang, Yanfen
    Wand, Zhiqiong
    He, Zhen
    He, Shuguang
    [J]. JOURNAL OF QUALITY TECHNOLOGY, 2017, 49 (02) : 123 - 135
  • [44] CONSTANT HAZARD AGAINST A CHANGE-POINT ALTERNATIVE - A BAYESIAN-APPROACH WITH CENSORED-DATA
    ACHCAR, JA
    BOLFARINE, H
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1989, 18 (10) : 3801 - 3819
  • [45] Online Change-Point Detection in Sparse Time Series With Application to Online Advertising
    Zhang, Jie
    Wei, Zhi
    Yan, Zhenyu
    Zhou, MengChu
    Pani, Abhishek
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (06): : 1141 - 1151
  • [46] Variance change-point detection in panel data models
    Li, Fuxiao
    Tian, Zheng
    Xiao, Yanting
    Chen, Zhanshou
    [J]. ECONOMICS LETTERS, 2015, 126 : 140 - 143
  • [47] THE CHANGE-POINT PROBLEM FOR ANGULAR DATA - A NONPARAMETRIC APPROACH
    LOMBARD, F
    [J]. TECHNOMETRICS, 1986, 28 (04) : 391 - 397
  • [48] onlineBcp: An R package for online change point detection using a Bayesian approach
    Xu, Hongyan
    Yigiter, Ayten
    Chen, Jie
    [J]. SOFTWAREX, 2022, 17
  • [49] Bayesian Change-Point Detection via Context-Tree Weighting
    Lungu, Valentinian
    Papageorgiou, Ioannis
    Kontoyiannis, Ioannis
    [J]. 2022 IEEE INFORMATION THEORY WORKSHOP (ITW), 2022, : 125 - 130
  • [50] rbrothers: R Package for Bayesian Multiple Change-Point Recombination Detection
    Irvahn, Jan
    Chattopadhyay, Sujay
    Sokurenko, Evgeni V.
    Minin, Vladimir N.
    [J]. EVOLUTIONARY BIOINFORMATICS, 2013, 9 : 235 - 238