A variational Bayesian methodology for hidden Markov models utilizing Student's-t mixtures

被引:44
|
作者
Chatzis, Sotirios P. [1 ]
Kosmopoulos, Dimitrios I. [2 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, London SW7 2BT, England
[2] NSCR Dimokritos, Inst Informat & Telecommun, Athens 15310, Greece
关键词
Hidden Markov models; Student's-t distribution; Variational Bayes; Speaker identification; Robotic task failure; Violence detection; EM;
D O I
10.1016/j.patcog.2010.09.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Student's-t hidden Markov model (SHMM) has been recently proposed as a robust to outliers form of conventional continuous density hidden Markov models, trained by means of the expectation-maximization algorithm. In this paper, we derive a tractable variational Bayesian inference algorithm for this model. Our innovative approach provides an efficient and more robust alternative to EM-based methods, tackling their singularity and overfitting proneness, while allowing for the automatic determination of the optimal model size without cross-validation. We highlight the superiority of the proposed model over the competition using synthetic and real data. We also demonstrate the merits of our methodology in applications from diverse research fields, such as human computer interaction, robotics and semantic audio analysis. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:295 / 306
页数:12
相关论文
共 50 条
  • [1] A novel corporate credit rating system based on Student's-t hidden Markov models
    Petropoulos, Anastasios
    Chatzis, Sotirios P.
    Xanthopoulos, Stylianos
    EXPERT SYSTEMS WITH APPLICATIONS, 2016, 53 : 87 - 105
  • [2] VARIATIONAL BAYESIAN ANALYSIS FOR HIDDEN MARKOV MODELS
    McGrory, C. A.
    Titterington, D. M.
    AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2009, 51 (02) : 227 - 244
  • [3] Clustering Hidden Markov Models With Variational Bayesian Hierarchical EM
    Lan, Hui
    Liu, Ziquan
    Hsiao, Janet H.
    Yu, Dan
    Chan, Antoni B.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (03) : 1537 - 1551
  • [4] Robust inferential sensor development based on variational Bayesian Student's-t mixture regression
    Wang, Jingbo
    Shao, Weiming
    Song, Zhihuan
    NEUROCOMPUTING, 2019, 369 : 11 - 28
  • [5] Variational Bayesian Sparse Kernel-Based Blind Image Deconvolution With Student's-t Priors
    Tzikas, Dimitris G.
    Likas, Aristidis C.
    Galatsanos, Nikolaos P.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (04) : 753 - 764
  • [6] Nonlinear variational Bayesian Student's-t mixture regression and inferential sensor application with semisupervised data
    Wang, Jingbo
    Shao, Weiming
    Zhang, Xinmin
    Qian, Jinchuan
    Song, Zhihuan
    Peng, Zhiping
    JOURNAL OF PROCESS CONTROL, 2021, 105 : 141 - 159
  • [7] Bayesian mixtures of Hidden Tree Markov Models for structured data clustering
    Bacciu, Davide
    Castellana, Daniele
    NEUROCOMPUTING, 2019, 342 : 49 - 59
  • [8] VARIATIONAL NONPARAMETRIC BAYESIAN HIDDEN MARKOV MODEL
    Ding, Nan
    Ou, Zhijian
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 2098 - 2101
  • [9] VARIATIONAL BAYESIAN ANALYSIS OF NONHOMOGENEOUS HIDDEN MARKOV MODELS WITH LONG AND ULTRALONG SEQUENCES
    Chen, Xinyuan
    Li, Yiwei
    Feng, Xiangnan
    Chang, Joseph T.
    ANNALS OF APPLIED STATISTICS, 2023, 17 (02): : 1615 - 1640
  • [10] Variational Bayesian Variable Selection for High-Dimensional Hidden Markov Models
    Zhai, Yao
    Liu, Wei
    Jin, Yunzhi
    Zhang, Yanqing
    MATHEMATICS, 2024, 12 (07)