Clustering of longitudinal curves via a penalized method and EM algorithm

被引:3
|
作者
Wang, Xin [1 ]
机构
[1] San Diego State Univ, Dept Math & Stat, 5500 Campanile, San Diego, CA 92182 USA
关键词
ADMM algorithm; B-spline regression; Clustering; EM algorithm; Functional principal component analysis; Penalty functions; FUNCTIONAL DATA; VARIABLE SELECTION; EFFECTS MODELS; MIXTURE MODEL; REGRESSION; COMPONENTS; PROFILES; CRITERIA; NUMBER;
D O I
10.1007/s00180-023-01380-2
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this article, a new method is proposed for clustering longitudinal curves. In the proposed method, clusters of mean functions are identified through a weighted concave pairwise fusion method. The EM algorithm and the alternating direction method of multipliers algorithm are combined to estimate the group structure, mean functions and principal components simultaneously. The proposed method also allows to incorporate the prior neighborhood information to have more meaningful groups by adding pairwise weights in the pairwise penalties. In the simulation study, the performance of the proposed method is compared to some existing clustering methods in terms of the accuracy for estimating the number of subgroups and mean functions. The results suggest that ignoring the covariance structure will have a great effect on the performance of estimating the number of groups and estimating accuracy. The effect of including pairwise weights is also explored in a spatial lattice setting to take into consideration of the spatial information. The results show that incorporating spatial weights will improve the performance. A real example is used to illustrate the proposed method.
引用
收藏
页码:1485 / 1512
页数:28
相关论文
共 50 条
  • [1] Clustering of longitudinal curves via a penalized method and EM algorithm
    Xin Wang
    Computational Statistics, 2024, 39 : 1485 - 1512
  • [2] VARIANCES FOR MAXIMUM PENALIZED LIKELIHOOD ESTIMATES OBTAINED VIA THE EM ALGORITHM
    SEGAL, MR
    BACCHETTI, P
    JEWELL, NP
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1994, 56 (02): : 345 - 352
  • [3] A batch rival penalized EM algorithm for Gaussian mixture clustering with automatic model selection
    Zhang, Dan
    Cheung, Yiu-ming
    ROUGH SETS AND KNOWLEDGE TECHNOLOGY, PROCEEDINGS, 2007, 4481 : 252 - +
  • [4] A Pseudo-EM Algorithm for Clustering Incomplete Longitudinal Data
    Shaikh, Mateen
    McNicholas, Paul D.
    Desmond, Anthony F.
    INTERNATIONAL JOURNAL OF BIOSTATISTICS, 2010, 6 (01):
  • [5] REGRESSION CLUSTERING WITH LOWER ERROR VIA EM ALGORITHM
    Vural, Metin
    Erdem, Pamir
    Agin, Onur
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 979 - 982
  • [6] Direct Calculation of the Variance of Maximum Penalized Likelihood Estimates via EM Algorithm
    Lee, Woojoo
    Pawitan, Yudi
    AMERICAN STATISTICIAN, 2014, 68 (02): : 93 - 97
  • [7] ON USE OF THE EM ALGORITHM FOR PENALIZED LIKELIHOOD ESTIMATION
    GREEN, PJ
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1990, 52 (03): : 443 - 452
  • [8] A fast algorithm for nonsmooth penalized clustering
    Zhou, Ruizhi
    Shen, Xin
    Niu, Lingfeng
    NEUROCOMPUTING, 2018, 273 : 583 - 592
  • [9] A Functional EM Algorithm for Mixing Density Estimation via Nonparametric Penalized Likelihood Maximization
    Liu, Lei
    Levine, Michael
    Zhu, Yu
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2009, 18 (02) : 481 - 504
  • [10] Maximum weighted likelihood via rival penalized EM for density mixture clustering with automatic model selection
    Cheung, YM
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (06) : 750 - 761