Clustering of longitudinal curves via a penalized method and EM algorithm

被引:3
|
作者
Wang, Xin [1 ]
机构
[1] San Diego State Univ, Dept Math & Stat, 5500 Campanile, San Diego, CA 92182 USA
关键词
ADMM algorithm; B-spline regression; Clustering; EM algorithm; Functional principal component analysis; Penalty functions; FUNCTIONAL DATA; VARIABLE SELECTION; EFFECTS MODELS; MIXTURE MODEL; REGRESSION; COMPONENTS; PROFILES; CRITERIA; NUMBER;
D O I
10.1007/s00180-023-01380-2
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this article, a new method is proposed for clustering longitudinal curves. In the proposed method, clusters of mean functions are identified through a weighted concave pairwise fusion method. The EM algorithm and the alternating direction method of multipliers algorithm are combined to estimate the group structure, mean functions and principal components simultaneously. The proposed method also allows to incorporate the prior neighborhood information to have more meaningful groups by adding pairwise weights in the pairwise penalties. In the simulation study, the performance of the proposed method is compared to some existing clustering methods in terms of the accuracy for estimating the number of subgroups and mean functions. The results suggest that ignoring the covariance structure will have a great effect on the performance of estimating the number of groups and estimating accuracy. The effect of including pairwise weights is also explored in a spatial lattice setting to take into consideration of the spatial information. The results show that incorporating spatial weights will improve the performance. A real example is used to illustrate the proposed method.
引用
收藏
页码:1485 / 1512
页数:28
相关论文
共 50 条
  • [21] A conscientious rival penalized competitive learning text clustering algorithm
    Gao, Mao-ting
    Wang, Zheng-ou
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 1256 - 1260
  • [22] Unsupervised image segmentation using penalized fuzzy clustering algorithm
    Yang, Y
    Zhang, F
    Zheng, CX
    Lin, P
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING IDEAL 2005, PROCEEDINGS, 2005, 3578 : 71 - 77
  • [23] A New Algorithm and Theory for Penalized Regression-based Clustering
    Wu, Chong
    Kwon, Sunghoon
    Shen, Xiaotong
    Pan, Wei
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17 : 1 - 25
  • [24] EM Clustering Algorithm for Automatic Text Summarization
    Ledeneva, Yulia
    Garcia Hernandez, Rene
    Montiel Soto, Romyna
    Cruz Reyes, Rafael
    Gelbukh, Alexander
    ADVANCES IN ARTIFICIAL INTELLIGENCE, PT I, 2011, 7094 : 305 - 315
  • [25] Initialization of the Neighborhood EM Algorithm for Spatial Clustering
    Hu, Tianming
    Ouyang, Ji
    Qu, Chao
    Liu, Chuanren
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2009, 5678 : 487 - +
  • [26] Parallelizing EM clustering algorithm on a cluster of SMPs
    Glimcher, L
    Agrawal, G
    EURO-PAR 2004 PARALLEL PROCESSING, PROCEEDINGS, 2004, 3149 : 372 - 380
  • [27] Pairwise clustering with matrix factorisation and the EM algorithm
    Robles-Kelly, A
    Hancock, ER
    COMPUTER VISION - ECCV 2002, PT II, 2002, 2351 : 63 - 77
  • [28] Clustering Dynamic Textures with the Hierarchical EM Algorithm
    Chan, Antoni B.
    Coviello, Emanuele
    Lanckriet, Gert. R. G.
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 2022 - 2029
  • [29] Nonsmooth Penalized Clustering via lp Regularized Sparse Regression
    Niu, Lingfeng
    Zhou, Ruizhi
    Tian, Yingjie
    Qi, Zhiquan
    Zhang, Peng
    IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (06) : 1423 - 1433
  • [30] Using Penalized EM Algorithm to Infer Learning Trajectories in Latent Transition CDM
    Wang, Chun
    PSYCHOMETRIKA, 2021, 86 (01) : 167 - 189