Penalized estimation in finite mixture of ultra-high dimensional regression models

被引:1
|
作者
Tang, Shiyi [1 ]
Zheng, Jiali [1 ]
机构
[1] Shanghai Univ Finance & Econ, Sch Stat & Management, Shanghai, Peoples R China
关键词
Finite mixture of regression models; ultra-high dimensional regression; EM algorithm; variable selection; order selection;
D O I
10.1080/03610926.2020.1851717
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we propose a penalized estimation method for finite mixture of ultra-high dimensional regression models. A two-step procedure is explored. Firstly, we conduct order selection with the number of components unknown. Then variable selection is applied to ultra-high dimensional regression models. A specific EM algorithm is designed to maximize penalized log-likelihood function. We demonstrate our method by numerical simulations which performs well. Further, an empirical study of return on equity (ROE) prediction is shown to consolidate our methodology.
引用
收藏
页码:5971 / 5992
页数:22
相关论文
共 50 条
  • [21] SCAD-PENALIZED REGRESSION IN HIGH-DIMENSIONAL PARTIALLY LINEAR MODELS
    Xie, Huiliang
    Huang, Jian
    [J]. ANNALS OF STATISTICS, 2009, 37 (02): : 673 - 696
  • [22] Penalized Regression for Fitting High Dimensional Propensity Score Models in Small Samples
    de Moor, Carl
    Malka, Ed
    [J]. PHARMACOEPIDEMIOLOGY AND DRUG SAFETY, 2014, 23 : 11 - 11
  • [23] PREDICTION OF THE NASH THROUGH PENALIZED MIXTURE OF LOGISTIC REGRESSION MODELS
    Morvan, Marie
    Devijver, Emilie
    Giacofci, Madison
    Monbet, Valerie
    [J]. ANNALS OF APPLIED STATISTICS, 2021, 15 (02): : 952 - 970
  • [24] PENALIZED INTERACTION ESTIMATION FOR ULTRAHIGH DIMENSIONAL QUADRATIC REGRESSION
    Wang, Cheng
    Jiang, Binyan
    Zhu, Liping
    [J]. STATISTICA SINICA, 2021, 31 (03) : 1549 - 1570
  • [25] Composite quantile regression for ultra-high dimensional semiparametric model averaging
    Guo, Chaohui
    Lv, Jing
    Wu, Jibo
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2021, 160
  • [26] Joint rank and variable selection for parsimonious estimation in a high-dimensional finite mixture regression model
    Devijver, Emilie
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2017, 157 : 1 - 13
  • [27] Penalized spline estimation for functional coefficient regression models
    Cao, Yanrong
    Lin, Haiqun
    Wu, Tracy Z.
    Yu, Yan
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (04) : 891 - 905
  • [28] Uniform joint screening for ultra-high dimensional graphical models
    Zheng, Zemin
    Shi, Haiyu
    Li, Yang
    Yuan, Hui
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2020, 179
  • [29] FUNCTIONAL FINITE MIXTURE REGRESSION MODELS
    Wang, Xiao
    Liu, Leo Yu-Feng
    Zhu, Hongtu
    [J]. STATISTICA SINICA, 2023, 33 (03) : 2087 - 2115
  • [30] Statistical analysis for a penalized EM algorithm in high-dimensional mixture linear regression model
    Wang, Ning
    Zhang, Xin
    Mai, Qing
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25