Robust variable selection for finite mixture regression models

被引:9
|
作者
Tang, Qingguo [1 ]
Karunamuni, R. J. [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Econ & Management, Nanjing, Jiangsu, Peoples R China
[2] Univ Alberta, Dept Math & Stat Sci, Edmonton, AB T6G 2G1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Finite mixture regression models; Variable selection; Minimum-distance methods; MINIMUM HELLINGER DISTANCE; NONCONCAVE PENALIZED LIKELIHOOD; MULTIVARIATE LOCATION; DIVERGING NUMBER; OF-EXPERTS; ESTIMATORS; EFFICIENT; REGULARIZATION; SHRINKAGE;
D O I
10.1007/s10463-017-0602-4
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Finite mixture regression (FMR) models are frequently used in statistical modeling, often with many covariates with low significance. Variable selection techniques can be employed to identify the covariates with little influence on the response. The problem of variable selection in FMR models is studied here. Penalized likelihood-based approaches are sensitive to data contamination, and their efficiency may be significantly reduced when the model is slightly misspecified. We propose a new robust variable selection procedure for FMR models. The proposed method is based on minimum-distance techniques, which seem to have some automatic robustness to model misspecification. We show that the proposed estimator has the variable selection consistency and oracle property. The finite-sample breakdown point of the estimator is established to demonstrate its robustness. We examine small-sample and robustness properties of the estimator using a Monte Carlo study. We also analyze a real data set.
引用
收藏
页码:489 / 521
页数:33
相关论文
共 50 条
  • [41] Robust estimation for the order of finite mixture models
    Sangyeol Lee
    Taewook Lee
    [J]. Metrika, 2008, 68 : 365 - 390
  • [42] FOUR USEFUL FINITE MIXTURE MODELS FOR REGRESSION ANALYSES OF PANEL DATA WITH A CATEGORICAL DEPENDENT VARIABLE
    Yamaguchi, Kazuo
    [J]. SOCIOLOGICAL METHODOLOGY, VOL 38, 2008, 38 : 283 - 328
  • [43] Robust estimation for the order of finite mixture models
    Lee, Sangyeol
    Lee, Taewook
    [J]. METRIKA, 2008, 68 (03) : 365 - 390
  • [44] Bayesian variable selection in Markov mixture models
    Paroli, Roberta
    Spezia, Luigi
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2008, 37 (01) : 25 - 47
  • [45] Variable Selection for Clustering with Gaussian Mixture Models
    Maugis, Cathy
    Celeux, Gilles
    Martin-Magniette, Marie-Laure
    [J]. BIOMETRICS, 2009, 65 (03) : 701 - 709
  • [46] A robust and efficient variable selection method for linear regression
    Yang, Zhuoran
    Fu, Liya
    Wang, You-Gan
    Dong, Zhixiong
    Jiang, Yunlu
    [J]. JOURNAL OF APPLIED STATISTICS, 2022, 49 (14) : 3677 - 3692
  • [47] Robust Variable Selection and Estimation in Threshold Regression Model
    Bo-wen Li
    Yun-qi Zhang
    Nian-sheng Tang
    [J]. Acta Mathematicae Applicatae Sinica, English Series, 2020, 36 : 332 - 346
  • [48] Variable selection and transformation in linear regression models
    Yeo, IK
    [J]. STATISTICS & PROBABILITY LETTERS, 2005, 72 (03) : 219 - 226
  • [49] Simultaneous variable selection for heteroscedastic regression models
    Zhang, Zhongzhan
    Wang, Darong
    [J]. PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON FINANCIAL ENGINEERING AND RISK MANAGEMENT 2008, 2008, : 141 - 143
  • [50] Variable Selection Linear Regression for Robust Speech Recognition
    Tsao, Yu
    Hu, Ting-Yao
    Sakti, Sakriani
    Nakamura, Satoshi
    Lee, Lin-shan
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (06) : 1477 - 1487