MODEL SELECTION AND STRUCTURE SPECIFICATION IN ULTRA-HIGH DIMENSIONAL GENERALISED SEMI-VARYING COEFFICIENT MODELS

被引:28
|
作者
Li, Degui [1 ]
Ke, Yuan [1 ]
Zhang, Wenyang [1 ]
机构
[1] Univ York, Dept Math, York YO10 5DD, N Yorkshire, England
来源
ANNALS OF STATISTICS | 2015年 / 43卷 / 06期
基金
新加坡国家研究基金会; 英国医学研究理事会; 美国国家科学基金会;
关键词
GSVCM; LASSO; local maximum likelihood; oracle estimation; SCAD; sparsity; ultra-high dimension; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; EFFICIENT ESTIMATION; REGRESSION; LASSO; SHRINKAGE;
D O I
10.1214/15-AOS1356
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we study the model selection and structure specification for the generalised semi-varying coefficient models (GSVCMs), where the number of potential covariates is allowed to be larger than the sample size. We first propose a penalised likelihood method with the LASSO penalty function to obtain the preliminary estimates of the functional coefficients. Then, using the quadratic approximation for the local log-likelihood function and the adaptive group LASSO penalty (or the local linear approximation of the group SCAD penalty) with the help of the preliminary estimation of the functional coefficients, we introduce a novel penalised weighted least squares procedure to select the significant covariates and identify the constant coefficients among the coefficients of the selected covariates, which could thus specify the semiparametric modelling structure. The developed model selection and structure specification approach not only inherits many nice statistical properties from the local maximum likelihood estimation and nonconcave penalised likelihood method, but also computationally attractive thanks to the computational algorithm that is proposed to implement our method. Under some mild conditions, we establish the asymptotic properties for the proposed model selection and estimation procedure such as the sparsity and oracle property. We also conduct simulation studies to examine the finite sample performance of the proposed method, and finally apply the method to analyse a real data set, which leads to some interesting findings.
引用
收藏
页码:2676 / 2705
页数:30
相关论文
共 50 条
  • [1] ADAPTIVE SEMI-VARYING COEFFICIENT MODEL SELECTION
    Hu, Tao
    Xia, Yingcun
    [J]. STATISTICA SINICA, 2012, 22 (02) : 575 - 599
  • [2] Forward Variable Selection for Sparse Ultra-High Dimensional Varying Coefficient Models
    Cheng, Ming-Yen
    Honda, Toshio
    Zhang, Jin-Ting
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2016, 111 (515) : 1209 - 1221
  • [3] The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors
    Huang, Lei
    Jiang, Hui
    Tian, Haitao
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (03) : 549 - 558
  • [4] Estimation on Generalized Semi-varying Coefficient Models
    Lv Shi-qin
    Wei Juan
    Zhang Gang
    [J]. 2012 INTERNATIONAL CONFERENCE ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING (ICMPBE2012), 2012, 33 : 949 - 953
  • [5] Estimation on Generalized Semi-varying Coefficient Models
    Lv Shi-qin
    Wei Juan
    Zhang Gang
    [J]. 2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL II, 2010, : 195 - 196
  • [6] Variance estimation for sparse ultra-high dimensional varying coefficient models
    Wang, Zhaoliang
    Xue, Liugen
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2019, 48 (05) : 1270 - 1283
  • [7] Estimation of semi-varying coefficient models with nonstationary regressors
    Li, Kunpeng
    Li, Degui
    Liang, Zhongwen
    Hsiao, Cheng
    [J]. ECONOMETRIC REVIEWS, 2017, 36 (1-3) : 354 - 369
  • [8] Estimation and inference for generalized semi-varying coefficient models
    Liu, Yuan
    Zhao, Yan-Yong
    Zhao, Jian-Qiang
    Miao, Zhang-Xiao
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2018, 88 (11) : 2215 - 2231
  • [9] Semi-varying coefficient models with a diverging number of components
    Li, Gaorong
    Xue, Liugen
    Lian, Heng
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2011, 102 (07) : 1166 - 1174
  • [10] Estimation of semi-varying coefficient models for longitudinal data with irregular error structure
    Zhao, Yan-Yong
    Lin, Jin-Guan
    Zhao, Jian-Qiang
    Miao, Zhang-Xiao
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2022, 169