Concave group methods for variable selection and estimation in high-dimensional varying coefficient models

被引:0
|
作者
YANG GuangRen [1 ,2 ]
HUANG Jian [3 ]
ZHOU Yong [2 ,4 ]
机构
[1] Department of Statistics,School of Economics,Jinan University
[2] School of Statistics and Management,Shanghai University of Finance and Economics
[3] Department of Statistics and Actuarial Science,University of Iowa
[4] Academy of Mathematics and Systems Science,Chinese Academy of Sciences
基金
中国国家自然科学基金; 国家自然科学基金重点项目;
关键词
basis expansion; group lasso; group MCP; high-dimensional data; sparsity; oracle property;
D O I
暂无
中图分类号
O212.4 [多元分析];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The varying-coefficient model is flexible and powerful for modeling the dynamic changes of regression coefficients.We study the problem of variable selection and estimation in this model in the sparse,highdimensional case.We develop a concave group selection approach for this problem using basis function expansion and study its theoretical and empirical properties.We also apply the group Lasso for variable selection and estimation in this model and study its properties.Under appropriate conditions,we show that the group least absolute shrinkage and selection operator(Lasso)selects a model whose dimension is comparable to the underlying model,regardless of the large number of unimportant variables.In order to improve the selection results,we show that the group minimax concave penalty(MCP)has the oracle selection property in the sense that it correctly selects important variables with probability converging to one under suitable conditions.By comparison,the group Lasso does not have the oracle selection property.In the simulation parts,we apply the group Lasso and the group MCP.At the same time,the two approaches are evaluated using simulation and demonstrated on a data example.
引用
收藏
页码:2073 / 2090
页数:18
相关论文
共 50 条
  • [41] Estimation and variable selection for generalized functional partially varying coefficient hybrid models
    Liu, Yanxia
    Wang, Zhihao
    Tian, Maozai
    Yu, Keming
    [J]. STATISTICAL PAPERS, 2024, 65 (01) : 93 - 119
  • [42] Variable selection and estimation for high-dimensional partially linear spatial autoregressive models with measurement errors
    Huang, Zhensheng
    Meng, Shuyu
    Zhang, Linlin
    [J]. STATISTICS AND ITS INTERFACE, 2024, 17 (04) : 681 - 697
  • [43] Group selection in high-dimensional partially linear additive models
    Wei, Fengrong
    [J]. BRAZILIAN JOURNAL OF PROBABILITY AND STATISTICS, 2012, 26 (03) : 219 - 243
  • [44] High-dimensional Varying Index Coefficient Models via Stein’s Identity
    Na, Sen
    Yang, Zhuoran
    Wang, Zhaoran
    Kolar, Mladen
    [J]. Journal of Machine Learning Research, 2019, 20
  • [45] High-dimensional Varying Index Coefficient Models via Stein's Identity
    Na, Sen
    Yang, Zhuoran
    Wang, Zhaoran
    Kolar, Mladen
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [46] JOINT VARIABLE AND RANK SELECTION FOR PARSIMONIOUS ESTIMATION OF HIGH-DIMENSIONAL MATRICES
    Bunea, Florentina
    She, Yiyuan
    Wegkamp, Marten H.
    [J]. ANNALS OF STATISTICS, 2012, 40 (05): : 2359 - 2388
  • [47] Variable selection for fixed effects varying coefficient models
    Gao Rong Li
    Heng Lian
    Peng Lai
    Heng Peng
    [J]. Acta Mathematica Sinica, English Series, 2015, 31 : 91 - 110
  • [48] Variable selection of the quantile varying coefficient regression models
    Weihua Zhao
    Riquan Zhang
    Yazhao Lv
    Jicai Liu
    [J]. Journal of the Korean Statistical Society, 2013, 42 : 343 - 358
  • [49] Variable selection for varying coefficient models with measurement errors
    Peixin Zhao
    Liugen Xue
    [J]. Metrika, 2011, 74 : 231 - 245
  • [50] Variable bandwidth selection in varying-coefficient models
    Zhang, WY
    Lee, SY
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2000, 74 (01) : 116 - 134