Concave group methods for variable selection and estimation in high-dimensional varying coefficient models

被引:0
|
作者
YANG GuangRen [1 ,2 ]
HUANG Jian [3 ]
ZHOU Yong [2 ,4 ]
机构
[1] Department of Statistics,School of Economics,Jinan University
[2] School of Statistics and Management,Shanghai University of Finance and Economics
[3] Department of Statistics and Actuarial Science,University of Iowa
[4] Academy of Mathematics and Systems Science,Chinese Academy of Sciences
基金
国家自然科学基金重点项目; 中国国家自然科学基金;
关键词
basis expansion; group lasso; group MCP; high-dimensional data; sparsity; oracle property;
D O I
暂无
中图分类号
O212.4 [多元分析];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The varying-coefficient model is flexible and powerful for modeling the dynamic changes of regression coefficients.We study the problem of variable selection and estimation in this model in the sparse,highdimensional case.We develop a concave group selection approach for this problem using basis function expansion and study its theoretical and empirical properties.We also apply the group Lasso for variable selection and estimation in this model and study its properties.Under appropriate conditions,we show that the group least absolute shrinkage and selection operator(Lasso)selects a model whose dimension is comparable to the underlying model,regardless of the large number of unimportant variables.In order to improve the selection results,we show that the group minimax concave penalty(MCP)has the oracle selection property in the sense that it correctly selects important variables with probability converging to one under suitable conditions.By comparison,the group Lasso does not have the oracle selection property.In the simulation parts,we apply the group Lasso and the group MCP.At the same time,the two approaches are evaluated using simulation and demonstrated on a data example.
引用
收藏
页码:2073 / 2090
页数:18
相关论文
共 50 条
  • [1] Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
    Yang GuangRen
    Huang Jian
    Zhou Yong
    [J]. SCIENCE CHINA-MATHEMATICS, 2014, 57 (10) : 2073 - 2090
  • [2] Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
    GuangRen Yang
    Jian Huang
    Yong Zhou
    [J]. Science China Mathematics, 2014, 57 : 2073 - 2090
  • [3] VARIABLE SELECTION AND ESTIMATION IN HIGH-DIMENSIONAL VARYING-COEFFICIENT MODELS
    Wei, Fengrong
    Huang, Jian
    Li, Hongzhe
    [J]. STATISTICA SINICA, 2011, 21 (04) : 1515 - 1540
  • [4] Variable selection in high-dimensional quantile varying coefficient models
    Tang, Yanlin
    Song, Xinyuan
    Wang, Huixia Judy
    Zhu, Zhongyi
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2013, 122 : 115 - 132
  • [5] VARIABLE SELECTION FOR HIGH-DIMENSIONAL GENERALIZED VARYING-COEFFICIENT MODELS
    Lian, Heng
    [J]. STATISTICA SINICA, 2012, 22 (04) : 1563 - 1588
  • [6] Variable Selection in High-dimensional Varying-coefficient Models with Global Optimality
    Xue, Lan
    Qu, Annie
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 1973 - 1998
  • [7] Structural identification and variable selection in high-dimensional varying-coefficient models
    Chen, Yuping
    Bai, Yang
    Fung, Wingkam
    [J]. JOURNAL OF NONPARAMETRIC STATISTICS, 2017, 29 (02) : 258 - 279
  • [8] Variable selection and estimation in high-dimensional models
    Horowitz, Joel L.
    [J]. CANADIAN JOURNAL OF ECONOMICS-REVUE CANADIENNE D ECONOMIQUE, 2015, 48 (02): : 389 - 407
  • [9] Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty
    Zhaoping Hong
    Yuao Hu
    Heng Lian
    [J]. Metrika, 2013, 76 : 887 - 908
  • [10] Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty
    Hong, Zhaoping
    Hu, Yuao
    Lian, Heng
    [J]. METRIKA, 2013, 76 (07) : 887 - 908