Nonnegative estimation and variable selection under minimax concave penalty for sparse high-dimensional linear regression models

被引:0
|
作者
Ning Li
Hu Yang
机构
[1] Chongqing University,College of Mathematics and Statistics
来源
Statistical Papers | 2021年 / 62卷
关键词
High-dimensional variable selection; Minimax concave penalty; Nonnegativity constraints; Oracle property;
D O I
暂无
中图分类号
学科分类号
摘要
As a promising alternative to the Lasso penalty, the minimax concave penalty (MCP) produces nearly unbiased shrinkage estimate. In this paper, we propose the nonnegative MCP estimator in the specific high-dimensional settings where the regression coefficients are imposed with the nonnegativity constraint, which is particularly relevant when modelling nonnegative data. We prove that the asymptotic theory for the nonnegative MCP estimator requires much weaker assumptions than those in the literature. In particular, we do not impose the restrictive distributional conditions on the random errors and do not assume the irrepresentable condition or its variants on the design matrix. For the nonnegative MCP estimator, despite its good asymptotic properties, the corresponding optimization problem is non-convex, and consequently much hard to solve. Thus, we develop an efficient computation algorithm, which is a coupling of the difference convex algorithm with the multiplicative updates algorithm, for the implementation of the nonnegative MCP estimator. Simulation studies are carried out to examine superior performance of the nonnegative MCP estimator against alternative methods and a real data analysis for index tracking is also presented for illustration.
引用
收藏
页码:661 / 680
页数:19
相关论文
共 50 条
  • [31] Transfer learning for high-dimensional linear regression: Prediction, estimation and minimax optimality
    Li, Sai
    Cai, T. Tony
    Li, Hongzhe
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2022, 84 (01) : 149 - 173
  • [32] Robust and sparse estimation methods for high-dimensional linear and logistic regression
    Kurnaz, Fatma Sevinc
    Hoffmann, Irene
    Filzmoser, Peter
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2018, 172 : 211 - 222
  • [33] Early stopping aggregation in selective variable selection ensembles for high-dimensional linear regression models
    Zhang, Chun-Xia
    Zhang, Jiang-She
    Yin, Qing-Yan
    KNOWLEDGE-BASED SYSTEMS, 2018, 153 : 1 - 11
  • [34] Variable selection in high-dimensional double generalized linear models
    Xu, Dengke
    Zhang, Zhongzhan
    Wu, Liucang
    STATISTICAL PAPERS, 2014, 55 (02) : 327 - 347
  • [35] Variable selection in high-dimensional partly linear additive models
    Lian, Heng
    JOURNAL OF NONPARAMETRIC STATISTICS, 2012, 24 (04) : 825 - 839
  • [36] Variable selection in high-dimensional double generalized linear models
    Dengke Xu
    Zhongzhan Zhang
    Liucang Wu
    Statistical Papers, 2014, 55 : 327 - 347
  • [37] Variable selection and estimation for high-dimensional spatial autoregressive models
    Cai, Liqian
    Maiti, Tapabrata
    SCANDINAVIAN JOURNAL OF STATISTICS, 2020, 47 (02) : 587 - 607
  • [38] Estimation and variable selection for high-dimensional spatial data models
    Hou, Li
    Jin, Baisuo
    Wu, Yuehua
    JOURNAL OF ECONOMETRICS, 2024, 238 (02)
  • [39] Minimax Rates of Estimation for High-Dimensional Linear Regression Over lq-Balls
    Raskutti, Garvesh
    Wainwright, Martin J.
    Yu, Bin
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (10) : 6976 - 6994
  • [40] Improving heritability estimation by a variable selection approach in sparse high dimensional linear mixed models
    Bonnet, Anna
    Levy-Leduc, Celine
    Gassiat, Elisabeth
    Toro, Roberto
    Bourgeron, Thomas
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 2018, 67 (04) : 813 - 839