Parametric and semiparametric reduced-rank regression with flexible sparsity

被引:6
|
作者
Lian, Heng [1 ,3 ]
Feng, Sanying [2 ]
Zhao, Kaifeng [1 ]
机构
[1] Nanyang Technol Univ, Div Math Sci, Singapore 637371, Singapore
[2] Beijing Univ Technol, Coll Appl Sci, Beijing 100124, Peoples R China
[3] Univ New S Wales, Sch Math & Stat, Sydney, NSW 2052, Australia
关键词
Additive models; Oracle inequality; Reduced-rank regression; Sparse group lasso; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; MODEL SELECTION; ADAPTIVE LASSO;
D O I
10.1016/j.jmva.2015.01.013
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider joint rank and variable selection in multivariate regression. Previously proposed joint rank and variable selection approaches assume that different responses are related to the same set of variables, which suggests using a group penalty on the rows of the coefficient matrix. However, this assumption may not hold in practice and motivates the usual lasso (l(1)) penalty on the coefficient matrix. We propose to use the gradient-proximal algorithm to solve this problem, which is a recent development in optimization. We also present some theoretical results for the proposed estimator with the l(1) penalty. We then consider several extensions including adaptive lasso penalty, sparse group penalty, and additive models. The proposed methodology thus offers a much more complete set of tools in high-dimensional multivariate regression. Finally, we present numerical illustrations based on simulated and real data sets. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:163 / 174
页数:12
相关论文
共 50 条
  • [1] Rank estimation in reduced-rank regression
    Bura, E
    Cook, RD
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2003, 87 (01) : 159 - 176
  • [2] PROCEDURES FOR REDUCED-RANK REGRESSION
    DAVIES, PT
    TSO, MKS
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 1982, 31 (03) : 244 - 255
  • [3] Reduced-rank linear regression
    Stoica, P
    Viberg, M
    [J]. 8TH IEEE SIGNAL PROCESSING WORKSHOP ON STATISTICAL SIGNAL AND ARRAY PROCESSING, PROCEEDINGS, 1996, : 542 - 545
  • [4] BIPLOTS IN REDUCED-RANK REGRESSION
    TERBRAAK, CJF
    LOOMAN, CWN
    [J]. BIOMETRICAL JOURNAL, 1994, 36 (08) : 983 - 1003
  • [5] Envelopes and reduced-rank regression
    Cook, R. Dennis
    Forzani, Liliana
    Zhang, Xin
    [J]. BIOMETRIKA, 2015, 102 (02) : 439 - 456
  • [6] Robust reduced-rank regression
    She, Y.
    Chen, K.
    [J]. BIOMETRIKA, 2017, 104 (03) : 633 - 647
  • [7] The APT model as reduced-rank regression
    Bekker, P
    Dobbelstein, P
    Wansbeek, T
    [J]. JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 1996, 14 (02) : 199 - 202
  • [8] Online Robust Reduced-Rank Regression
    Yang, Yangzhuoran Fin
    Zhao, Ziping
    [J]. 2020 IEEE 11TH SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP (SAM), 2020,
  • [9] Robust reduced-rank modeling via rank regression
    Zhao, Weihua
    Lian, Heng
    Ma, Shujie
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2017, 180 : 1 - 12
  • [10] Sparse reduced-rank regression with covariance estimation
    Lisha Chen
    Jianhua Z. Huang
    [J]. Statistics and Computing, 2016, 26 : 461 - 470