Tuning Parameter Selection for Underdetermined Reduced-Rank Regression

被引:6
|
作者
Ulfarsson, Magnus O. [1 ]
Solo, Victor [2 ]
机构
[1] Univ Iceland, Dept Elect & Comp Engn, IS-111 Reykjavik, Iceland
[2] Univ New S Wales, Sch Elect Engn, Sydney, NSW 2052, Australia
关键词
Model selection; reduced-rank regression; Stein's unbiased risk estimation (SURE); MODEL; REGULARIZATION; DIMENSION; SIGNALS; SURE;
D O I
10.1109/LSP.2013.2272463
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multivariate regression is one of the most widely applied multivariate statistical methods with many uses across a range of disciplines. But the number of parameters increases exponentially with dimension and reduced-rank regression (RRR) is a well known approach to dimension reduction. But traditional RRR applies only to an overdetermined system. For increasingly common undetermined systems this issue can be managed by regularization, e.g., with a quadratic penalty. A significant problem is then the choice of the two tuning parameters: one discrete i.e., the rank; the other continuous i.e., the Tikhonov penalty parameter. In this paper we resolve this problem via Stein's unbiased risk estimator (SURE). We compare SURE to cross-validation and apply it on both simulated and real data sets.
引用
收藏
页码:881 / 884
页数:4
相关论文
共 50 条
  • [42] Maximum likelihood parameter and rank estimation in reduced-rank multivariate linear regressions
    Stoica, P
    Viberg, M
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1996, 44 (12) : 3069 - 3078
  • [43] Hilbert space methods for reduced-rank Gaussian process regression
    Solin, Arno
    Sarkka, Simo
    STATISTICS AND COMPUTING, 2020, 30 (02) : 419 - 446
  • [44] Hilbert space methods for reduced-rank Gaussian process regression
    Arno Solin
    Simo Särkkä
    Statistics and Computing, 2020, 30 : 419 - 446
  • [45] MODEL FREE MULTIVARIATE REDUCED-RANK REGRESSION WITH CATEGORICAL PREDICTORS
    Setodji, Claude Messan
    Li, Lexin
    STATISTICA SINICA, 2009, 19 (03) : 1119 - 1136
  • [46] A fully Bayesian approach to sparse reduced-rank multivariate regression
    Yang, Dunfu
    Goh, Gyuhyeong
    Wang, Haiyan
    STATISTICAL MODELLING, 2022, 22 (03) : 199 - 220
  • [47] Multivariate Functional Regression Via Nested Reduced-Rank Regularization
    Liu, Xiaokang
    Ma, Shujie
    Chen, Kun
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2022, 31 (01) : 231 - 240
  • [48] On the Optimum Number of Hypotheses for Adaptive Reduced-Rank Subspace Selection
    Hofer, Markus
    Xu, Zhinan
    Zemen, Thomas
    2015 IEEE 82ND VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2015,
  • [49] Sparse reduced-rank regression for multivariate varying-coefficient models
    Zhang, Fode
    Li, Rui
    Lian, Heng
    Bandyopadhyay, Dipankar
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2021, 91 (04) : 752 - 767
  • [50] Reduced-rank Least Squares Parameter Estimation in the Presence of Byzantine Sensors
    Nagananda, K. G.
    Blum, Rick S.
    Koppel, Alec
    2020 54TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2020, : 30 - 35