Shrinkage structure of partial least squares

被引:22
|
作者
Lingjærde, OC [1 ]
Christophersen, N [1 ]
机构
[1] Univ Oslo, N-0316 Oslo, Norway
关键词
Krylov subspace; least squares; partial least squares; principal components; rank deficient; shrinkage estimators; subspace distance;
D O I
10.1111/1467-9469.00201
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Partial least squares regression (PLS) is one method to estimate parameters in a linear model when predictor variables are nearly collinear. One way to characterize PLS is in terms of the scaling (shrinkage or expansion) along each eigenvector of the predictor correlation matrix. This characterization is useful in providing a link between PLS and other shrinkage estimators, such as principal components regression (PCR) and ridge regression (RR), thus facilitating a direct comparison of PLS with these methods. This paper gives a detailed analysis of the shrinkage structure of PLS, and several new results are presented regarding the nature and extent of shrinkage.
引用
收藏
页码:459 / 473
页数:15
相关论文
共 50 条
  • [21] Least squares and shrinkage estimation under bimonotonicity constraints
    Beran, Rudolf
    Duembgen, Lutz
    STATISTICS AND COMPUTING, 2010, 20 (02) : 177 - 189
  • [22] Extreme partial least-squares
    Bousebata, Meryem
    Enjolras, Geoffroy
    Girard, Stephane
    JOURNAL OF MULTIVARIATE ANALYSIS, 2023, 194
  • [23] IMPLEMENTING PARTIAL LEAST-SQUARES
    DENHAM, MC
    STATISTICS AND COMPUTING, 1995, 5 (03) : 191 - 202
  • [24] AN INTERPRETATION OF PARTIAL LEAST-SQUARES
    GARTHWAITE, PH
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1994, 89 (425) : 122 - 127
  • [25] Prediction intervals in partial least squares
    Denham, MC
    JOURNAL OF CHEMOMETRICS, 1997, 11 (01) : 39 - 52
  • [26] Approximate kernel partial least squares
    Xiling Liu
    Shuisheng Zhou
    Annals of Mathematics and Artificial Intelligence, 2020, 88 : 973 - 986
  • [27] Integrative sparse partial least squares
    Liang, Weijuan
    Ma, Shuangge
    Zhang, Qingzhao
    Zhu, Tingyu
    STATISTICS IN MEDICINE, 2021, 40 (09) : 2239 - 2256
  • [28] Global Sparse Partial Least Squares
    Mou, Yi
    You, Xinge
    Jiang, Xiubao
    Xu, Duanquan
    Yu, Shujian
    2014 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2014, : 349 - 352
  • [29] Partial least squares algorithms and methods
    Vinzi, Vincenzo Esposito
    Russolillo, Giorgio
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2013, 5 (01): : 1 - 19
  • [30] Approximate kernel partial least squares
    Liu, Xiling
    Zhou, Shuisheng
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2020, 88 (09) : 973 - 986