Variable Selection in Additive Models Using P-Splines

被引:22
|
作者
Antoniadis, Anestis [1 ]
Gijbels, Irene [2 ,3 ]
Verhasselt, Anneleen [4 ]
机构
[1] Univ Grenoble 1, Lab Jean Kuntzmann, Grenoble, France
[2] Katholieke Univ Leuven, Dept Math, Louvain, Belgium
[3] Katholieke Univ Leuven, Leuven Stat Res Ctr LStat, Louvain, Belgium
[4] Univ Antwerp, Dept Math & Comp Sci, B-2020 Antwerp, Belgium
关键词
Additive modeling; Nonnegative garrote; Nonparametric smoothing; Penalized spline regression; Selection of variables; PENALIZED LIKELIHOOD; REGULARIZATION; REGRESSION; FLOW;
D O I
10.1080/00401706.2012.726000
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article extends the nonnegative garrote method to a component selection method in a nonparametric additive model in which each univariate function is estimated with P-splines. We also establish the consistency of the procedure. An advantage of P-splines is that the fitted function is represented in a rather small basis of B-splines. A numerical study illustrates the finite-sample performance of the method and includes a comparison with other methods. The nonnegative garrote method with P-splines has the advantage of being computationally fast and performs, with an appropriate parameter selection procedure implemented, overall very well. Real data analysis leads to interesting findings. Supplementary materials for this article (technical proofs, additional numerical results, R code) are available online.
引用
收藏
页码:425 / 438
页数:14
相关论文
共 50 条
  • [31] Spatially adaptive Bayesian penalized regression splines (P-splines)
    Baladandayuthapani, V
    Mallick, BK
    Carroll, RJ
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2005, 14 (02) : 378 - 394
  • [32] REML for Two-Dimensional P-Splines
    Boer, Martin P.
    DEVELOPMENTS IN STATISTICAL MODELLING, IWSM 2024, 2024, : 1 - 6
  • [33] FAVARDS SOLUTION IS LIMIT OF WK,P-SPLINES
    CHUI, CK
    SMITH, PW
    WARD, JD
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1976, 220 (JUN) : 299 - 305
  • [34] Flexible smoothing with P-splines: a unified approach
    Currie, I. D.
    Durban, M.
    STATISTICAL MODELLING, 2002, 2 (04) : 333 - 349
  • [35] Sketching for Kronecker Product Regression and P-splines
    Diao, Huaian
    Song, Zhao
    Sun, Wen
    Woodruff, David P.
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [36] Anisotropic multidimensional smoothing using Bayesian tensor product P-splines
    Bach, Paul
    Klein, Nadja
    STATISTICS AND COMPUTING, 2025, 35 (02)
  • [37] LIMITS OF HK,P-SPLINES AS P-] 1
    CHUI, CK
    SMITH, PW
    WARD, JD
    NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY, 1975, 22 (01): : A161 - A161
  • [38] Simultaneous probability statements for Bayesian P-splines
    Brezger, Andreas
    Lang, Stefan
    STATISTICAL MODELLING, 2008, 8 (02) : 141 - 168
  • [39] Frequency Analysis of Recurrence Variational P-Splines
    Kochegurova E.A.
    Kochegurov A.I.
    Rozhkova N.E.
    Optoelectronics, Instrumentation and Data Processing, 2017, 53 (6) : 591 - 598
  • [40] Fast bivariate P-splines: the sandwich smoother
    Xiao, Luo
    Li, Yingxing
    Ruppert, David
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2013, 75 (03) : 577 - 599