S-Estimation for Penalized Regression Splines

被引:19
|
作者
Tharmaratnam, Kukatharmini [1 ]
Claeskens, Gerda [1 ]
Croux, Christophe [1 ]
Saubian-Barrera, Matias [2 ]
机构
[1] Katholieke Univ Leuven, OR & Business Stat & Leuven Stat Res Ctr, Louvain, Belgium
[2] Univ British Columbia, Dept Stat, Vancouver, BC V6T 1W5, Canada
关键词
M-estimator; Penalized least squares method; S-estimator; Smoothing parameter; ASYMPTOTICS;
D O I
10.1198/jcgs.2010.08149
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This article is about S-estimation for penalized regression splines. Penalized regression splines are one of the currently most used methods for smoothing noisy data. The estimation method used for fitting such a penalized regression spline model is mostly based on least squares methods, which are known to be sensitive to outlying observations. In real-world applications, outliers are quite commonly observed. There are several robust estimation methods taking outlying observations into account. We define and study S-estimators for penalized regression spline models. Hereby we replace the least squares estimation method for penalized regression splines by a suitable S-estimation method. By keeping the modeling by means of splines and by keeping the penalty term, though using S-estimators instead of least squares estimators, we arrive at an estimation method that is both robust and flexible enough to capture nonlinear trends in the data. Simulated data and a real data example are used to illustrate the effectiveness of the procedure. Software code (for use with R) is available online.
引用
收藏
页码:609 / 625
页数:17
相关论文
共 50 条
  • [1] BIVARIATE PENALIZED SPLINES FOR REGRESSION
    Lai, Ming-Jun
    Wang, Li
    [J]. STATISTICA SINICA, 2013, 23 (03) : 1399 - 1417
  • [2] S-estimation of nonlinear regression models with dependent and heterogeneous observations
    Sakata, S
    White, H
    [J]. JOURNAL OF ECONOMETRICS, 2001, 103 (1-2) : 5 - 72
  • [3] A New Robust Algorithm for Penalized Regression Splines Based on Mode-Estimation
    Eldeeb, Ahmed
    Desoky, Sabreen
    Ahmed, Mohamed
    [J]. INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2021, 12 (01): : 1037 - 1055
  • [4] Smoothness Selection for Penalized Quantile Regression Splines
    Reiss, Philip T.
    Huang, Lei
    [J]. INTERNATIONAL JOURNAL OF BIOSTATISTICS, 2012, 8 (01):
  • [5] On semiparametric regression with O'Sullivan penalized splines
    Wand, M. P.
    Ormerod, J. T.
    [J]. AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2008, 50 (02) : 179 - 198
  • [6] Spatially adaptive Bayesian penalized regression splines (P-splines)
    Baladandayuthapani, V
    Mallick, BK
    Carroll, RJ
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2005, 14 (02) : 378 - 394
  • [7] Marginal longitudinal semiparametric regression via penalized splines
    Al Kadiri, M.
    Carroll, R. J.
    Wand, M. P.
    [J]. STATISTICS & PROBABILITY LETTERS, 2010, 80 (15-16) : 1242 - 1252
  • [8] Penalized estimation of free-knot splines
    Lindstrom, MJ
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 1999, 8 (02) : 333 - 352
  • [9] Semiparametric regression with shape-constrained penalized splines
    Hazelton, Martin L.
    Turlach, Berwin A.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2011, 55 (10) : 2871 - 2879
  • [10] Convex Regression via Penalized Splines: A Complementarity Approach
    Shen, Jinglai
    Wang, Xiao
    [J]. 2012 AMERICAN CONTROL CONFERENCE (ACC), 2012, : 332 - 337