ROBUST NONPARAMETRIC ESTIMATION VIA WAVELET MEDIAN REGRESSION

被引:29
|
作者
Brown, Lawrence D. [1 ]
Cai, T. Tony [1 ]
Zhou, Harrison H. [2 ]
机构
[1] Univ Penn, Wharton Sch, Philadelphia, PA 19104 USA
[2] Yale Univ, Dept Stat, New Haven, CT 06511 USA
来源
ANNALS OF STATISTICS | 2008年 / 36卷 / 05期
关键词
Adaptivity; asymptotic equivalence; James-Stein estimator; moderate large deviation; nonparametric regression; quantile coupling; robust estimation; wavelets;
D O I
10.1214/07-AOS513
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we develop a nonparametric regression method that is simultaneously adaptive over a wide range of function classes for the regression function and robust over a large collection of error distributions, including those that are heavy-tailed, and may not even possess variances or means. Our approach is to first use local medians to turn the problem of nonparametric regression with unknown noise distribution into a standard Gaussian regression problem and then apply a wavelet block thresholding procedure to construct an estimator of the regression function. It is shown that the estimator simultaneously attains the optimal rate of convergence over a wide range of the Besov classes, without prior knowledge of the smoothness of the underlying functions or prior knowledge of the error distribution. The estimator also automatically adapts to the local smoothness of the underlying function, and attains the local adaptive minimax rate for estimating functions at a point. A key technical result in our development is a quantile coupling theorem which gives a tight bound for the quantile coupling between the sample medians and a normal variable. This median Coupling inequality may be of independent interest.
引用
收藏
页码:2055 / 2084
页数:30
相关论文
共 50 条
  • [41] Estimation of hedonic price functions via additive nonparametric regression
    Carlos Martins-Filho
    Okmyung Bin
    [J]. Empirical Economics, 2005, 30 : 93 - 114
  • [42] Nonparametric wavelet regression for binary response
    Antoniadis, A
    Leblanc, F
    [J]. STATISTICS, 2000, 34 (03) : 183 - 213
  • [43] Robust regression by boosting the median
    Kégl, B
    [J]. LEARNING THEORY AND KERNEL MACHINES, 2003, 2777 : 258 - 272
  • [44] Wavelet-based robust estimation and variable selection in nonparametric additive models
    Amato, Umberto
    Antoniadis, Anestis
    De Feis, Italia
    Gijbels, Irene
    [J]. STATISTICS AND COMPUTING, 2022, 32 (01)
  • [45] Wavelet-based robust estimation and variable selection in nonparametric additive models
    Umberto Amato
    Anestis Antoniadis
    Italia De Feis
    Irène Gijbels
    [J]. Statistics and Computing, 2022, 32
  • [46] ROBUST ESTIMATES IN MULTIVARIATE NONPARAMETRIC REGRESSION VIA LEAST ABSOLUTE  DEVIATIONS
    旋沛德
    郑忠国
    [J]. Acta Mathematica Scientia, 1996, (S1) : 57 - 69
  • [47] NONPARAMETRIC ESTIMATION OF REGRESSION FUNCTION
    SABRY, H
    [J]. COMPTES RENDUS HEBDOMADAIRES DES SEANCES DE L ACADEMIE DES SCIENCES SERIE A, 1978, 286 (20): : 941 - 944
  • [48] Robust adaptive efficient estimation for semi-Markov nonparametric regression models
    Barbu, Vlad Stefan
    Beltaief, Slim
    Pergamenshchikov, Sergey
    [J]. STATISTICAL INFERENCE FOR STOCHASTIC PROCESSES, 2019, 22 (02) : 187 - 231
  • [49] ON NONPARAMETRIC-ESTIMATION OF THE REGRESSION
    IBRAGIMOV, IA
    KHASMINSKII, RZ
    [J]. DOKLADY AKADEMII NAUK SSSR, 1980, 252 (04): : 780 - 784
  • [50] Nonparametric estimation in heteroskedastic regression
    Akritas, MG
    [J]. STATISTICS & PROBABILITY LETTERS, 1996, 28 (01) : 23 - 31