The bias and skewness of M-estimators in regression

被引:5
|
作者
Withers, Christopher [1 ]
Nadarajah, Saralees [2 ]
机构
[1] Ind Res Ltd, Appl Math Grp, Lower Hutt, New Zealand
[2] Univ Manchester, Sch Math, Manchester, Lancs, England
来源
关键词
Bias reduction; M-estimates; non-linear; regression; robust; skewness; LEAST-SQUARES ESTIMATORS; QUANTILES;
D O I
10.1214/09-EJS447
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider 211 estimation of a regression model with a nuisance parameter and a vector of other parameters. The unknown distribution of the residuals is not assumed to be normal or symmetric. Simple and easily estimated formulas are given for the dominant terms of the bias and skewness of the parameter estimates. For the linear model these are proportional to the skewness of the 'independent' variables. For a nonlinear model, its linear component plays the role of these independent variables, and a second term must be added proportional to the covariance of its linear and quadratic components. For the least squares estimate with normal errors this term was derived by Box [1]. We also consider the effect of a large number of parameters, and the case of random independent variables.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] M-estimators for isotonic regression
    Alvarez, Enrique E.
    Yohai, Victor J.
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2012, 142 (08) : 2351 - 2368
  • [2] Asymptotic distribution of regression M-estimators
    Arcones, MA
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2001, 97 (02) : 235 - 261
  • [3] Regression clustering with redescending M-estimators
    Garlipp, T
    Müller, CH
    INNOVATIONS IN CLASSIFICATION, DATA SCIENCE, AND INFORMATION SYSTEMS, 2005, : 38 - 45
  • [4] M-Estimators for Regression with Changing Scale
    Withers, Christopher S.
    Nadarajah, Saralees
    SANKHYA-SERIES B-APPLIED AND INTERDISCIPLINARY STATISTICS, 2016, 78 : 238 - 286
  • [5] THE BIAS OF K-STEP M-ESTIMATORS
    ROUSSEEUW, PJ
    CROUX, C
    STATISTICS & PROBABILITY LETTERS, 1994, 20 (05) : 411 - 420
  • [6] M-ESTIMATORS AND GNOSTICAL ESTIMATORS FOR IDENTIFICATION OF A REGRESSION-MODEL
    NOVOVICOVA, J
    AUTOMATICA, 1990, 26 (03) : 607 - 610
  • [7] ROBUST REGRESSION TREES BASED ON M-ESTIMATORS
    Galimberti, G.
    Pillati, M.
    Soffritti, G.
    STATISTICA, 2007, 67 (02) : 173 - 190
  • [8] Regression M-estimators with doubly censored data
    Ren, JJ
    Gu, MG
    ANNALS OF STATISTICS, 1997, 25 (06): : 2638 - 2664
  • [9] A review on robust M-estimators for regression analysis
    de Menezes, D. Q. F.
    Prata, D. M.
    Secchi, A. R.
    Pinto, J. C.
    COMPUTERS & CHEMICAL ENGINEERING, 2021, 147 (147)
  • [10] Robust regression with projection based M-estimators
    Chen, HF
    Meer, P
    NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, 2003, : 878 - 885