The bias and skewness of M-estimators in regression

被引:5
|
作者
Withers, Christopher [1 ]
Nadarajah, Saralees [2 ]
机构
[1] Ind Res Ltd, Appl Math Grp, Lower Hutt, New Zealand
[2] Univ Manchester, Sch Math, Manchester, Lancs, England
来源
关键词
Bias reduction; M-estimates; non-linear; regression; robust; skewness; LEAST-SQUARES ESTIMATORS; QUANTILES;
D O I
10.1214/09-EJS447
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We consider 211 estimation of a regression model with a nuisance parameter and a vector of other parameters. The unknown distribution of the residuals is not assumed to be normal or symmetric. Simple and easily estimated formulas are given for the dominant terms of the bias and skewness of the parameter estimates. For the linear model these are proportional to the skewness of the 'independent' variables. For a nonlinear model, its linear component plays the role of these independent variables, and a second term must be added proportional to the covariance of its linear and quadratic components. For the least squares estimate with normal errors this term was derived by Box [1]. We also consider the effect of a large number of parameters, and the case of random independent variables.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] ON BOOTSTRAPPING M-ESTIMATORS
    LAHIRI, SN
    SANKHYA-THE INDIAN JOURNAL OF STATISTICS SERIES A, 1992, 54 : 157 - 170
  • [22] ON B-SPLINE M-ESTIMATORS IN A SEMIPARAMETRIC REGRESSION MODEL
    SHI Peide (Department of Probability and Statistics
    Journal of Systems Science & Complexity, 1994, (03) : 270 - 281
  • [23] INCONSISTENT M-ESTIMATORS - NONLINEAR-REGRESSION WITH MULTIPLICATIVE ERROR
    BHATTACHARYYA, BB
    KHOSHGOFTAAR, TM
    RICHARDSON, GD
    STATISTICS & PROBABILITY LETTERS, 1992, 14 (05) : 407 - 411
  • [24] Characterizing M-estimators
    Dimitriadis, Timo
    Fissler, Tobias
    Ziegel, Johanna
    BIOMETRIKA, 2024, 111 (01) : 339 - 346
  • [25] ON INCONSISTENT M-ESTIMATORS
    FREEDMAN, DA
    DIACONIS, P
    ANNALS OF STATISTICS, 1982, 10 (02): : 454 - 461
  • [26] M-ESTIMATORS AND GNOSTICAL ESTIMATORS OF LOCATION
    NOVOVICOVA, J
    PROBLEMS OF CONTROL AND INFORMATION THEORY-PROBLEMY UPRAVLENIYA I TEORII INFORMATSII, 1989, 18 (06): : 397 - 407
  • [27] Robust M-estimators of scale:: Minimax bias versus maximal variance
    Collins, JR
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1999, 27 (01): : 81 - 96
  • [28] Limiting behavior of recursive M-estimators in multivariate linear regression models
    Miao, BQ
    Wu, Y
    JOURNAL OF MULTIVARIATE ANALYSIS, 1996, 59 (01) : 60 - 80
  • [29] Asymptotics of M-estimators in two-phase linear regression models
    Koul, HL
    Qian, LF
    Surgailis, D
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2003, 103 (01) : 123 - 154
  • [30] A NEW SCALE STEP FOR HUBER M-ESTIMATORS IN MULTIPLE-REGRESSION
    RIVEST, LP
    SIAM JOURNAL ON SCIENTIFIC AND STATISTICAL COMPUTING, 1988, 9 (01): : 164 - 169