M-estimation using penalties or sieves

被引:13
|
作者
van de Geer, S [1 ]
机构
[1] Leiden Univ, Inst Math, NL-2300 RA Leiden, Netherlands
关键词
convexity; empirical process; M-estimator; penalty; rate of convergence; sieve;
D O I
10.1016/S0378-3758(02)00270-7
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present rates of convergence for (penalized or sieved) M-estimators of a parameter in a normed vector space, using a loss function that is convex in the parameter. We show how the convexity can be used to 'localize' the problem, i.e., to confine considerations to a small neighborhood in parameter space. The results are then along the lines as those for the least squares problem: rates follow from entropy calculations (on that small neighborhood). As detailed example, we consider the estimation of a log-density. (C) 2002 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:55 / 69
页数:15
相关论文
共 50 条
  • [1] RESTRICTED M-ESTIMATION
    NYQUIST, H
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1992, 14 (04) : 499 - 507
  • [2] Sequential M-estimation
    Pham, DS
    Leung, YH
    Zoubir, A
    Brcic, R
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL II, PROCEEDINGS: SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING SIGNAL PROCESSING THEORY AND METHODS, 2004, : 697 - 700
  • [3] General M-estimation
    Bai, ZD
    Wu, Y
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 1997, 63 (01) : 119 - 135
  • [4] The calculus of M-estimation
    Stefanski, LA
    Boos, DD
    [J]. AMERICAN STATISTICIAN, 2002, 56 (01): : 29 - 38
  • [5] M-estimation using unbiased median variance estimate
    Yang, Ling
    Shen, Yunzhong
    Li, Bofeng
    [J]. JOURNAL OF GEODESY, 2019, 93 (06) : 911 - 925
  • [6] Robustizing robust M-estimation using deterministic annealing
    Li, SZ
    [J]. PATTERN RECOGNITION, 1996, 29 (01) : 159 - 166
  • [7] M-estimation using unbiased median variance estimate
    Ling Yang
    Yunzhong Shen
    Bofeng Li
    [J]. Journal of Geodesy, 2019, 93 : 911 - 925
  • [8] Robust Regression Using Data Partitioning and M-Estimation
    Park, Yousung
    Kim, Daeyoung
    Kim, Seongyong
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2012, 41 (08) : 1282 - 1300
  • [9] Sample heterogeneity and M-estimation
    Hallin, M
    Mizera, I
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2001, 93 (1-2) : 139 - 160
  • [10] ON M-PROCESSES AND M-ESTIMATION
    WELSH, AH
    [J]. ANNALS OF STATISTICS, 1989, 17 (01): : 337 - 361