Estimation of kullback-leibler divergence by local likelihood

被引:24
|
作者
Lee, Young Kyung [1 ]
Park, Byeong U. [1 ]
机构
[1] Seoul Natl Univ, Dept Stat, Seoul 151747, South Korea
关键词
kernel smoothing; local likelihood density estimation; bandwidth; Kullback-Leibler divergence;
D O I
10.1007/s10463-005-0014-8
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Motivated from the bandwidth selection problem in local likelihood density estimation and from the problem of assessing a final model chosen by a certain model selection procedure, we consider estimation of the Kullback-Leibler divergence. It is known that the best bandwidth choice for the local likelihood density estimator depends on the distance between the true density and the 'vehicle' parametric model. Also, the Kullback-Leibler divergence may be a useful measure based on which one judges how far the true density is away from a parametric family. We propose two estimators of the Kullback-Leibler divergence. We derive their asymptotic distributions and compare finite sample properties.
引用
收藏
页码:327 / 340
页数:14
相关论文
共 50 条
  • [21] A decision cognizant Kullback-Leibler divergence
    Ponti, Moacir
    Kittler, Josef
    Riva, Mateus
    de Campos, Teofilo
    Zor, Cemre
    [J]. PATTERN RECOGNITION, 2017, 61 : 470 - 478
  • [22] The Kullback-Leibler divergence and nonnegative matrices
    Boche, Holger
    Stanczak, Slawomir
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) : 5539 - 5545
  • [23] AN INVOLUTION INEQUALITY FOR THE KULLBACK-LEIBLER DIVERGENCE
    Pinelis, Iosif
    [J]. MATHEMATICAL INEQUALITIES & APPLICATIONS, 2017, 20 (01): : 233 - 235
  • [24] Distributions of the Kullback-Leibler divergence with applications
    Belov, Dmitry I.
    Armstrong, Ronald D.
    [J]. BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2011, 64 (02): : 291 - 309
  • [25] Model Fusion with Kullback-Leibler Divergence
    Claici, Sebastian
    Yurochkin, Mikhail
    Ghosh, Soumya
    Solomon, Justin
    [J]. 25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [26] Estimation of the Weibull parameters by Kullback-Leibler divergence of Survival functions
    Yari, Gholamhossein
    Mirhabibi, Alireza
    Saghafi, Abolfazl
    [J]. APPLIED MATHEMATICS & INFORMATION SCIENCES, 2013, 7 (01): : 187 - 192
  • [27] Significance estimation for the Kullback-Leibler divergence: the Poissonian case in seismological studies
    Nava, F. A.
    [J]. GEOFISICA INTERNACIONAL, 2023, 62 (03): : 519 - 523
  • [28] A generalization of the Kullback-Leibler divergence and its properties
    Yamano, Takuya
    [J]. JOURNAL OF MATHEMATICAL PHYSICS, 2009, 50 (04)
  • [29] Computation of Kullback-Leibler Divergence in Bayesian Networks
    Moral, Serafin
    Cano, Andres
    Gomez-Olmedo, Manuel
    [J]. ENTROPY, 2021, 23 (09)
  • [30] PREFERRED POINT GEOMETRY AND THE LOCAL DIFFERENTIAL GEOMETRY OF THE KULLBACK-LEIBLER DIVERGENCE
    CRITCHLEY, F
    MARRIOTT, P
    SALMON, M
    [J]. ANNALS OF STATISTICS, 1994, 22 (03): : 1587 - 1602