Distributions of the Kullback-Leibler divergence with applications

被引：66

作者：

Belov, Dmitry I. ^{[1
]}

Armstrong, Ronald D. ^{[2
]}

机构：

[1] Law Sch Admiss Council, Newtown, PA 18940 USA

[2] Rutgers State Univ, New Brunswick, NJ 08903 USA

来源：

BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY | 2011年 / 64卷 / 02期

关键词：

ITEM SELECTION; INFORMATION; MODEL; NORMALITY; POSTERIOR; ISSUES; TESTS;

D O I：

10.1348/000711010X522227

中图分类号：

O1 [数学];

学科分类号：

0701 ; 070101 ;

摘要：

The Kullback-Leibler divergence (KLD) is a widely used method for measuring the fit of two distributions. In general, the distribution of the KLD is unknown. Under reasonable assumptions, common in psychometrics, the distribution of the KLD is shown to be asymptotically distributed as a scaled (non-central) chi-square with one degree of freedom or a scaled (doubly non-central) F. Applications of the KLD for detecting heterogeneous response data are discussed with particular emphasis on test security.

引用

页码：291 / 309

页数：19

共 50 条

[1] Kullback-Leibler Divergence Estimation of Continuous Distributions
Perez-Cruz, Fernando
[J]. 2008 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS, VOLS 1-6, 2008, : 1666 - 1670
[2] Use of the Kullback-Leibler Divergence in Estimating Clutter Distributions
Ritchie, M. A.
Charlish, A.
Woodbridge, K.
Stove, A. G.
[J]. 2011 IEEE RADAR CONFERENCE (RADAR), 2011, : 751 - 756
[3] Assessing Similarity of Rating Distributions by Kullback-Leibler Divergence
Corduas, Marcella
[J]. CLASSIFICATION AND MULTIVARIATE ANALYSIS FOR COMPLEX DATA STRUCTURES, 2011, : 221 - 228
[4] The Kullback-Leibler Divergence Between Lattice Gaussian Distributions
Nielsen, Frank
[J]. JOURNAL OF THE INDIAN INSTITUTE OF SCIENCE, 2022, 102 (04) : 1177 - 1188
[5] Renyi Divergence and Kullback-Leibler Divergence
van Erven, Tim
Harremoes, Peter
[J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
[6] The fractional Kullback-Leibler divergence
Alexopoulos, A.
[J]. JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2021, 54 (07)
[7] BOUNDS FOR KULLBACK-LEIBLER DIVERGENCE
Popescu, Pantelimon G.
Dragomir, Sever S.
Slusanschi, Emil I.
Stanasila, Octavian N.
[J]. ELECTRONIC JOURNAL OF DIFFERENTIAL EQUATIONS, 2016,
[8] On the Interventional Kullback-Leibler Divergence
Wildberger, Jonas
Guo, Siyuan
Bhattacharyya, Arnab
Schoelkopf, Bernhard
[J]. CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 328 - 349
[9] Kullback-Leibler Divergence Revisited
Raiber, Fiana
Kurland, Oren
[J]. ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 117 - 124
[10] Kullback-Leibler Divergence Between Multivariate Generalized Gaussian Distributions
Bouhlel, Nizar
Dziri, Ali
[J]. IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (07) : 1021 - 1025

← 1 2 3 4 5 →