Efficiency of nearest neighbor entropy estimators for Bernoulli measures

被引：0

作者：

Timofeev, Evgeniy A. ^{[2
]}

Kaltchenko, Alexei ^{[1
]}

机构：

[1] Wilfrid Laurier Univ, Dept Phys & Comp, Waterloo, ON N2L 3C5, Canada

[2] Yaroslavl State Univ, Dept Theoret Informat, Yaroslavl, Russia

来源：

INDEPENDENT COMPONENT ANALYSES, COMPRESSIVE SAMPLING, WAVELETS, NEURAL NET, BIOSYSTEMS, AND NANOENGINEERING XII | 2014年 / 9118卷

关键词：

Metric; entropy; estimation; nonparametric; nearest neighbor; bias;

D O I：

10.1117/12.2049574

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

A problem of nonparametric entropy estimation for discrete stationary ergodic processes is considered. The estimation is based on so-called "nearest-neighbor method". It is shown that, for Bernoulli measures, the estimator is unbiased, i.e. converges to the (inverse) entropy of the process. Moreover, for symmetric Bernoulli measures, the unbiased estimator can be explicitly constructed.

引用

页数：5

共 50 条

[1] EFFICIENCY OF NEAREST NEIGHBOR ESTIMATORS
HOLGATE, P
BIOMETRICS, 1964, 20 (03) : 647 - &
[2] Selection of a Metric for the Nearest Neighbor Entropy Estimators
Timofeev E.
Journal of Mathematical Sciences, 2014, 203 (6) : 892 - 906
[3] NEAREST-NEIGHBOR ENTROPY ESTIMATORS WITH WEAK METRICS
Timofeev, Evgeniy
Kaltchenko, Alexei
ADVANCES IN MATHEMATICS OF COMMUNICATIONS, 2014, 8 (02) : 119 - 127
[4] K n-nearest neighbor estimators of entropy
Mnatsakanov R.M.
Misra N.
Li S.
Harner E.J.
Mathematical Methods of Statistics, 2008, 17 (3) : 261 - 277
[5] Nearest neighbor estimates of entropy
Singh, Harshinder
Misra, Neeraj
Hnizdo, Vladimir
Fedorowicz, Adam
Demchuk, Eugene
American Journal of Mathematical and Management Sciences, 2003, 23 (3-4) : 301 - 321
[6] NEAREST NEIGHBOR ESTIMATORS FOR RANDOM-FIELDS
TRAN, LT
YAKOWITZ, S
JOURNAL OF MULTIVARIATE ANALYSIS, 1993, 44 (01) : 23 - 46
[7] Nearest neighbor estimates of Kaniadakis entropy
Danila-Cernat, Ioana
ANALELE STIINTIFICE ALE UNIVERSITATII OVIDIUS CONSTANTA-SERIA MATEMATICA, 2022, 30 (01): : 171 - 189
[8] Relative performance of the grid, nearest neighbor, and OLS estimators
Pace, RK
JOURNAL OF REAL ESTATE FINANCE AND ECONOMICS, 1996, 13 (03): : 203 - 218
[9] STRONG CONSISTENCY OF NEAREST NEIGHBOR REGRESSION FUNCTION ESTIMATORS
CHENG, PE
JOURNAL OF MULTIVARIATE ANALYSIS, 1984, 15 (01) : 63 - 72
[10] BIAS REDUCTION OF THE NEAREST NEIGHBOR ENTROPY ESTIMATOR
Kaltchenko, Alexei
Timofeeva, Nina
Timofeev, Eugeniy A.
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2008, 18 (12): : 3781 - 3787

← 1 2 3 4 5 →