Efficiency of nearest neighbor entropy estimators for Bernoulli measures

被引：0

作者：

Timofeev, Evgeniy A. ^{[2
]}

Kaltchenko, Alexei ^{[1
]}

机构：

[1] Wilfrid Laurier Univ, Dept Phys & Comp, Waterloo, ON N2L 3C5, Canada

[2] Yaroslavl State Univ, Dept Theoret Informat, Yaroslavl, Russia

来源：

INDEPENDENT COMPONENT ANALYSES, COMPRESSIVE SAMPLING, WAVELETS, NEURAL NET, BIOSYSTEMS, AND NANOENGINEERING XII | 2014年 / 9118卷

关键词：

Metric; entropy; estimation; nonparametric; nearest neighbor; bias;

D O I：

10.1117/12.2049574

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

A problem of nonparametric entropy estimation for discrete stationary ergodic processes is considered. The estimation is based on so-called "nearest-neighbor method". It is shown that, for Bernoulli measures, the estimator is unbiased, i.e. converges to the (inverse) entropy of the process. Moreover, for symmetric Bernoulli measures, the unbiased estimator can be explicitly constructed.

引用

页数：5

共 50 条

[31] Strong Uniform Consistency of k-Nearest Neighbor Regression Function Estimators
秦更生
成平
Science China Mathematics, 1994, (09) : 1032 - 1040
[32] ASYMPTOTIC CONFIDENCE BANDS FOR DENSITIES BASED ON NEAREST NEIGHBOR ESTIMATORS UNDER CENSORING
MIELNICZUK, J
STATISTICS & PROBABILITY LETTERS, 1987, 5 (02) : 125 - 128
[33] STRONG UNIFORM CONSISTENCY OF K-NEAREST NEIGHBOR REGRESSION FUNCTION ESTIMATORS
QIN, GS
CHENG, P
SCIENCE IN CHINA SERIES A-MATHEMATICS PHYSICS ASTRONOMY, 1994, 37 (09): : 1032 - 1040
[34] Strong Uniform Consistency of k-Nearest Neighbor Regression Function Estimators
秦更生
成平
ScienceinChina,SerA., 1994, Ser.A.1994 (09) : 1032 - 1040
[35] Strong uniform consistency of k-nearest neighbor regression function estimators
Qin, Geng-Sheng
Cheng, Ping
Science in China Series A: Mathematics, Physics, Astronomy and Technological Sciences, 1994, 37 (09):
[36] The role of local dimensionality measures in benchmarking nearest neighbor search
Aumuller, Martin
Ceccarello, Matteo
INFORMATION SYSTEMS, 2021, 101
[37] QUASI-REVERSIBLE MEASURES OF NEAREST NEIGHBOR SPEED FUNCTIONS
DING, WD
CHEN, MF
CHINESE ANNALS OF MATHEMATICS SERIES B, 1981, 2 (01): : 47 - 59
[38] Asymptotic Form of the Bias of Entropy Estimator for Bernoulli Measures
Timofeev, E. A.
AUTOMATIC CONTROL AND COMPUTER SCIENCES, 2010, 44 (07) : 467 - 475
[39] Geometric k-nearest neighbor estimation of entropy and mutual information
Lord, Warren M.
Sun, Jie
Bollt, Erik M.
CHAOS, 2018, 28 (03)
[40] Fast nearest neighbor search of entropy-constrained vector quantization
Johnson, MH
Ladner, RE
Riskin, EA
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (08) : 1435 - 1437

← 1 2 3 4 5 →