Efficiency of nearest neighbor entropy estimators for Bernoulli measures

被引：0

作者：

Timofeev, Evgeniy A. ^{[2
]}

Kaltchenko, Alexei ^{[1
]}

机构：

[1] Wilfrid Laurier Univ, Dept Phys & Comp, Waterloo, ON N2L 3C5, Canada

[2] Yaroslavl State Univ, Dept Theoret Informat, Yaroslavl, Russia

来源：

INDEPENDENT COMPONENT ANALYSES, COMPRESSIVE SAMPLING, WAVELETS, NEURAL NET, BIOSYSTEMS, AND NANOENGINEERING XII | 2014年 / 9118卷

关键词：

Metric; entropy; estimation; nonparametric; nearest neighbor; bias;

D O I：

10.1117/12.2049574

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

A problem of nonparametric entropy estimation for discrete stationary ergodic processes is considered. The estimation is based on so-called "nearest-neighbor method". It is shown that, for Bernoulli measures, the estimator is unbiased, i.e. converges to the (inverse) entropy of the process. Moreover, for symmetric Bernoulli measures, the unbiased estimator can be explicitly constructed.

引用

页数：5

共 50 条

[41] A Classification Method based on Local Information and Nearest Neighbor Entropy Estimation
Lazic, Ivan
Mijatovic, Gorana
Iovino, Marta
Loncar-Turukalo, Tatjana
Faes, Luca
2024 IEEE 22ND MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, MELECON 2024, 2024, : 311 - 316
[42] The nearest neighbor
Alt, H
COMPUTATIONAL DISCRETE MATHEMATICS: ADVANCED LECTURES, 2001, 2122 : 13 - 24
[43] On the nearest neighbor of the nearest neighbor in multidimensional continuous and quantized space
Rovatti, Riccardo
Mazzini, Gianluca
IEEE TRANSACTIONS ON INFORMATION THEORY, 2008, 54 (09) : 4069 - 4080
[44] IMPROVING K-NEAREST NEIGHBOR EFFICIENCY FOR TEXT CATEGORIZATION
Barigou, F.
NEURAL NETWORK WORLD, 2016, 26 (01) : 45 - 65
[45] Nearest neighbor and reverse nearest neighbor queries for moving objects
Benetis, R
Jensen, CS
Karciauskas, G
Saltenis, S
IDEAS 2002: INTERNATIONAL DATABASE ENGINEERING AND APPLICATIONS SYMPOSIUM, PROCEEDINGS, 2002, : 44 - 53
[46] A novel version of k nearest neighbor: Dependent nearest neighbor
Ertugrul, Omer Faruk
Tagluk, Mehmet Emin
APPLIED SOFT COMPUTING, 2017, 55 : 480 - 490
[47] Efficient nearest neighbor classification using a cascade of approximate similarity measures
Athitsos, V
Alon, J
Sclaroff, S
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, : 486 - 493
[48] Fluctuation bounds for entropy production estimators in Gibbs measures
Maldonado, Cesar
JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2015, 48 (04)
[49] HETEROGENEOUS DISTANCE MEASURES AND NEAREST-NEIGHBOR CLASSIFICATION IN AN ECOLOGICAL SETTING
Spencer, Matthew S.
Prins, Samantha C. Bates
Beckom, Margaret S.
MISSOURI JOURNAL OF MATHEMATICAL SCIENCES, 2010, 22 (02) : 108 - 123
[50] Fast nearest neighbor search for ECVQ and other modified distortion measures
Johnson, MH
Ladner, R
Riskin, EA
INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, 1996, : 423 - 426

← 1 2 3 4 5 →