On optimum choice of k in nearest neighbor classification

被引：85

作者：

Ghosh, Anil K. ^{[1
]}

机构：

[1] Indian Stat Inst, Theoret Stat & Math Unit, Kolkata 700108, India

来源：

COMPUTATIONAL STATISTICS & DATA ANALYSIS | 2006年 / 50卷 / 11期

关键词：

accuracy index; Bayesian strength function; cross-validation; misclassification rate; neighborhood parameter; non-informative prior; optimal Bayes risk; posterior probability;

D O I：

10.1016/j.csda.2005.06.007

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

A major issue in k-nearest neighbor classification is how to choose the optimum value of the neighborhood parameter k. Popular cross-validation techniques often fail to guide us well in selecting k mainly due to the presence of multiple minimizers of the estimated misclassification rate. This article investigates a Bayesian method in this connection, which solves the problem of multiple optimizers. The utility of the proposed method is illustrated using some benchmark data sets. (C) 2005 Elsevier B.V. All rights reserved.

引用

页码：3113 / 3123

页数：11

共 50 条

[41] Soft nearest neighbor classification
Baram, Y
1997 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, 1997, : 1469 - 1473
[42] NEAREST NEIGHBOR PATTERN CLASSIFICATION
COVER, TM
HART, PE
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) : 21 - +
[43] The Extended Nearest Neighbor Classification
Zeng Yong
Wang Bing
Zhao Liang
Yang Yupu
PROCEEDINGS OF THE 27TH CHINESE CONTROL CONFERENCE, VOL 4, 2008, : 559 - +
[44] Nearest Neighbor Classification by Relearning
Ishii, Naohiro
Hoki, Yuta
Okada, Yuki
Bao, Yongguang
INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING, PROCEEDINGS, 2009, 5788 : 42 - 49
[45] p-adic distance and k-Nearest Neighbor classification
Kartal, Elif
Caliskan, Fatma
Eskisehirli, Beyaz Basak
Ozen, Zeki
NEUROCOMPUTING, 2024, 578
[46] Exclusive lasso-based k-nearest-neighbor classification
Lin Qiu
Yanpeng Qu
Changjing Shang
Longzhi Yang
Fei Chao
Qiang Shen
Neural Computing and Applications, 2021, 33 : 14247 - 14261
[47] Scalable Evidential K-Nearest Neighbor Classification on Big Data
Gong, Chaoyu
Demmel, Jim
You, Yang
IEEE TRANSACTIONS ON BIG DATA, 2024, 10 (03) : 226 - 237
[48] An Evidential K-Nearest Neighbor Classification Method with Weighted Attributes
Jiao, Lianmeng
Pan, Quan
Feng, Xiaoxue
Yang, Feng
2013 16TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2013, : 145 - 150
[49] SNAKEBITE CLASSIFICATION USING THE CHAIN CODE AND K NEAREST NEIGHBOR METHODS
Maharani, Tri
TOXICON, 2024, 248
[50] The k conditional nearest neighbor algorithm for classification and class probability estimation
Gweon, Hyukjun
Schonlau, Matthias
Steiner, Stefan H.
PEERJ COMPUTER SCIENCE, 2019, 2019 (05)

← 1 2 3 4 5 →