Validation of k-Nearest Neighbor Classifiers

被引：11
|
作者：
Bax, Eric [1 ]
机构：
[1] Yahoo, Pasadena, CA 91116 USA
来源：
IEEE TRANSACTIONS ON INFORMATION THEORY | 2012年 / 58卷 / 05期
关键词：
Learning systems; machine learning; nearest neighbor; statistical learning; supervised learning; CLASSIFICATION; APPROXIMATE;
D O I：
10.1109/TIT.2011.2180887
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
This paper presents a method to compute probably approximately correct error bounds for k-nearest neighbor classifiers. The method withholds some training data as a validation set to bound the error rate of the holdout classifier that is based on the remaining training data. Then, the method uses the validation set to bound the difference in error rates between the holdout classifier and the classifier based on all training data. The result is a bound on the out-of-sample error rate for the classifier based on all training data.
引用
收藏
页码：3225 / 3234
页数：10
相关论文
共 50 条
  • [31] Predicting subcellular locations of eukaryotic proteins using Bayesian and k-nearest neighbor classifiers
    Hsiao, Han C. W.
    Chen, Shih-Hao
    Chang, Judson Pei-Chun
    Tsai, Jeffrey J. P.
    [J]. JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2008, 24 (05) : 1361 - 1375
  • [32] Comparison of Fuzzy Diagnosis with K-Nearest Neighbor and Naive Bayes Classifiers in Disease Diagnosis
    Mahdi, Asaad
    Razali, Ahmad
    AlWakil, Ali
    [J]. BRAIN-BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE, 2011, 2 (02): : 58 - 66
  • [33] Predicting subcellular locations of eukaryotic proteins using bayesian and k-nearest neighbor classifiers
    Department of Bioinformatics, Asia University, Wufeng, 413, Taiwan
    不详
    [J]. J. Inf. Sci. Eng., 2008, 5 (1361-1375):
  • [34] An analysis on two different data sets by using ensemble of k-nearest neighbor classifiers
    Ramli, Nor Azuana
    Ismail, Mohd Tahir
    Wooi, Hooy Chee
    [J]. WSEAS Transactions on Mathematics, 2014, 13 : 780 - 789
  • [35] Approximate direct and reverse nearest neighbor queries, and the k-nearest neighbor graph
    Figueroa, Karina
    Paredes, Rodrigo
    [J]. SISAP 2009: 2009 SECOND INTERNATIONAL WORKSHOP ON SIMILARITY SEARCH AND APPLICATIONS, PROCEEDINGS, 2009, : 91 - +
  • [36] Evidential Editing K-Nearest Neighbor Classifier
    Jiao, Lianmeng
    Denoeux, Thierry
    Pan, Quan
    [J]. SYMBOLIC AND QUANTITATIVE APPROACHES TO REASONING WITH UNCERTAINTY, ECSQARU 2015, 2015, 9161 : 461 - 471
  • [37] K-nearest neighbor finding using MaxNearestDist
    Samet, Hanan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (02) : 243 - 252
  • [38] ISOLATED HANDWRITTEN ARABIC NUMERALS RECOGNITION USING THE K-NEAREST NEIGHBOR AND THE HIDDEN MARKOVMODEL CLASSIFIERS
    El Kessab, Badre-eddine
    Daoui, Cherki
    Bouikhalene, Belaid
    Salouan, Rachid
    [J]. FACTA UNIVERSITATIS-SERIES MATHEMATICS AND INFORMATICS, 2015, 30 (05): : 731 - 740
  • [39] Text Categorization with K-Nearest Neighbor Approach
    Manne, Suneetha
    Kotha, Sita Kumari
    Fatima, S. Sameen
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS DESIGN AND INTELLIGENT APPLICATIONS 2012 (INDIA 2012), 2012, 132 : 413 - +
  • [40] Joint Evidential K-Nearest Neighbor Classification
    Gong, Chaoyu
    Li, Yongbin
    Liu, Yong
    Wang, Pei-hong
    You, Yang
    [J]. 2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 2113 - 2126
12345