Conformal transformation of the metric for k-nearest neighbors classification

被引:0
|
作者
Popescu, Marius Claudiu [1 ]
Grama, Lacrimioara [1 ]
Rusu, Corneliu [1 ]
机构
[1] Tech Univ Cluj Napoca, Fac Elect Telecommun & Informat Technol, Signal Proc Grp, Cluj Napoca, Romania
关键词
k-nearest neighbors; Riemannian metric learning; nonparametric classification;
D O I
10.1109/iccp51029.2020.9266240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper introduces a new method for improving the nearest neighbors classifier. Our approach is based on the idea of replacing the constant metric with a variable and conformally equivalent one that is data dependent, and therefore it is more informative. We define a family of conformal transformations that, under some assumptions, induces distance functions that are efficiently computable. Using the intuition that the distances between points near a class boundary should be larger, a simple method for selecting a transformation is proposed. We perform experiments on two datasets. The first set of experiments are with a sentiment prediction dataset, and in this case our method offers some improvements over the standard k-NN algorithm. In the second empirical analysis, we apply the method to a news categorisation problem. In this case the results are mixed. We conclude with a discussion of the advantages and weaknesses of the method, and propose a number of possible improvements.
引用
收藏
页码:229 / 234
页数:6
相关论文
共 50 条
  • [41] The research on an adaptive k-nearest neighbors classifier
    Yu, Xiao-Gao
    Yu, Xiao-Peng
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 1241 - 1246
  • [42] Random kernel k-nearest neighbors regression
    Srisuradetchai, Patchanok
    Suksrikran, Korn
    FRONTIERS IN BIG DATA, 2024, 7
  • [43] Ensemble Learning with Extremely Randomized k-Nearest Neighbors for Accurate and Efficient Classification
    Saber, Abid
    Abbas, Moncef
    Fergani, Belkacem
    NEW GENERATION COMPUTING, 2025, 43 (01)
  • [44] PATCH CONFIDENCE K-NEAREST NEIGHBORS DENOISING
    Angelino, Cesario V.
    Debreuve, Eric
    Barlaud, Michel
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 1129 - 1132
  • [45] A NEW FUZZY K-NEAREST NEIGHBORS ALGORITHM
    Li, Chengjie
    Pei, Zheng
    Li, Bo
    Zhang, Zhen
    INTELLIGENT DECISION MAKING SYSTEMS, VOL. 2, 2010, : 246 - +
  • [46] Hypersphere anchor loss for K-Nearest neighbors
    Xiang Ye
    Zihang He
    Heng Wang
    Yong Li
    Applied Intelligence, 2023, 53 : 30319 - 30328
  • [47] A FUZZY EXTENDED K-NEAREST NEIGHBORS RULE
    BEREAU, M
    DUBUISSON, B
    FUZZY SETS AND SYSTEMS, 1991, 44 (01) : 17 - 32
  • [48] A k-Nearest Neighbors Approach for COCOMO Calibration
    Le, Phu
    Vu Nguyen
    2017 4TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS), 2017, : 219 - 224
  • [49] Maximizing Reverse k-Nearest Neighbors for Trajectories
    Al Rahat, Tamjid
    Arman, Arif
    Ali, Mohammed Eunus
    DATABASES THEORY AND APPLICATIONS, ADC 2018, 2018, 10837 : 262 - 274
  • [50] The research on an adaptive k-nearest neighbors classifier
    Yu, Xiaopeng
    Yu, Xiaogao
    PROCEEDINGS OF THE FIFTH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS, VOLS 1 AND 2, 2006, : 535 - 540