Conformal transformation of the metric for k-nearest neighbors classification

被引:0
|
作者
Popescu, Marius Claudiu [1 ]
Grama, Lacrimioara [1 ]
Rusu, Corneliu [1 ]
机构
[1] Tech Univ Cluj Napoca, Fac Elect Telecommun & Informat Technol, Signal Proc Grp, Cluj Napoca, Romania
关键词
k-nearest neighbors; Riemannian metric learning; nonparametric classification;
D O I
10.1109/iccp51029.2020.9266240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper introduces a new method for improving the nearest neighbors classifier. Our approach is based on the idea of replacing the constant metric with a variable and conformally equivalent one that is data dependent, and therefore it is more informative. We define a family of conformal transformations that, under some assumptions, induces distance functions that are efficiently computable. Using the intuition that the distances between points near a class boundary should be larger, a simple method for selecting a transformation is proposed. We perform experiments on two datasets. The first set of experiments are with a sentiment prediction dataset, and in this case our method offers some improvements over the standard k-NN algorithm. In the second empirical analysis, we apply the method to a news categorisation problem. In this case the results are mixed. We conclude with a discussion of the advantages and weaknesses of the method, and propose a number of possible improvements.
引用
收藏
页码:229 / 234
页数:6
相关论文
共 50 条
  • [31] Accuracy and Specificity Trade-off in k-nearest Neighbors Classification
    Herranz, Luis
    Jiang, Shuqiang
    COMPUTER VISION - ACCV 2014, PT II, 2015, 9004 : 133 - 146
  • [32] Diagnosis of Melanocytic Lesions using the K-Nearest Neighbors classification technique
    Vazquez Noguera, Jose Luis
    Pinto-Roa, Diego P.
    Franco, Alba
    Martinez, Leticia
    Nunez, Carlos
    2022 17TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2022,
  • [33] Adaptive Global k-Nearest Neighbors for Hierarchical Classification of Data Streams
    Tieppo, Eduardo
    Barddal, Jean Paul
    Nievola, Julio Cesar
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 631 - 636
  • [34] Weighted K-nearest neighbors classification based on Whale optimization algorithm
    Anvari, S.
    Azgomi, M. Abdollahi
    Dishabi, M. R. Ebrahimi
    Maheri, M.
    IRANIAN JOURNAL OF FUZZY SYSTEMS, 2023, 20 (03): : 61 - 74
  • [35] Quantum K-nearest neighbors classification algorithm based on Mahalanobis distance
    Gao, Li-Zhen
    Lu, Chun-Yue
    Guo, Gong-De
    Zhang, Xin
    Lin, Song
    FRONTIERS IN PHYSICS, 2022, 10
  • [36] Particles Contaminations Detection during Plasma Etching Process by using k-Nearest Neighbors and Fuzzy k-Nearest Neighbors
    Somari, Noratika Mohammad
    Abdullah, Mohd Firdaus
    Osman, Muhammad Khusairi
    Nazelan, Abdul Mu'iz
    Ahmad, Khairul Azman
    Appanan, Sooria Pragash Rao S.
    Hooi, Loh Kwang
    2016 6TH IEEE INTERNATIONAL CONFERENCE ON CONTROL SYSTEM, COMPUTING AND ENGINEERING (ICCSCE), 2016, : 512 - 516
  • [37] Introduction to machine learning: k-nearest neighbors
    Zhang, Zhongheng
    ANNALS OF TRANSLATIONAL MEDICINE, 2016, 4 (11)
  • [38] Distributionally Robust Weighted k-Nearest Neighbors
    Zhu, Shixiang
    Xie, Liyan
    Zhang, Minghe
    Gao, Rui
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [39] Enhancing k-Nearest Neighbors through Learning Transformation Functions by Genetic Programming
    Huang, Kuan-Chun
    Wen, Yu-Wei
    Ting, Chuan-Kang
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 1891 - 1897
  • [40] I-VECTOR TRANSFORMATION USING K-NEAREST NEIGHBORS FOR SPEAKER VERIFICATION
    Khan, Umair
    India, Miquel
    Hernando, Javier
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 7574 - 7578