Conformal transformation of the metric for k-nearest neighbors classification

被引:0
|
作者
Popescu, Marius Claudiu [1 ]
Grama, Lacrimioara [1 ]
Rusu, Corneliu [1 ]
机构
[1] Tech Univ Cluj Napoca, Fac Elect Telecommun & Informat Technol, Signal Proc Grp, Cluj Napoca, Romania
关键词
k-nearest neighbors; Riemannian metric learning; nonparametric classification;
D O I
10.1109/iccp51029.2020.9266240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper introduces a new method for improving the nearest neighbors classifier. Our approach is based on the idea of replacing the constant metric with a variable and conformally equivalent one that is data dependent, and therefore it is more informative. We define a family of conformal transformations that, under some assumptions, induces distance functions that are efficiently computable. Using the intuition that the distances between points near a class boundary should be larger, a simple method for selecting a transformation is proposed. We perform experiments on two datasets. The first set of experiments are with a sentiment prediction dataset, and in this case our method offers some improvements over the standard k-NN algorithm. In the second empirical analysis, we apply the method to a news categorisation problem. In this case the results are mixed. We conclude with a discussion of the advantages and weaknesses of the method, and propose a number of possible improvements.
引用
收藏
页码:229 / 234
页数:6
相关论文
共 50 条
  • [1] Classification with learning k-nearest neighbors
    Laaksonen, J
    Oja, E
    ICNN - 1996 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS. 1-4, 1996, : 1480 - 1483
  • [2] Quantum Algorithm for K-Nearest Neighbors Classification Based on the Metric of Hamming Distance
    Yue Ruan
    Xiling Xue
    Heng Liu
    Jianing Tan
    Xi Li
    International Journal of Theoretical Physics, 2017, 56 : 3496 - 3507
  • [3] Quantum Algorithm for K-Nearest Neighbors Classification Based on the Metric of Hamming Distance
    Ruan, Yue
    Xue, Xiling
    Liu, Heng
    Tan, Jianing
    Li, Xi
    INTERNATIONAL JOURNAL OF THEORETICAL PHYSICS, 2017, 56 (11) : 3496 - 3507
  • [4] AutoML for Stream k-Nearest Neighbors Classification
    Bahri, Maroua
    Veloso, Bruno
    Bifet, Albert
    Gama, Joao
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 597 - 602
  • [5] k-Nearest Neighbors for automated classification of celestial objects
    LiLi Li
    YanXia Zhang
    YongHeng Zhao
    Science in China Series G: Physics, Mechanics and Astronomy, 2008, 51 : 916 - 922
  • [6] PERFORMANCE OF K-NEAREST NEIGHBORS ALGORITHM IN OPINION CLASSIFICATION
    Jedrzejewski, Krzysztof
    Zamorski, Maurycy
    FOUNDATIONS OF COMPUTING AND DECISION SCIENCES, 2013, 38 (02) : 97 - 110
  • [7] Diminishing Prototype Size for k-Nearest Neighbors Classification
    Samadpour, Mohammad Mehdi
    Parvin, Hamid
    Rad, Farhad
    2015 FOURTEENTH MEXICAN INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE (MICAI), 2015, : 139 - 144
  • [8] k-Nearest Neighbors for automated classification of celestial objects
    LI LiLi1
    2 Department of Physics
    3 Weishanlu Middle School
    Science China(Physics,Mechanics & Astronomy), 2008, (07) : 916 - 922
  • [9] k-Nearest Neighbors for automated classification of celestial objects
    Li LiLi
    Zhang YanXia
    Zhao YongHeng
    SCIENCE IN CHINA SERIES G-PHYSICS MECHANICS & ASTRONOMY, 2008, 51 (07): : 916 - 922
  • [10] k-nearest neighbors prediction and classification for spatial data
    Mohamed-Salem Ahmed
    Mamadou N’diaye
    Mohammed Kadi Attouch
    Sophie Dabo-Niange
    Journal of Spatial Econometrics, 2023, 4 (1):