Conformal transformation of the metric for k-nearest neighbors classification

被引:0
|
作者
Popescu, Marius Claudiu [1 ]
Grama, Lacrimioara [1 ]
Rusu, Corneliu [1 ]
机构
[1] Tech Univ Cluj Napoca, Fac Elect Telecommun & Informat Technol, Signal Proc Grp, Cluj Napoca, Romania
关键词
k-nearest neighbors; Riemannian metric learning; nonparametric classification;
D O I
10.1109/iccp51029.2020.9266240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper introduces a new method for improving the nearest neighbors classifier. Our approach is based on the idea of replacing the constant metric with a variable and conformally equivalent one that is data dependent, and therefore it is more informative. We define a family of conformal transformations that, under some assumptions, induces distance functions that are efficiently computable. Using the intuition that the distances between points near a class boundary should be larger, a simple method for selecting a transformation is proposed. We perform experiments on two datasets. The first set of experiments are with a sentiment prediction dataset, and in this case our method offers some improvements over the standard k-NN algorithm. In the second empirical analysis, we apply the method to a news categorisation problem. In this case the results are mixed. We conclude with a discussion of the advantages and weaknesses of the method, and propose a number of possible improvements.
引用
收藏
页码:229 / 234
页数:6
相关论文
共 50 条
  • [21] K-nearest neighbors clustering algorithm
    Gauza, Dariusz
    Zukowska, Anna
    Nowak, Robert
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2014, 2014, 9290
  • [22] Hausdorff Distance with k-Nearest Neighbors
    Wang, Jun
    Tan, Ying
    ADVANCES IN SWARM INTELLIGENCE, ICSI 2012, PT II, 2012, 7332 : 272 - 281
  • [23] A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity
    Zhang, B
    Srihari, SN
    EIGHTH INTERNATIONAL WORKSHOP ON FRONTIERS IN HANDWRITING RECOGNITION: PROCEEDINGS, 2002, : 13 - 18
  • [24] (Very) Fast (All) k-Nearest Neighbors in Metric and Non Metric Spaces without Indexing
    Miranda, Natalia
    Chavez, Edgar
    Fabiana Piccoli, Maria
    Reyes, Nora
    SIMILARITY SEARCH AND APPLICATIONS (SISAP), 2013, 8199 : 300 - 311
  • [25] k-Nearest Neighbors in Uncertain Graphs
    Potamias, Michalis
    Bonchi, Francesco
    Gionis, Aristides
    Kollios, George
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2010, 3 (01): : 997 - 1008
  • [26] Adaptive condensed fuzzy monotonic K-nearest neighbors for monotonic classification
    Chen, Jiankai
    Li, Zhongyan
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [27] Weather Prediction and Classification Using Neural Networks and k-Nearest Neighbors
    Mantri, Rhea
    Raghavendra, Kulkarni Rakshit
    Puri, Harshita
    Chaudhary, Jhanavi
    Bingi, Kishore
    2021 8TH INTERNATIONAL CONFERENCE ON SMART COMPUTING AND COMMUNICATIONS (ICSCC), 2021, : 263 - 268
  • [28] Towards heterogeneous similarity function learning for the k-nearest neighbors classification
    Grudzinski, Karol
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING - ICAISC 2008, PROCEEDINGS, 2008, 5097 : 578 - 587
  • [29] Machine learning classification based on k-Nearest Neighbors for PolSAR data
    Ferreira, Jodavid A.
    Rodrigues, Anny K. G.
    Ospina, Raydonal
    Gomez, Luis
    ANAIS DA ACADEMIA BRASILEIRA DE CIENCIAS, 2024, 96 (01):
  • [30] Classification of incomplete data based on belief functions and K-nearest neighbors
    Liu, Zhun-ga
    Liu, Yong
    Dezert, Jean
    Pan, Quan
    KNOWLEDGE-BASED SYSTEMS, 2015, 89 : 113 - 125