Can unbounded distance measures mitigate the curse of dimensionality?

被引:9
|
作者
Jayaram, Balasubramaniam [1 ]
Klawonn, Frank [2 ,3 ]
机构
[1] Indian Inst Technol Hyderabad, Dept Math, Yeddumailaram 502205, India
[2] Ostfalia Univ Appl Sci, Dept Comp Sci, D-38302 Wolfenbuettel, Germany
[3] Helmholtz Ctr Infect Res, Bioinformat & Stat, D-38124 Braunschweig, Germany
关键词
curse of dimensionality; CoD; nearest neighbour classifier; cluster analysis;
D O I
10.1504/IJDMMM.2012.049883
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we revisit the curse of dimensionality, especially the concentration of the norm phenomenon which is the inability of distance functions to separate points well in high dimensions. We study the influence of the different properties of a distance measure, viz., triangle inequality, boundedness and translation invariance and on this phenomenon. Our studies indicate that unbounded distance measures whose expectations do not exist are to be preferred. We propose some new distance measures based on our studies and present many experimental results which seem to confirm our analysis. In particular, we study these distance measures w.r.t. indices like relative variance and relative contrast and further compare and contrast these measures in the setting of nearest neighbour/proximity searches and hierarchical clustering.
引用
收藏
页码:361 / 383
页数:23
相关论文
共 50 条
  • [1] Quantifying the Empirical Wasserstein Distance to a Set of Measures: Beating the Curse of Dimensionality
    Si, Nian
    Blanchet, Jose
    Ghosh, Soumyadip
    Squillante, Mark S.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [2] Empirical measures: regularity is a counter-curse to dimensionality
    Kloeckner, Benoit R.
    [J]. ESAIM-PROBABILITY AND STATISTICS, 2020, 24 : 408 - 434
  • [3] CAN LOCAL PARTICLE FILTERS BEAT THE CURSE OF DIMENSIONALITY?
    Rebeschini, Patrick
    van Handel, Ramon
    [J]. ANNALS OF APPLIED PROBABILITY, 2015, 25 (05): : 2809 - 2866
  • [4] Independent Subspace Analysis can Cope with the 'Curse of Dimensionality'
    Szabo, Zoltan
    Lorincz, Andras
    [J]. ACTA CYBERNETICA, 2007, 18 (02): : 213 - 221
  • [5] Mitigating the influence of the curse of dimensionality on time series similarity measures
    Al-Naymat, Ghazi
    [J]. INTERNATIONAL JOURNAL OF COMPUTER APPLICATIONS IN TECHNOLOGY, 2015, 52 (01) : 94 - 105
  • [6] The Curse of Dimensionality
    Patel, Niketu P.
    Sarraf, Elie
    Tsai, Mitchell H.
    [J]. ANESTHESIOLOGY, 2018, 129 (03) : 614 - 615
  • [7] Can Shared-Neighbor Distances Defeat the Curse of Dimensionality?
    Houle, Michael E.
    Kriegel, Hans-Peter
    Kroeger, Peer
    Schubert, Erich
    Zimek, Arthur
    [J]. SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2010, 6187 : 482 - +
  • [8] The curse(s) of dimensionality
    Naomi Altman
    Martin Krzywinski
    [J]. Nature Methods, 2018, 15 : 399 - 400
  • [9] Breaking the curse of dimensionality
    Weimar, Markus
    [J]. DISSERTATIONES MATHEMATICAE, 2015, (505) : 5 - 112
  • [10] The Curse of Dimensionality Reply
    Kheterpal, Sachin
    Tremper, Kevin K.
    [J]. ANESTHESIOLOGY, 2018, 129 (03) : 615 - 616