Improving Spectral Clustering Using the Asymptotic Value of the Normalized Cut

被引:5
|
作者
Hofnneyr, David P. [1 ]
机构
[1] Stellenbosch Univ, Dept Stat & Actuarial Sci, Cnr Bosman & Victoria St, ZA-7602 Stellenbosch, South Africa
关键词
Cluster number determination; Low density separation; Self-tuning clustering;
D O I
10.1080/10618600.2019.1593180
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Spectral clustering (SC) is a popular and versatile clustering method based on a relaxation of the normalized graph cut objective. Despite its popularity, selecting the number of clusters and tuning the important scaling parameter remain challenging problems in practical applications of SC. Popular heuristics have been proposed, but corresponding theoretical results are scarce. In this article, we investigate the asymptotic value of the normalized cut for an increasing sample assumed to arise from an underlying probability distribution. Based on this, we find strong connections between spectral and density clustering. This enables us to provide recommendations for selecting the number of clusters and setting the scaling parameter in a data driven manner. An algorithm inspired by these recommendations is proposed, whichwe have found to exhibit strong performance in a range of applied domains. AnRimplementation of the algorithm is available from https://github. com/DavidHofmeyr/spuds. Supplementary materials for this article are available online.
引用
收藏
页码:980 / 992
页数:13
相关论文
共 50 条
  • [1] Research on Improved Normalized Cut Spectral Clustering Algorithm
    Zheng, Quan
    Liu, Zengli
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 1981 - 1984
  • [2] Robust and smart spectral clustering from normalized cut
    Kong, Wanzeng
    Hu, Sanqing
    Zhang, Jianhai
    Dai, Guojun
    NEURAL COMPUTING & APPLICATIONS, 2013, 23 (05): : 1503 - 1512
  • [3] Robust and smart spectral clustering from normalized cut
    Wanzeng Kong
    Sanqing Hu
    Jianhai Zhang
    Guojun Dai
    Neural Computing and Applications, 2013, 23 : 1503 - 1512
  • [4] Neural Normalized Cut: A differential and generalizable approach for spectral clustering
    He, Wei
    Zhang, Shangzhi
    Li, Chun-Guang
    Qi, Xianbiao
    Xiao, Rong
    Guo, Jun
    PATTERN RECOGNITION, 2025, 164
  • [5] A Note on Spectral Clustering Method Based on Normalized Cut Criterion
    Sumuya
    Guo, Chonghui
    Chai, Shanglei
    PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, : 799 - 803
  • [6] Spectral Clustering of Large-scale Data by Directly Solving Normalized Cut
    Chen, Xiaojun
    Hong, Weijun
    Nie, Feiping
    He, Dan
    Yang, Min
    Huang, Joshua Zhexue
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1206 - 1215
  • [7] An intrusion detection algorithm for sensor network based on normalized cut spectral clustering
    Yang, Gaoming
    Yu, Xu
    Xu, Lingwei
    Xin, Yu
    Fang, Xianjin
    PLOS ONE, 2019, 14 (10):
  • [8] Color restoration based on spectral information using normalized cut
    Morimoto, Tetsuro
    Mihashi, Tohru
    Ikeuchi, Katsushi
    Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers, 2008, 62 (09): : 1453 - 1460
  • [9] Attributed Graph Clustering with Unimodal Normalized Cut
    Ye, Wei
    Zhou, Linfei
    Sun, Xin
    Plant, Claudia
    Boehm, Christian
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 601 - 616
  • [10] Color Restoration Method Based on Spectral Information Using Normalized Cut
    Tetsuro Morimoto
    Tohru Mihashi
    Katsushi Ikeuchi
    International Journal of Automation & Computing, 2008, (03) : 226 - 233