Fast kernel spectral clustering

被引:12
|
作者
Langone, Rocco [1 ]
Suykens, Johan A. K. [1 ]
机构
[1] Katholieke Univ Leuven, ESAT STADIUS, Kasteelpk Arenberg 10, B-3001 Leuven, Belgium
基金
欧洲研究理事会;
关键词
Spectral clustering; Kernel methods; Big data; NystrOm approximation; LARGE DATA SETS; NYSTROM METHOD;
D O I
10.1016/j.neucom.2016.12.085
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spectral clustering suffers from a scalability problem in both memory usage and computational time when the number of data instances N is large. To solve this issue, we present a fast spectral clustering algorithm able to effectively handle millions of datapoints at a desktop PC scale. The proposed technique relies on a kernel-based formulation of the spectral clustering problem, also known as kernel spectral clustering. In this framework, the Nystrom approximation of the feature map of size m, with m << N, is used to solve the primal optimization problem. This leads to a reduction of time complexity from O(N-3) to O(mN) and space complexity from O(N-2) to O(mN). The effectiveness of the proposed algorithm in terms of computational efficiency and clustering quality is illustrated on several datasets. (C) 2017 Published by Elsevier B.V.
引用
收藏
页码:27 / 33
页数:7
相关论文
共 50 条
  • [1] Hierarchical kernel spectral clustering
    Alzate, Carlos
    Suykens, Johan A. K.
    [J]. NEURAL NETWORKS, 2012, 35 : 21 - 30
  • [2] Spectral kernel methods for clustering
    Cristianini, N
    Shawe-Taylor, J
    Kandola, J
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 14, VOLS 1 AND 2, 2002, 14 : 649 - 655
  • [3] Soft Kernel Spectral Clustering
    Langone, Rocco
    Mall, Raghvendra
    Suykens, Johan A. K.
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [4] Kernel Cuts: Kernel and Spectral Clustering Meet Regularization
    Tang, Meng
    Marin, Dmitrii
    Ben Ayed, Ismail
    Boykov, Yuri
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (05) : 477 - 511
  • [5] CONCENTRATION OF KERNEL MATRICES WITH APPLICATION TO KERNEL SPECTRAL CLUSTERING
    Amini, Arash A.
    Razaee, Zahra S.
    [J]. ANNALS OF STATISTICS, 2021, 49 (01): : 531 - 556
  • [6] Kernel Cuts: Kernel and Spectral Clustering Meet Regularization
    Meng Tang
    Dmitrii Marin
    Ismail Ben Ayed
    Yuri Boykov
    [J]. International Journal of Computer Vision, 2019, 127 : 477 - 511
  • [7] Powered Gaussian kernel spectral clustering
    Yessica Nataliani
    Miin-Shen Yang
    [J]. Neural Computing and Applications, 2019, 31 : 557 - 572
  • [8] A survey of kernel and spectral methods for clustering
    Filippone, Maurizio
    Camastra, Francesco
    Masulli, Francesco
    Rovetta, Stefano
    [J]. PATTERN RECOGNITION, 2008, 41 (01) : 176 - 190
  • [9] Denoised Kernel Spectral Data Clustering
    Mall, Raghvendra
    Bensmail, Halima
    Langone, Rocco
    Varon, Carolina
    Suykens, Johan A. K.
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 3709 - 3716
  • [10] Spectral clustering with the probabilistic cluster kernel
    Izquierdo-Verdiguier, Emma
    Jenssen, Robert
    Gomez-Chova, Luis
    Camps-Valls, Gustavo
    [J]. NEUROCOMPUTING, 2015, 149 : 1299 - 1304