Self-Paced and Discrete Multiple Kernel k-Means

被引:3
|
作者
Lu, Yihang [1 ]
Zheng, Xuan [1 ]
Lu, Jitao [1 ]
Wang, Rong [1 ]
Nie, Feiping [1 ]
Li, Xuelong [1 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
关键词
Clustering; Multiple kernel k-means; Self-Paced Learning;
D O I
10.1145/3511808.3557696
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multiple Kernel k-means (MKKM) uses various kernels from different sources to improve clustering performance. However, most of the existing models are non-convex, which is prone to be stuck into bad local optimum, especially with noise and outliers. To address the issue, we propose a novel Self-Paced and Discrete Multiple Kernel k-Means (SPD-MKKM). It learns the MKKM model in a meaningful order by progressing both samples and kernels from easy to complex, which is beneficial to avoid bad local optimum. In addition, whereas existing methods optimize in two stages: learning the relaxation matrix and then finding the discrete one by extra discretization, our work can directly gain the discrete cluster indicator matrix without extra process. What's more, a well-designed alternative optimization is employed to reduce the overall computational complexity via using the coordinate descent technique. Finally, thorough experiments performed on real-world datasets illustrated the excellence and efficacy of our method.
引用
收藏
页码:4284 / 4288
页数:5
相关论文
共 50 条
  • [41] SELF-PACED TRAINING
    FRIEDMAN, R
    [J]. BYTE, 1995, 20 (06): : 45 - 45
  • [42] On the Existence of Kernel Function for Kernel-Trick of k-Means
    Klopotek, Mieczyslaw A.
    [J]. FOUNDATIONS OF INTELLIGENT SYSTEMS, ISMIS 2017, 2017, 10352 : 97 - 104
  • [43] ELM based Multiple Kernel k-means with Diversity-Induced Regularization
    Zhao, Yang
    Dou, Yong
    Liu, Xinwang
    Li, Teng
    [J]. 2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 2699 - 2705
  • [44] A new formulation of sparse multiple kernel k-means clustering and its applications
    Qu, Wentao
    Xiu, Xianchao
    Sun, Jun
    Kong, Lingchen
    [J]. STATISTICAL ANALYSIS AND DATA MINING, 2023, 16 (05) : 436 - 455
  • [45] KERNEL MATRIX TRIMMING FOR IMPROVED KERNEL K-MEANS CLUSTERING
    Tsapanos, Nikolaos
    Tefas, Anastasios
    Nikolaidis, Nikolaos
    Pitas, Ioannis
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 2285 - 2289
  • [46] Supervised kernel density estimation K-means
    Bortoloti, Frederico Damasceno
    de Oliveira, Elias
    Ciarelli, Patrick Marques
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 168
  • [47] Approximation of Kernel k-Means for Streaming Data
    Havens, Timothy C.
    [J]. 2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 509 - 512
  • [48] The Global Kernel k-Means Clustering Algorithm
    Tzortzis, Grigorios
    Likas, Aristidis
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 1977 - 1984
  • [49] Kernel K-Means Sampling for Nystrom Approximation
    He, Li
    Zhang, Hong
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) : 2108 - 2120
  • [50] Localized Incomplete Multiple Kernel k-Means With Matrix-Induced Regularization
    Li, Miaomiao
    Xia, Jingyuan
    Xu, Huiying
    Liao, Qing
    Zhu, Xinzhong
    Liu, Xinwang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) : 3479 - 3492