Large Graph Clustering With Simultaneous Spectral Embedding and Discretization

被引:59
|
作者
Wang, Zhen [1 ,2 ]
Li, Zhaoqing [2 ,3 ]
Wang, Rong [2 ,4 ]
Nie, Feiping [2 ,4 ]
Li, Xuelong [2 ,4 ]
机构
[1] Northwestern Polytech Univ, Sch Mech Engn, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710072, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Automat, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Clustering methods; Clustering algorithms; Optimization; Complexity theory; Acceleration; Optical imaging; Laplace equations; Large graph clustering; spectral embedding; spectral rotation; label propagation; K-MEANS ALGORITHM;
D O I
10.1109/TPAMI.2020.3002587
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spectral clustering methods are gaining more and more interests and successfully applied in many fields because of their superior performance. However, there still exist two main problems to be solved: 1) spectral clustering methods consist of two successive optimization stages-spectral embedding and spectral rotation, which may not lead to globally optimal solutions, 2) and it is known that spectral methods are time-consuming with very high computational complexity. There are methods proposed to reduce the complexity for data vectors but not for graphs that only have information about similarity matrices. In this paper, we propose a new method to solve these two challenging problems for graph clustering. In the new method, a new framework is established to perform spectral embedding and spectral rotation simultaneously. The newly designed objective function consists of both terms of embedding and rotation, and we use an improved spectral rotation method to make it mathematically rigorous for the optimization. To further accelerate the algorithm, we derive a low-dimensional representation matrix from a graph by using label propagation, with which, in return, we can reconstruct a double-stochastic and positive semidefinite similarity matrix. Experimental results demonstrate that our method has excellent performance in time cost and accuracy.
引用
收藏
页码:4426 / 4440
页数:15
相关论文
共 50 条
  • [1] Multi-view spectral clustering by simultaneous consensus graph learning and discretization
    Zhong, Guo
    Shu, Ting
    Huang, Guoheng
    Yan, Xueming
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [2] JGSED: An End-to-End Spectral Clustering Model for Joint Graph Construction, Spectral Embedding and Discretization
    Peng, Yong
    Huang, Wenna
    Kong, Wanzeng
    Nie, Feiping
    Lu, Bao-Liang
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (06): : 1687 - 1701
  • [3] Simultaneous Spectral Data Embedding and Clustering
    Allab, Kais
    Labiod, Lazhar
    Nadif, Mohamed
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (12) : 6396 - 6401
  • [4] Spectral embedding network for attributed graph clustering
    Zhang, Xiaotong
    Liu, Han
    Wu, Xiao-Ming
    Zhang, Xianchao
    Liu, Xinyue
    [J]. NEURAL NETWORKS, 2021, 142 : 388 - 396
  • [5] Structured graph optimization for joint spectral embedding and clustering
    Yang, Xiaojun
    Li, Siyuan
    Liang, Ke
    Nie, Feiping
    Lin, Liang
    [J]. NEUROCOMPUTING, 2022, 503 : 62 - 72
  • [6] Enhancing generalized spectral clustering with embedding Laplacian graph regularization
    Zhang, Hengmin
    Yang, Jian
    Zhang, Bob
    Tang, Yang
    Du, Wenli
    Wen, Bihan
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2024,
  • [7] FAST SPECTRAL CLUSTERING WITH EFFICIENT LARGE GRAPH CONSTRUCTION
    Zhu, Wei
    Nie, Feiping
    Li, Xuelong
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2492 - 2496
  • [8] Simultaneous Dimensionality and Complexity Model Selection for Spectral Graph Clustering
    Yang, Congyuan
    Priebe, Carey E.
    Park, Youngser
    Marchette, David J.
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2021, 30 (02) : 422 - 441
  • [9] Iterative Graph Embedding and Clustering
    Oborevich, Artem
    Makarov, Ilya
    [J]. ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2023, PT I, 2023, 14134 : 68 - 79
  • [10] Graph Clustering with Embedding Propagation
    Yang, Carl
    Liu, Liyuan
    Liu, Mengxiong
    Wang, Zongyi
    Zhang, Chao
    Han, Jiawei
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 858 - 867