Hypergraph Spectral Clustering in the Weighted Stochastic Block Model

被引:52
|
作者
Ahn, Kwangjun [1 ]
Lee, Kangwook [2 ]
Suh, Changho [2 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Math Sci, Daejeon 34141, South Korea
[2] Korea Adv Inst Sci & Technol, Sch Elect Engn, Daejeon 34141, South Korea
基金
新加坡国家研究基金会;
关键词
Clustering; hypergraph clustering; information-theoretic limits; stochastic block model; subspace clustering; COMMUNITY DETECTION; CONSISTENCY; ALGORITHM; RECOVERY;
D O I
10.1109/JSTSP.2018.2837638
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Spectral clustering is a celebrated algorithm that partitions the objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there are many other applications in which only multiway similarity measures are available. This motivates us to explore the multiway measurement setting. In this paper, we develop two algorithms intended for such setting: hypergraph spectral clustering (HSC) and hypergraph spectral clustering with local refinement (HSCLR). Our main contribution lies in performance analysis of the polytime algorithms under a random hypergraph model, which we name the weighted stochastic block model, in which objects and multiway measures are modeled as nodes and weights of hyperedges, respectively. Denoting by n the number of nodes, our analysis reveals the following: 1) HSC outputs a partition which is better than a random guess if the sum of edge weights (to be explained later) is Omega (n); 2) HSC out puts a partition which coincides with the hidden partition except for a vanishing fraction of nodes if the sum of edge weights is.(n); and 3) HSCLR exactly recovers the hidden partition if the sum of edge weights is on the order of n log n. Our results improve upon the state of the arts recently established under the model and they first settle the orderwise optimal results for the binary edge weight case. Moreover, we show that our results lead to efficient sketching algorithms for subspace clustering, a computer vision application. Finally, we show that HSCLR achieves the information-theoretic limits for a special yet practically relevant model, thereby showing no computational barrier for the case.
引用
收藏
页码:959 / 974
页数:16
相关论文
共 50 条
  • [21] Optimal Sampling and Clustering in the Stochastic Block Model
    Yun, Se-Young
    Proutiere, Alexandre
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [22] Limiting spectral distribution of stochastic block model
    Su, Giap Van
    Chen, May-Ru
    Guo, Mei-Hui
    Huang, Hao-Wei
    [J]. RANDOM MATRICES-THEORY AND APPLICATIONS, 2023, 12 (04)
  • [23] Hypergraph Spectral Clustering for Point Cloud Segmentation
    Zhang, Songyang
    Cui, Shuguang
    Ding, Zhi
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1655 - 1659
  • [24] Hypothesis testing in sparse weighted stochastic block model
    Mingao Yuan
    Fan Yang
    Zuofeng Shang
    [J]. Statistical Papers, 2022, 63 : 1051 - 1073
  • [25] Hypothesis testing in sparse weighted stochastic block model
    Yuan, Mingao
    Yang, Fan
    Shang, Zuofeng
    [J]. STATISTICAL PAPERS, 2022, 63 (04) : 1051 - 1073
  • [26] Preconditioned Spectral Clustering for Stochastic Block Partition Streaming Graph Challenge
    Zhuzhunashvili, David
    Knyazev, Andrew
    [J]. 2017 IEEE HIGH PERFORMANCE EXTREME COMPUTING CONFERENCE (HPEC), 2017,
  • [27] Randomized Spectral Clustering in Large-Scale Stochastic Block Models
    Zhang, Hai
    Guo, Xiao
    Chang, Xiangyu
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2022, 31 (03) : 887 - 906
  • [28] Improved Clustering Algorithms for the Bipartite Stochastic Block Model
    Ndaoud, Mohamed
    Sigalla, Suzanne
    Tsybakov, Alexandre B.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (03) : 1960 - 1975
  • [29] Attributed graph clustering with subspace stochastic block model
    Chen, Haoran
    Yu, Zhongjing
    Yang, Qinli
    Shao, Junming
    [J]. INFORMATION SCIENCES, 2020, 535 : 130 - 141
  • [30] Hypergraph-Based Spectral Clustering for Categorical Data
    Li, Yang
    Guo, Chonghui
    [J]. 2015 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2015, : 396 - 401