Contrastive Ensemble Clustering

被引:0
|
作者
Chen, Man-Sheng [1 ,2 ,3 ]
Lin, Jia-Qi [4 ]
Wang, Chang-Dong [1 ,2 ,3 ]
Huang, Dong [5 ]
Lai, Jian-Huang [6 ,7 ]
机构
[1] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[2] Sun Yat Sen Univ, Guangdong Key Lab Big Data Anal & Proc, Guangzhou 510275, Peoples R China
[3] Guangxi Zhuang Autonomous Reg Informat Ctr, Guangxi Key Lab Digital Infrastructure, Nanning 530201, Peoples R China
[4] Sun Yat Sen Univ, Sch Math Zhuhai, Guangzhou 510275, Peoples R China
[5] South China Univ, Dept Comp Sci, Guangzhou 510640, Peoples R China
[6] Sun Yat sen Univ, Sch Comp Sci & Engn, Guangdong Key Lab Informat Secur Technol, Minist Educ, Guangzhou 510275, Peoples R China
[7] Sun Yat sen Univ, Key Lab Machine Intelligence & Adv Comp, Minist Educ, Guangzhou 510275, Peoples R China
关键词
Clustering methods; Clustering algorithms; Noise measurement; Contrastive learning; Representation learning; Partitioning algorithms; Noise; Mutual information; Loss measurement; Data structures; Adaptive fusion; contrastive components; ensemble clustering; latent representation;
D O I
10.1109/TNNLS.2025.3531903
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ensemble clustering aims to combine different base clusterings into a better clustering than that of the individual one. In general, a co-association matrix depicting the pairwise affinity between different data samples is constructed by average fusion or weighted fusion of the connective matrices from multiple base clusterings. Despite the significant success, the existing works fail to capture the global structure information from multiple noisy connective matrices. Meanwhile, the locality property of the resulting representation matrix could not be explicitly preserved. In this article, we propose a novel contrastive ensemble clustering (CEC) method. Specifically, a consensus mapping model is designed for the discovery of the latent representation from the noisy observations with distinct confidences. Furthermore, a contrastive regularizer is dexterously formulated to refine the latent representation while preserving its locality property. Extensive experiments conducted on several benchmark datasets demonstrate the superiority of the proposed CEC method. To the best of our knowledge, it is the first time to explore the potential of latent representation learning and contrastive components for the ensemble clustering task.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Contrastive Clustering
    Li, Yunfan
    Hu, Peng
    Liu, Zitao
    Peng, Dezhong
    Zhou, Joey Tianyi
    Peng, Xi
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8547 - 8555
  • [2] Graph Contrastive Clustering
    Zhong, Huasong
    Wu, Jianlong
    Chen, Chong
    Huang, Jianqiang
    Deng, Minghua
    Nie, Liqiang
    Lin, Zhouchen
    Hua, Xian-Sheng
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9204 - 9213
  • [3] Contrastive Hierarchical Clustering
    Znalezniak, Michal
    Rola, Przemyslaw
    Kaszuba, Patryk
    Tabor, Jacek
    Smieja, Marek
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT I, 2023, 14169 : 627 - 643
  • [4] Safe Contrastive Clustering
    Tang, Pengwei
    Tang, Huayi
    Wang, Wei
    Liu, Yong
    MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 294 - 305
  • [5] An Ensemble Clustering Framework Based on Hierarchical Clustering Ensemble Selection and Clusters Clustering
    Li, Wenjun
    Wang, Zikang
    Sun, Wei
    Bahrami, Sara
    CYBERNETICS AND SYSTEMS, 2023, 54 (05) : 741 - 766
  • [6] Simple Contrastive Graph Clustering
    Liu, Yue
    Yang, Xihong
    Zhou, Sihang
    Liu, Xinwang
    Wang, Siwei
    Liang, Ke
    Tu, Wenxuan
    Li, Liang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (10) : 13789 - 13800
  • [7] Deep Temporal Contrastive Clustering
    Zhong, Ying
    Huang, Dong
    Wang, Chang-Dong
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 7869 - 7885
  • [8] Pyramid contrastive learning for clustering
    Zhou, Zi-Feng
    Huang, Dong
    Wang, Chang-Dong
    NEURAL NETWORKS, 2025, 185
  • [9] Supporting Clustering with Contrastive Learning
    Zhang, Dejiao
    Nan, Feng
    Wei, Xiaokai
    Li, Shang-Wen
    Zhu, Henghui
    McKeown, Kathleen
    Nallapati, Ramesh
    Arnold, Andrew O.
    Xiang, Bing
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 5419 - 5430
  • [10] Strongly augmented contrastive clustering
    Deng, Xiaozhi
    Huang, Dong
    Chen, Ding-Hua
    Wang, Chang-Dong
    Lai, Jian-Huang
    PATTERN RECOGNITION, 2023, 139