Robust multilayer bootstrap networks in ensemble for unsupervised representation learning and clustering

被引:0
|
作者
Zhang, Xiao-Lei [1 ,2 ,3 ]
Li, Xuelong [2 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Shaanxi, Peoples R China
[2] China Telecom, Inst Artificial Intelligence TeleAI, Beijing 710072, Peoples R China
[3] Northwestern Polytech Univ, Res & Dev Inst, Shenzhen, Peoples R China
基金
美国国家科学基金会;
关键词
Ensemble selection; Cluster ensemble; Multilayer bootstrap networks; Unsupervised learning;
D O I
10.1016/j.patcog.2024.110739
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It is known that unsupervised nonlinear learning is sensitive to the selection of hyperparameters, which hinders its practical use. How to determine the optimal hyperparameter setting that may be dramatically different across applications is a hard issue. In this paper, we aim to address this issue for multilayer bootstrap networks (MBN), a recent unsupervised model, in a way as simple as possible. Specifically, we first propose an MBN ensemble (MBN-E) algorithm which concatenates the sparse outputs of a set of MBN base models with different network structures into a new representation. Then, we take the new representation produced by MBN-E as a reference for selecting the optimal MBN base models. Moreover, we propose a fast version of MBN-E (fMBN-E), which is not only theoretically even faster than a single standard MBN but also does not increase the estimation error of MBN-E. Empirically, comparing to a number of advanced clustering methods, the proposed methods reach reasonable performance in their default settings. fMBN-E is empirically hundreds of times faster than MBN-E without suffering performance degradation. The applications to image segmentation and graph data mining further demonstrate the advantage of the proposed methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Tri-level Robust Clustering Ensemble with Multiple Graph Learning
    Zhou, Peng
    Du, Liang
    Shen, Yi-Dong
    Li, Xuejun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11125 - 11133
  • [42] Deep boundary-aware clustering by jointly optimizing unsupervised representation learning
    Ru Wang
    Lin Li
    Peipei Wang
    Xiaohui Tao
    Peiyu Liu
    Multimedia Tools and Applications, 2022, 81 : 34309 - 34324
  • [43] Deep boundary-aware clustering by jointly optimizing unsupervised representation learning
    Wang, Ru
    Li, Lin
    Wang, Peipei
    Tao, Xiaohui
    Liu, Peiyu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (24) : 34309 - 34324
  • [44] Unsupervised Human Activity Representation Learning with Multi-task Deep Clustering
    Ma, Haojie
    Zhang, Zhijie
    Li, Wenzhong
    Lu, Sanglu
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (01):
  • [45] Robust Representation Learning by Clustering with Bisimulation Metrics for Visual Reinforcement Learning with Distractions
    Liu, Qiyuan
    Zhou, Qi
    Yang, Rui
    Wang, Jie
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 8843 - 8851
  • [46] Linear constraints on weight representation for generalized learning of multilayer networks
    Ishii, M
    Kumazawa, I
    NEURAL COMPUTATION, 2001, 13 (12) : 2851 - 2863
  • [47] Unsupervised Image Steganalysis Method Using Self-Learning Ensemble Discriminant Clustering
    Cao, Bing
    Feng, Guorui
    Yin, Zhaoxia
    Fan, Lingyan
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2017, E100D (05) : 1144 - 1147
  • [48] Manifold regularization ensemble clustering with many objectives using unsupervised extreme learning machines
    Homayouni, Haleh
    Mansoori, Eghbal G.
    INTELLIGENT DATA ANALYSIS, 2021, 25 (04) : 847 - 862
  • [49] SMDE: Unsupervised representation learning for time series based on signal mode decomposition and ensemble
    Zhang, Haobin
    Chan, Shengning
    Qin, Si
    Dong, Zheng
    Chen, Guanghui
    KNOWLEDGE-BASED SYSTEMS, 2024, 301
  • [50] Ensemble clustering by block diagonal representation
    Yang, Xiaofei
    Cheng, Nuo
    Ma, Yingcang
    Xing, Zhiwei
    Xin, Xiaolong
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2025, 28 (01):