Multi-View Clustering Based on Adaptive Similarity Graph Joint Optimization

被引:0
|
作者
Ji X. [1 ,2 ]
Shi M.-Y. [1 ]
Zhou P. [2 ]
Yao S. [1 ]
机构
[1] School of Computer Science and Technology, Anhui University, Hefei
[2] International Brain Science Engineering Research Center, Anhui University, Hefei
来源
关键词
adaptive optimization; graph fusion; multi-view clustering; self-weighting; similar graph;
D O I
10.11897/SP.J.1016.2024.00310
中图分类号
学科分类号
摘要
Compared to single-view learning, multi-view learning can often obtain more comprehensive information about the learning object. Therefore, in the field of unsupervised learning, multi-view clustering has received great attention from researchers. Among them,graph based multi-view clustering has made great research progress in recent years. Graph based multi-view clustering generally involves learning similar graphs from the raw data of each view,and then fusing similar graphs between views to obtain the final clustering result. Therefore, the effectiveness of multi-view clustering is determined by the quality of similar graphs and the fusion method of similar graphs. However, existing graph based multi-view clustering methods almost all focus on the fusion of similar graphs between views,and lack attention to the quality of similar graphs themselves. Most of these methods learn similar graphs in isolation from the raw data of each view, and keep the similar graphs unchanged in the subsequent graph fusion process. The similarity graph obtained in this way inevitably contains noise and redundant information,which in turn affects subsequent graph fusion and clustering. The existing a small amount of studies that consider the quality of similarity graphs either directly iterate the construction of similarity graphs and graph fusion processes, or use rank constraints to further initializes in advance during the predefined similarity graph process, or utilizes some underlying structures of similarity graphs to obtain the fused graph. These methods have very little improvement in the quality of similarity graph, so the final clustering performance improvement is also very limited. At the same time,the existing graph based multi-view clustering process lacks comprehensive consideration of consistency and inconsistency between views,which will also seriously affect the final multi-view clustering performance. In order to avoid the adverse effects of low-quality predefined similarity graphs on clustering results, and to comprehensively consider the consistency and inconsistency between views to improve the final clustering effect, this paper proposes a multi-view clustering method based on adaptive similarity graph joint optimization (AJO-MVC). Firstly, the Hadamard product is used to obtain high-quality consistency information between views,and then the predefined similarity graphs of each view are compared with this information to reconstruct the preset similarity graphs for each view. This process strengthens the consistency between different views and weakens the inconsistency. Secondly, a joint iterative optimization framework for similar graph reconstruction and graph fusion is designed to achieve adaptive improvement of similar graphs, ultimately achieving a joint improvement of similar graphs and clustering results. This AJO-MVC method combines the process of improving similar graphs with the process of graph fusion for adaptive iterative optimization, and continuously strengthens the consistency between views and weakens the inconsistency between views during the iterative optimization. In addition, this AJO-MVC method proposed in this paper also integrates some advantages of existing multi-view clustering methods, such as self-weighting and no need for additional clustering steps. The effectiveness and superiority of our AJO-MVC method have been fully validated through experiments on nine benchmark datasets with eight comparison methods. © 2024 Science Press. All rights reserved.
引用
收藏
页码:310 / 322
页数:12
相关论文
共 31 条
  • [1] Chao G, Sun S, Bi J., A survey on multiview clustering, IEEE Transactions on Artificial Intelligence, 2, 2, pp. 146-168, (2021)
  • [2] Yang Y,, Wang H., Multi-view clustering:A survey, Big Data Mining and Analytics, 1, 2, pp. 83-107, (2018)
  • [3] Blum A,, Mitchell T., Combining labeled and unlabeled data with co-training, Proceedings of the 11th Annual Conference on Computational Learning Theory, pp. 92-100, (1998)
  • [4] Deep embedded multi-view clustering with collaborative training, Information Sciences, 573, pp. 279-290, (2021)
  • [5] De Sa V R,, Gallagher P W,, Lewis J M,, Et al., Multi-view kernel construction, Machine Learning, 79, 1-2, pp. 47-71, (2010)
  • [6] Zhou S,, Zhu E,, Liu X,, Et al., Subspace segmentation-based robust multiple kernel clustering, Information Fusion, 53, 2, pp. 145-154, (2020)
  • [7] Chaudhuri K,, Kakade S M,, Livescu K,, Et al., Multi-view clustering via canonical correlation analysis, Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129-136, (2009)
  • [8] Spielman D., Spectral graph theory, Combinatorial Scientific Computing, 18, 1, (2012)
  • [9] Sheng-Li Xie, Hong-Da Chen, Jun-Li Gao, Et al., Deep multiview clustering based on distribution aligned variational autoencoder, Chinese Journal of Computers, 46, 5, pp. 945-959, (2023)
  • [10] Liu B Y,, Huang L,, Wang C D,, Et al., Multi-view consensus proximity learning for clustering, IEEE Transactions on Knowledge and Data Engineering, 34, 7, pp. 3405-3417, (2020)