Self-supervised multi-view clustering in computer vision: A survey

被引:0
|
作者
Wang, Jiatai [1 ,2 ]
Xu, Zhiwei [3 ,4 ]
Yang, Xuewen [5 ]
Li, Hailong [1 ]
Li, Bo [1 ]
Meng, Xuying [4 ]
机构
[1] Inner Mongolia Univ Technol, Coll Data Sci & Applicat, Hohhot, Peoples R China
[2] OPPO Res Inst, Audio Semant Res Dept, Beijing, Peoples R China
[3] Haihe Lab ITAI, Tianjin, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
[5] InnoPeak Technol Inc, Palo Alto, CA USA
基金
美国国家科学基金会;
关键词
computer vision; pattern clustering;
D O I
10.1049/cvi2.12299
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, multi-view clustering (MVC) has had significant implications in the fields of cross-modal representation learning and data-driven decision-making. Its main objective is to cluster samples into distinct groups by leveraging consistency and complementary information among multiple views. However, the field of computer vision has witnessed the evolution of contrastive learning, and self-supervised learning has made substantial research progress. Consequently, self-supervised learning is progressively becoming dominant in MVC methods. It involves designing proxy tasks to extract supervisory information from image and video data, thereby guiding the clustering process. Despite the rapid development of self-supervised MVC, there is currently no comprehensive survey analysing and summarising the current state of research progress. Hence, the authors aim to explore the emergence of self-supervised MVC by discussing the reasons and advantages behind it. Additionally, the internal connections and classifications of common datasets, data issues, representation learning methods, and self-supervised learning methods are investigated. The authors not only introduce the mechanisms for each category of methods, but also provide illustrative examples of their applications. Finally, some open problems are identified for further investigation and development. The self-supervised learning problem presents a significant challenge within the realm of MVC, and its investigation holds paramount importance for practical applications. The authors include commonly employed self-supervised MVC datasets and related problems, offering insights from both image and video perspectives. Subsequently, a novel classification method is aimed at categorising existing self-supervised MVC methods. Finally, it is imperative to highlight several open and challenging problems, encouraging researchers to delve deeper into further research and make substantial progress in this domain. image
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Self-Supervised Deep Multi-View Subspace Clustering
    Sun, Xiukun
    Cheng, Miaomiao
    Min, Chen
    Jing, Liping
    [J]. ASIAN CONFERENCE ON MACHINE LEARNING, VOL 101, 2019, 101 : 1001 - 1016
  • [2] Self-supervised Deep Correlational Multi-view Clustering
    Xin, Bowen
    Zeng, Shan
    Wang, Xiuying
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Self-supervised Multi-view Clustering for Unsupervised Image Segmentation
    Fang, Tiyu
    Liang, Zhen
    Shao, Xiuli
    Dong, Zihao
    Li, Jinping
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2021, PT V, 2021, 12895 : 113 - 125
  • [4] Self-Supervised Graph Convolutional Network for Multi-View Clustering
    Xia, Wei
    Wang, Qianqian
    Gao, Quanxue
    Zhang, Xiangdong
    Gao, Xinbo
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3182 - 3192
  • [5] Self-Supervised Graph Completion for Incomplete Multi-View Clustering
    Liu, Cheng
    Wu, Si
    Li, Rui
    Jiang, Dazhi
    Wong, Hau-San
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (09) : 9394 - 9406
  • [6] Partial Multi-View Clustering via Self-Supervised Network
    Feng, Wei
    Sheng, Guoshuai
    Wang, Qianqian
    Gao, Quanxue
    Tao, Zhiqiang
    Dong, Bo
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 11, 2024, : 11988 - 11995
  • [7] Self-Supervised Discriminative Feature Learning for Deep Multi-View Clustering
    Xu, Jie
    Ren, Yazhou
    Tang, Huayi
    Yang, Zhimeng
    Pan, Lili
    Yang, Yang
    Pu, Xiaorong
    Yu, Philip S.
    He, Lifang
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (07) : 7470 - 7482
  • [8] Self-Supervised Information Bottleneck for Deep Multi-View Subspace Clustering
    Wang, Shiye
    Li, Changsheng
    Li, Yanming
    Yuan, Ye
    Wang, Guoren
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1555 - 1567
  • [9] Dual Alignment Self-Supervised Incomplete Multi-View Subspace Clustering Network
    Zhao, Liang
    Zhang, Jie
    Wang, Qiuhao
    Chen, Zhikui
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 2122 - 2126
  • [10] Digging into Uncertainty in Self-supervised Multi-view Stereo
    Xu, Hongbin
    Zhou, Zhipeng
    Wang, Yali
    Kang, Wenxiong
    Sun, Baigui
    Li, Hao
    Qiao, Yu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 6058 - 6067