Attentive multi-view deep subspace clustering net q

被引:27
|
作者
Lu, Run-kun [1 ]
Liu, Jian-wei [1 ]
Zuo, Xin [1 ]
机构
[1] China Univ Petr, Coll Informat Sci & Engn, Dept Automat, Beijing Campus CUP,260 Mailbox, Beijing 102249, Peoples R China
关键词
Multi-view learning; Subspace clustering; Deep learning; Attention;
D O I
10.1016/j.neucom.2021.01.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel Attentive Multi-View Deep Subspace Nets (AMVDSN), which deeply explores underlying consistent and view-specific information from multiple views and fuse them by con-sidering each view's dynamic contribution obtained by attention mechanism. Unlike most multi-view subspace learning methods that they directly reconstruct data points on raw data or only consider con-sistency or complementarity when learning representation in deep or shallow space, our proposed method seeks to find a joint latent representation that explicitly considers both consensus and view-specific information among multiple views, and then performs subspace clustering on learned joint latent representation. Besides, different views contribute differently to representation learning, we therefore introduce attention mechanism to derive dynamic weight for each view, which performs much better than previous fusion methods in the field of multi-view subspace clustering. The proposed algorithm is intuitive and can be easily optimized just by using Stochastic Gradient Descent (SGD) because of the neural network framework, which also provides strong non-linear characterization capability compared with traditional subspace clustering approaches. The experimental results on seven real-world data sets have demonstrated the effectiveness of our proposed algorithm against some state-of-the-art subspace learning approaches.
引用
收藏
页码:186 / 196
页数:11
相关论文
共 50 条
  • [21] Scalable Affine Multi-view Subspace Clustering
    Wanrong Yu
    Xiao-Jun Wu
    Tianyang Xu
    Ziheng Chen
    Josef Kittler
    [J]. Neural Processing Letters, 2023, 55 : 4679 - 4696
  • [22] Diverse and Common Multi-View Subspace Clustering
    Lu, Zhiqiang
    Wu, Songsong
    Liu, Yurong
    Gao, Guangwei
    Wu, Fei
    [J]. PROCEEDINGS OF 2018 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2018, : 878 - 882
  • [23] Feature concatenation multi-view subspace clustering
    Zheng, Qinghai
    Zhu, Jihua
    Li, Zhongyu
    Pang, Shanmin
    Wang, Jun
    Li, Yaochen
    [J]. NEUROCOMPUTING, 2020, 379 : 89 - 102
  • [24] Contrastive and attentive graph learning for multi-view clustering
    Wang, Ru
    Li, Lin
    Tao, Xiaohui
    Wang, Peipei
    Liu, Peiyu
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (04)
  • [25] Multi-view Subspace Clustering on Topological Manifold
    Huang, Shudong
    Wu, Hongjie
    Ren, Yazhou
    Tsang, Ivor W.
    Xu, Zenglin
    Feng, Wentao
    Lv, Jiancheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [26] Consistent and Specific Multi-View Subspace Clustering
    Luo, Shirui
    Zhang, Changqing
    Zhang, Wei
    Cao, Xiaochun
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 3730 - 3737
  • [27] Generalized Multi-View Collaborative Subspace Clustering
    Lan, Mengcheng
    Meng, Min
    Yu, Jun
    Wu, Jigang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (06) : 3561 - 3574
  • [28] Efficient Orthogonal Multi-view Subspace Clustering
    Chen, Man-Sheng
    Wang, Chang-Dong
    Huang, Dong
    Lai, Jian-Huang
    Yu, Philip S.
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 127 - 135
  • [29] Multi-view Subspace Clustering for Face Images
    Zhang, Xin
    Dinh Phung
    Venkatesh, Svetha
    Duc-Son Pham
    Liu, Wanquan
    [J]. 2015 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2015, : 555 - 561
  • [30] Scalable Affine Multi-view Subspace Clustering
    Yu, Wanrong
    Wu, Xiao-Jun
    Xu, Tianyang
    Chen, Ziheng
    Kittler, Josef
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (04) : 4679 - 4696