Subspace-based self-weighted multiview fusion for instance retrieval

被引:5
|
作者
Wu, Zhijian [1 ]
Li, Jun [1 ]
Xu, Jianhua [1 ]
Yang, Wankou [2 ]
机构
[1] Nanjing Normal Univ, Sch Comp & Elect Informat, Nanjing 210023, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-weighted learning; Multiview subspace learning; Multiview fusion; Instance retrieval; IMAGE; FEATURES;
D O I
10.1016/j.ins.2022.01.068
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing subspace-based multiview learning algorithms treat multiview features equally in the process of subspace reconstruction without distinguishing the discrepant contributions from different views. This limitation adversely affects subspace embedding, particularly when significant variances in view-specific feature characteristics are present. In this paper, a unified subspace-based self-weighted multiview learning framework (SSMVL) is proposed for instance retrieval. In contrast to the previous methods in which the variances in multiview features are ignored, the self-weighted learning mechanism is integrated into the multiview subspace learning framework such that the weights of different views are adaptively learned instead of empirically assigned. In addition, the proposed SSMVL approach falls into the unsupervised learning category and is thus independent of massive amounts of labeled data resulting from labor-intensive annotation. In this study, the extension of SSMVL to the Hamming subspace learning paradigm is also explored for efficient retrieval. Experiments on five public benchmarks reveal that the self-weighted learning strategy plays a beneficial role in multiview fusion, and our method achieves superior performance in comparison to state-of-the-art methods. (C) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:261 / 276
页数:16
相关论文
共 50 条
  • [1] Kernelized Multiview Subspace Analysis By Self-Weighted Learning
    Wang, Huibing
    Wang, Yang
    Zhang, Zhao
    Fu, Xianping
    Zhuo, Li
    Xu, Mingliang
    Wang, Meng
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3828 - 3840
  • [2] Subspace-based multi-view fusion for instance-level image retrieval
    Jun Li
    Bo Yang
    Wankou Yang
    Changyin Sun
    Jianhua Xu
    [J]. The Visual Computer, 2021, 37 : 619 - 633
  • [3] Subspace-based multi-view fusion for instance-level image retrieval
    Li, Jun
    Yang, Bo
    Yang, Wankou
    Sun, Changyin
    Xu, Jianhua
    [J]. VISUAL COMPUTER, 2021, 37 (03): : 619 - 633
  • [4] Self-weighted Multiview Clustering with Multiple Graphs
    Nie, Feiping
    Li, Jing
    Li, Xuelong
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2564 - 2570
  • [5] When deep meets shallow: subspace-based multi-view fusion for instance-level image retrieval
    Li, Jun
    Yang, Bo
    Yang, Wankou
    Sun, Changyin
    Zhang, Hong
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 486 - 492
  • [6] SELF-WEIGHTED MULTIVIEW METRIC LEARNING BY MAXIMIZING THE CROSS CORRELATIONS
    Wang, Huibing
    Peng, Jinjia
    Fu, Xianping
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 465 - 470
  • [7] SELF-WEIGHTED DEEP SUBSPACE CLUSTERING WITH FUZZY LABELS
    Bao, Zhaoqiang
    Wang, Lihong
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2023, 19 (04): : 1057 - 1072
  • [8] Subspace-based method for phase retrieval in interferometry
    Patil, A
    Rastogi, P
    [J]. OPTICS EXPRESS, 2005, 13 (04): : 1240 - 1248
  • [9] Information Subspace-Based Fusion for Vehicle Classification
    Ghanem, Sally
    Panahi, Ashkan
    Krim, Hamid
    Kerekes, Ryan A.
    Mattingly, John
    [J]. 2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1612 - 1616
  • [10] Counting with Self-Weighted Multi-Scale Fusion Networks
    Xiong, Xin
    Shen, Jie
    Li, Ying
    He, Wei
    Li, Peng
    Yan, Wenjie
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (10)