Asymmetric Gaussian Process multi-view learning for visual classification

被引:19
|
作者
Li, Jinxing [1 ,2 ]
Li, Zhaoqun [1 ]
Lu, Guangming [4 ]
Xu, Yong [4 ]
Zhang, Bob [5 ]
Zhang, David [1 ,3 ]
机构
[1] Chinese Univ Hong Kong Shenzhen, Shenzhen, Peoples R China
[2] Univ Sci & Technol China, Hefei, Peoples R China
[3] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[4] Harbin Inst Technol, Dept Comp Sci, Shenzhen, Peoples R China
[5] Univ Macau, Dept Comp & Informat Sci, Taipa, Macao, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Multi-view; Gaussian Process; View-shared; View-specific; Classification; MAXIMUM-ENTROPY DISCRIMINATION; LATENT VARIABLE MODEL;
D O I
10.1016/j.inffus.2020.08.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Methods of multi-view learning attain outstanding performance in different fields compared with the single-view based strategies. In this paper, the Gaussian Process Latent Variable Model (GPVLM), which is a generative and non-parametric model, is exploited to represent multiple views in a common subspace. Specifically, there exists a shared latent variable across various views that is assumed to be transformed to observations by using distinctive Gaussian Process projections. However, this assumption is only a generative strategy, being intractable to simply estimate the fused variable at the testing step. In order to tackle this problem, another projection from observed data to the shared variable is simultaneously learned by enjoying the view-shared and view-specific kernel parameters under the Gaussian Process structure. Furthermore, to achieve the classification task, label information is also introduced to be the generation from the latent variable through a Gaussian Process transformation. Extensive experimental results on multi-view datasets demonstrate the superiority and effectiveness of our model in comparison to state-of-the-art algorithms.
引用
收藏
页码:108 / 118
页数:11
相关论文
共 50 条
  • [21] MULTI-VIEW MULTI-LABEL ACTIVE LEARNING FOR IMAGE CLASSIFICATION
    Zhang, Xiaoyu
    Cheng, Jian
    Xu, Changsheng
    Lu, Hanqing
    Ma, Songde
    [J]. ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 258 - 261
  • [22] MULTI-VIEW METRIC LEARNING FOR MULTI-LABEL IMAGE CLASSIFICATION
    Zhang, Mengying
    Li, Changsheng
    Wang, Xiangfeng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2134 - 2138
  • [23] Image classification with multi-view multi-instance metric learning
    Tang, Jingjing
    Li, Dewei
    Tian, Yingjie
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 189
  • [24] Multi-view Regularized Gaussian Processes
    Liu, Qiuyang
    Sun, Shiliang
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2017, PT II, 2017, 10235 : 655 - 667
  • [25] Multi-view Deep Gaussian Processes
    Sun, Shiliang
    Liu, Qiuyang
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2018), PT I, 2018, 11301 : 130 - 139
  • [26] MULTI-VIEW METRIC LEARNING FOR MULTI-VIEW VIDEO SUMMARIZATION
    Wang, Linbo
    Fang, Xianyong
    Guo, Yanwen
    Fu, Yanwei
    [J]. 2016 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2016, : 179 - 182
  • [27] Multi-view representation learning for multi-view action recognition
    Hao, Tong
    Wu, Dan
    Wang, Qian
    Sun, Jin-Sheng
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 453 - 460
  • [28] WoT-based Gaussian process multi-view learning for real-time monitoring and identification
    Zhou, Aili
    [J]. INTERNET TECHNOLOGY LETTERS, 2022,
  • [29] WoT-based Gaussian process multi-view learning for real-time monitoring and identification
    Zhou, Aili
    [J]. INTERNET TECHNOLOGY LETTERS, 2023, 6 (05)
  • [30] Learning multi-view visual correspondences with self-supervision
    Zhang, Pengcheng
    Zhou, Lei
    Bai, Xiao
    Wang, Chen
    Zhou, Jun
    Zhang, Liang
    Zheng, Jin
    [J]. DISPLAYS, 2022, 72