Generalized sparse metric learning with relative comparisons

被引:0
|
作者
Kaizhu Huang
Yiming Ying
Colin Campbell
机构
[1] Institute of Automation,National Laboratory of Pattern Recognition
[2] Chinese Academy of Sciences,School of Engineering, Computing and Mathematics
[3] University of Exeter,Department of Engineering Mathematics
[4] University of Bristol,undefined
来源
Knowledge and Information Systems | 2011年 / 28卷
关键词
Generalized framework; Metric learning; Sparse;
D O I
暂无
中图分类号
学科分类号
摘要
The objective of sparse metric learning is to learn a distance measure from a set of data in addition to finding a low-dimensional representation. Despite demonstrated success, the performance of existing sparse metric learning approaches is usually limited because the methods assumes certain problem relaxations or they target the SML objective indirectly. In this paper, we propose a Generalized Sparse Metric Learning method. This novel framework offers a unified view for understanding many existing sparse metric learning algorithms including the Sparse Metric Learning framework proposed in (Rosales and Fung ACM International conference on knowledge discovery and data mining (KDD), pp 367–373, 2006), the Large Margin Nearest Neighbor (Weinberger et al. in Advances in neural information processing systems (NIPS), 2006; Weinberger and Saul in Proceedings of the twenty-fifth international conference on machine learning (ICML-2008), 2008), and the D-ranking Vector Machine (D-ranking VM) (Ouyang and Gray in Proceedings of the twenty-fifth international conference on machine learning (ICML-2008), 2008). Moreover, GSML also establishes a close relationship with the Pairwise Support Vector Machine (Vert et al. in BMC Bioinform, 8, 2007). Furthermore, the proposed framework is capable of extending many current non-sparse metric learning models to their sparse versions including Relevant Component Analysis (Bar-Hillel et al. in J Mach Learn Res, 6:937–965, 2005) and a state-of-the-art method proposed in (Xing et al. Advances in neural information processing systems (NIPS), 2002). We present the detailed framework, provide theoretical justifications, build various connections with other models, and propose an iterative optimization method, making the framework both theoretically important and practically scalable for medium or large datasets. Experimental results show that this generalized framework outperforms six state-of-the-art methods with higher accuracy and significantly smaller dimensionality for seven publicly available datasets.
引用
收藏
页码:25 / 45
页数:20
相关论文
共 50 条
  • [21] Sparse semantic metric learning for image retrieval
    Liu, Jing
    Li, Zechao
    Lu, Hanqing
    MULTIMEDIA SYSTEMS, 2014, 20 (06) : 635 - 643
  • [22] Sparse Online Relative Similarity Learning
    Yao, Dezhong
    Zhao, Peilin
    Yu, Chen
    Jin, Hai
    Li, Bin
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 529 - 538
  • [23] Generalized Sum Pooling for Metric Learning
    Guerbuez, Yeti Z.
    Sener, Ozan
    Alatan, A. Aydin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 5439 - 5450
  • [24] Comparisons of relative BV-capacities and Sobolev capacity in metric spaces
    Hakkarainen, Heikki
    Shanmugalingam, Nageswari
    NONLINEAR ANALYSIS-THEORY METHODS & APPLICATIONS, 2011, 74 (16) : 5525 - 5543
  • [25] Simultaneous Preference and Metric Learning from Paired Comparisons
    Xu, Austin
    Davenport, Mark
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [26] Metric Learning from Limited Pairwise Preference Comparisons
    Wang, Zhi
    So, Geelon
    Vinayak, Ramya Korlakai
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2024, 244 : 3571 - 3602
  • [27] Sparse Bayesian approach for metric learning in latent space
    Zabihzadeh, Davood
    Monsefi, Reza
    Yazdi, Hadi Sadoghi
    KNOWLEDGE-BASED SYSTEMS, 2019, 178 : 11 - 24
  • [28] Visual Tracking with Multilevel Sparse Representation and Metric Learning
    Chen, Baifan
    Peng, Meng
    Liu, Lijue
    Lu, Tao
    JOURNAL OF INFORMATION TECHNOLOGY RESEARCH, 2018, 11 (02) : 1 - 12
  • [29] Sparse Feature Preservation for Relative Attribute Learning
    Wu, Han
    Kong, Xiangwei
    Yang, Hongxue
    Li, Ying
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2016, : 385 - 390
  • [30] Enhancing Factorization Machines With Generalized Metric Learning
    Guo, Yangyang
    Cheng, Zhiyong
    Jing, Jiazheng
    Lin, Yanpeng
    Nie, Liqiang
    Wang, Meng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (08) : 3740 - 3753