Multiple kernel multivariate performance learning using cutting plane algorithm

被引:39
|
作者
Wang, Jingbin [1 ,2 ]
Wang, Haoxiang [3 ]
Zhou, Yihua [4 ]
McDonald, Nancy [5 ]
机构
[1] Chinese Acad Sci, Natl Time Serv Ctr, Xian 710600, Peoples R China
[2] Chinese Acad Sci, Grad Univ, Beijing 100039, Peoples R China
[3] Cornell Univ, Dept Elect & Comp Engn, Ithaca, NY 14850 USA
[4] Lehigh Univ, Dept Mech Engn & Mech, Bethlehem, PA 18015 USA
[5] Tulane Univ, Dept Comp Sci, New Orleans, LA 70118 USA
关键词
Pattern recognition; multiple kernel; multivariate performance measures; cutting plane algorithm; FEATURE-SELECTION; SURFACE;
D O I
10.1109/SMC.2015.327
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a multi-kernel classifier learning algorithm to optimize a given nonlinear and nonsmoonth multivariate classifier performance measure. Moreover, to solve the problem of kernel function selection and kernel parameter tuning, we proposed to construct an optimal kernel by weighted linear combination of some candidate kernels. The learning of the classifier parameter and the kernel weight are unified in a single objective function considering to minimize the upper boundary of the given multivariate performance measure. The objective function is optimized with regard to classifier parameter and kernel weight alternately in an iterative algorithm by using cutting plane algorithm. The developed algorithm is evaluated on two different pattern classification methods with regard to various multivariate performance measure optimization problems. The experiment results show the proposed algorithm outperforms the competing methods.
引用
收藏
页码:1870 / 1875
页数:6
相关论文
共 50 条
  • [41] Sparse kernel SVMs via cutting-plane training
    Thorsten Joachims
    Chun-Nam John Yu
    Machine Learning, 2009, 76 : 179 - 193
  • [42] Sparse Kernel SVMs via Cutting-Plane Training
    Joachims, Thorsten
    Yu, Chun-Nam John
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I, 2009, 5781 : 8 - 8
  • [43] On Multiple Kernel Learning with Multiple Labels
    Tang, Lei
    Chen, Jianhui
    Ye, Jieping
    21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, 2009, : 1255 - 1260
  • [44] Sparse kernel SVMs via cutting-plane training
    Joachims, Thorsten
    Yu, Chun-Nam John
    MACHINE LEARNING, 2009, 76 (2-3) : 179 - 193
  • [45] Multiple kernel learning by empirical target kernel
    Wang, Peiyan
    Cai, Dongfeng
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2020, 18 (02)
  • [46] Multiple Instance Learning via Multiple Kernel Learning
    Yang, Bing
    Li, Qian
    Jing, Ling
    Zhen, Ling
    OPERATIONS RESEARCH AND ITS APPLICATIONS, 2010, 12 : 160 - 167
  • [47] Bimodal Emotion Recognition using Kernel Canonical Correlation Analysis and Multiple Kernel Learning
    Yan, Jingjie
    Qiu, Wei
    2021 14TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2021), 2021,
  • [48] Performance of SVM with Multiple Kernel Learning for Classification Tasks of Imbalanced Datasets
    Saeed, Sana
    Ong, Hong Choon
    PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY, 2019, 27 (01): : 527 - 545
  • [49] A Multiple Kernel Machine with Incremental Learning using Sparse Representation
    Pezeshki, Ali
    Azimi-Sadjadi, Mahmood R.
    Robbiano, Christopher
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [50] Multiclass multiple kernel learning using hypersphere for pattern recognition
    Yu Guo
    Huaitie Xiao
    Applied Intelligence, 2018, 48 : 2746 - 2754