Safe sample screening rules for multicategory angle-based support vector machines

被引:3
|
作者
Fan, Yiwei [1 ]
Zhao, Junlong [2 ]
机构
[1] Beijing Inst Technol, Sch Math & Stat, Beijing, Peoples R China
[2] Beijing Normal Univ, Sch Stat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Angle-based support vector machine; Duality gap; Sample screening; Variational inequality; SVM; CLASSIFICATION; ALGORITHM; DESCENT;
D O I
10.1016/j.csda.2022.107508
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Support vector machines are popular techniques for classification problems, where the optimal separating hyperplane only depends on a subset of training data. To reduce computational costs, safe sample screening rules are proposed in the literature, which enable us to remove redundant samples prior to the training phase. However, existing works on safe sample screening rules mainly focus on binary classification. The multicategory angle-based support vector machine (MASVM) is a computationally efficient method for multicategory classification problems, which constructs a decision function without the sum-to-zero constraint. To further reduce computational costs in linear MASVM, two safe sample screening methods are proposed: the gap safe rule (MAGSR) and the dual screening with variational inequalities (MADVI). A two-stage screening framework combining MAGSR and MADVI together is then developed. Extensive simulations and real applications show the great advantage of the proposed methods in computation, compared with existing approaches. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Reinforced Angle-Based Multicategory Support Vector Machines
    Zhang, Chong
    Liu, Yufeng
    Wang, Junhui
    Zhu, Hongtu
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2016, 25 (03) : 806 - 825
  • [2] A safe sample screening rule for Universum support vector machines
    Zhao, Jiang
    Xu, Yitian
    [J]. KNOWLEDGE-BASED SYSTEMS, 2017, 138 : 46 - 57
  • [3] Safe screening rules for multi-view support vector machines
    Wang, Huiru
    Zhu, Jiayi
    Zhang, Siyuan
    [J]. NEURAL NETWORKS, 2023, 166 : 326 - 343
  • [4] The consistency of multicategory support vector machines
    Chen, DR
    Xiang, DH
    [J]. ADVANCES IN COMPUTATIONAL MATHEMATICS, 2006, 24 (1-4) : 155 - 169
  • [5] Reinforced Multicategory Support Vector Machines
    Liu, Yufeng
    Yuan, Ming
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2011, 20 (04) : 901 - 919
  • [6] Multicategory Classification by Support Vector Machines
    Erin J. Bredensteiner
    Kristin P. Bennett
    [J]. Computational Optimization and Applications, 1999, 12 : 53 - 79
  • [7] Multicategory classification by support vector machines
    Bredensteiner, EJ
    Bennett, KP
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 12 (1-3) : 53 - 79
  • [8] The consistency of multicategory support vector machines
    Di-Rong Chen
    Dao-Hong Xiang
    [J]. Advances in Computational Mathematics, 2006, 24 : 155 - 169
  • [9] Angle-based twin support vector machine
    Reshma Khemchandani
    Pooja Saigal
    Suresh Chandra
    [J]. Annals of Operations Research, 2018, 269 : 387 - 417
  • [10] Angle-based twin support vector machine
    Khemchandani, Reshma
    Saigal, Pooja
    Chandra, Suresh
    [J]. ANNALS OF OPERATIONS RESEARCH, 2018, 269 (1-2) : 387 - 417