Principal weighted support vector machines for sufficient dimension reduction in binary classification

被引:31
|
作者
Shin, Seung Jun [1 ]
Wu, Yichao [2 ]
Zhang, Hao Helen [3 ]
Liu, Yufeng [4 ]
机构
[1] Korea Univ, Dept Stat, Seoul 02841, South Korea
[2] North Carolina State Univ, Dept Stat, 2311 Stinson Dr,Campus Box 8203, Raleigh, NC 27695 USA
[3] Univ Arizona, Dept Math, 617 North Santa Rita Ave,POB 210089, Tucson, AZ 85721 USA
[4] Univ North Carolina Chapel Hill, Dept Stat & Operat Res, 354 Hanes Hall, Chapel Hill, NC 27599 USA
基金
新加坡国家研究基金会; 美国国家卫生研究院; 美国国家科学基金会;
关键词
Fisher consistency; Hyperplane alignment; Reproducing kernel Hilbert space; Weighted support vector machine; SLICED INVERSE REGRESSION; CENTRAL SUBSPACE; HESSIAN DIRECTIONS;
D O I
10.1093/biomet/asw057
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sufficient dimension reduction is popular for reducing data dimensionality without stringent model assumptions. However, most existing methods may work poorly for binary classification. For example, sliced inverse regression (Li, 1991) can estimate at most one direction if the response is binary. In this paper we propose principal weighted support vector machines, a unified framework for linear and nonlinear sufficient dimension reduction in binary classification. Its asymptotic properties are studied, and an efficient computing algorithm is proposed. Numerical examples demonstrate its performance in binary classification.
引用
收藏
页码:67 / 81
页数:15
相关论文
共 50 条
  • [41] Density-weighted support vector machines for binary class imbalance learning
    Barenya Bikash Hazarika
    Deepak Gupta
    Neural Computing and Applications, 2021, 33 : 4243 - 4261
  • [42] Weighted relaxed support vector machines
    Seref, Onur
    Razzaghi, Talayeh
    Xanthopoulos, Petros
    ANNALS OF OPERATIONS RESEARCH, 2017, 249 (1-2) : 235 - 271
  • [43] Support Vector Machines with Weighted Regularization
    Yokota, Tatsuya
    Yamashita, Yukihiko
    NEURAL INFORMATION PROCESSING, PT II, 2011, 7063 : 471 - 480
  • [44] Weighted relaxed support vector machines
    Onur Şeref
    Talayeh Razzaghi
    Petros Xanthopoulos
    Annals of Operations Research, 2017, 249 : 235 - 271
  • [45] Feature reduction using Support Vector Machines for binary gas detection
    Maldonado-Bascón, S
    Al-Khalifa, S
    López-Ferreras, F
    ARTIFICIAL NEURAL NETS PROBLEM SOLVING METHODS, PT II, 2003, 2687 : 798 - 805
  • [46] Contextual PolSAR image classification using fractal dimension and support vector machines
    Aghababaee, Hossein
    Amini, Jalal
    Tzeng, Yu-Chang
    EUROPEAN JOURNAL OF REMOTE SENSING, 2013, 46 : 317 - 332
  • [47] Principal quantile regression for sufficient dimension reduction with heteroscedasticity
    Wang, Chong
    Shin, Seung Jun
    Wu, Yichao
    ELECTRONIC JOURNAL OF STATISTICS, 2018, 12 (02): : 2114 - 2140
  • [48] WEIGHTED SUPPORT VECTOR MACHINES FOR TREE SPECIES CLASSIFICATION USING LIDAR DATA
    Hoang Minh Nguyen
    Demir, Beguem
    Dalponte, Michele
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 6740 - 6743
  • [49] Feature weighted confidence to incorporate prior knowledge into support vector machines for classification
    Zhang, Wen
    Yu, Lean
    Yoshida, Taketoshi
    Wang, Qing
    KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 58 (02) : 371 - 397
  • [50] Time-weighted Fuzzy Support Vector Machines for classification in changing environments
    Maldonado, Sebastian
    Lopez, Julio
    Vairetti, Carla
    INFORMATION SCIENCES, 2021, 559 : 97 - 110