L1-penalized AUC-optimization with a surrogate loss

被引:0
|
作者
Kim, Hyungwoo [1 ]
Shin, Seung Jun [2 ]
机构
[1] Pukyong Natl Univ, Dept Stat & Data Sci, 45 Yongso Ro, Pusan 04853, Guam, South Korea
[2] Korea Univ, Dept Stat, Seoul 136701, South Korea
基金
新加坡国家研究基金会;
关键词
AUC-optimization; AUC consistency; variable selection; L-1-norm penalty; clustering and proximal gradient descent; SUPPORT; AREA;
D O I
10.29220/CSAM.2024.31.2.203
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The area under the ROC curve (AUC) is one of the most common criteria used to measure the overall performance of binary classifiers for a wide range of machine learning problems. In this article, we propose a L-1 -penalized AUC-optimization classifier that directly maximizes the AUC for high -dimensional data. Toward this, we employ the AUC-consistent surrogate loss function and combine the L-1 -norm penalty which enables us to estimate coefficients and select informative variables simultaneously. In addition, we develop an efficient optimization algorithm by adopting k -means clustering and proximal gradient descent which enjoys computational advantages to obtain solutions for the proposed method. Numerical simulation studies demonstrate that the proposed method shows promising performance in terms of prediction accuracy, variable selectivity, and computational costs.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Penalized maximum likelihood estimation with l(1) penalty
    Loubes, J-M
    Yan, Y.
    [J]. INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS & STATISTICS, 2009, 14 (J09): : 35 - 46
  • [42] Generalized L1 penalized matrix factorization
    Rasmussen, Morten Arendt
    [J]. JOURNAL OF CHEMOMETRICS, 2017, 31 (04)
  • [43] Least angle and l(1) penalized regression: A review
    Hesterberg, Tim
    Choi, Nam Hee
    Meier, Lukas
    Fraley, Chris
    [J]. STATISTICS SURVEYS, 2008, 2 : 61 - 93
  • [44] Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classification
    Yuan, Zhuoning
    Yan, Yan
    Sonka, Milan
    Yang, Tianbao
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3020 - 3029
  • [45] L1 Penalized Sequential Convex Programming for Fast Trajectory Optimization: With Application to Optimal Missile Guidance
    Heekun Roh
    Young-Jae Oh
    Min-Jea Tahk
    Ki-Jeong Kwon
    Hyuck-Hoon Kwon
    [J]. International Journal of Aeronautical and Space Sciences, 2020, 21 : 493 - 503
  • [46] Penalized high-dimensional M-quantile regression: From L1 to Lp optimization
    Hu, Jie
    Chen, Yu
    Zhang, Weiping
    Guo, Xiao
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2021, 49 (03): : 875 - 905
  • [47] L1 Penalized Sequential Convex Programming for Fast Trajectory Optimization: With Application to Optimal Missile Guidance
    Roh, Heekun
    Oh, Young-Jae
    Tahk, Min-Jea
    Kwon, Ki-Jeong
    Kwon, Hyuck-Hoon
    [J]. INTERNATIONAL JOURNAL OF AERONAUTICAL AND SPACE SCIENCES, 2020, 21 (02) : 493 - 503
  • [48] Penalized Entropy: a novel loss function for uncertainty estimation and optimization in medical image classification
    Feng, Dehua
    Chen, Xi
    Wang, Xiaoyu
    Lv, Jiahuan
    Bai, Ling
    Zhang, Shu
    Zhou, Zhiguo
    [J]. 2022 IEEE 35TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2022, : 306 - 310
  • [49] The l1 penalized decoder and its reweighted LP
    Liu, Xishuo
    Draper, Stark C.
    Recht, Benjamin
    [J]. 2012 50TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2012, : 1572 - 1579
  • [50] Consistency of l1 penalized negative binomial regressions
    Xie, Fang
    Xiao, Zhijie
    [J]. STATISTICS & PROBABILITY LETTERS, 2020, 165