F-measure maximizing logistic regression

被引:0
|
作者
Okabe, Masaaki [1 ]
Tsuchida, Jun [1 ]
Yadohisa, Hiroshi [1 ]
机构
[1] Doshisha Univ, Grad Sch Culture & Informat Sci, Kyoto, Japan
关键词
Density ratio; Discriminant analysis; Imbalanced data; Weighted importance; ROC;
D O I
10.1080/03610918.2022.2081706
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Logistic regression is a widely used method in several fields. When applying logistic regression to imbalanced data, wherein the majority classes dominate the minority classes, all class labels are estimated as "majority class." In this study, we use an F-measure optimization method to improve the performance of logistic regression applied to imbalanced data. Although many F-measure optimization methods adopt a ratio of the estimators to approximate the F-measure, the ratio of the estimators tends to exhibit more bias than when the ratio is directly approximated. Therefore, we employ an approximate F-measure to estimate the relative density ratio. In addition, we define and approximate a relative F-measure. We present an algorithm for a logistic regression weighted approximation relative to the F-measure. The results of an experiment using real world data demonstrate that our proposed algorithm can efficiently improve the performance of logistic regression applied to imbalanced data.
引用
收藏
页码:2554 / 2564
页数:11
相关论文
共 50 条
  • [1] An Adjusted Nearest Neighbor Algorithm Maximizing the F-Measure from Imbalanced Data
    Viola, Remi
    Emonet, Remi
    Habrard, Amaury
    Metzler, Guillaume
    Riou, Sebastien
    Sebban, Marc
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 243 - 250
  • [2] Logistic discrimination based on G-mean and F-measure for imbalanced problem
    Guo, Huaping
    Liu, Hongbing
    Wu, Changan
    Zhi, Weimei
    Xiao, Yan
    She, Wei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2016, 31 (03) : 1155 - 1166
  • [3] The F-measure for Research Priority
    Ronald Rousseau
    Journal of Data and Information Science, 2018, (01) : 1 - 18
  • [4] F*: an interpretable transformation of the F-measure
    David J. Hand
    Peter Christen
    Nishadi Kirielle
    Machine Learning, 2021, 110 : 451 - 456
  • [5] F*: an interpretable transformation of the F-measure
    Hand, David J.
    Christen, Peter
    Kirielle, Nishadi
    MACHINE LEARNING, 2021, 110 (03) : 451 - 456
  • [6] The F-measure for Research Priority
    Ronald Rousseau
    JournalofDataandInformationScience, 2018, 3 (01) : 1 - 18
  • [7] Online F-Measure Optimization
    Busa-Fekete, Robert
    Szorenyi, Balazs
    Dembczynski, Krzysztof
    Huellermeier, Eyke
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [8] The F-measure for Research Priority
    Rousseau, Ronald
    JOURNAL OF DATA AND INFORMATION SCIENCE, 2018, 3 (01) : 1 - 18
  • [9] On the statistical properties of the F-measure
    Chen, TY
    Kuo, FC
    Merkel, R
    QSIC 2004: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON QUALITY SOFTWARE, 2004, : 146 - 153
  • [10] THE EXTENSION THEOREM OF F-MEASURE SPACES
    ZHENG, DP
    FUZZY SETS AND SYSTEMS, 1983, 11 (01) : 19 - 29