Learning a Label-Noise Robust Logistic Regression: Analysis and Experiments

被引:0
|
作者
Bootkrajang, Jakramate [1 ]
Kaban, Ata [1 ]
机构
[1] Univ Birmingham, Sch Comp Sci, Birmingham B15 2TT, W Midlands, England
关键词
label noise; logistic regression; robust learning; gradient ascent optimisation; generalisation error bounds; DISCRIMINANT-ANALYSIS; INITIAL SAMPLES; MICROARRAYS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Label-noise robust logistic regression (rLR) is an extension of logistic regression that includes a model of random mislabelling. This paper attempts a theoretical analysis of rLR. By decomposing and interpreting the gradient of the likelihood objective of rLR as employed in gradient ascent optimisation, we get insights into the ability of the rLR learning algorithm to counteract the negative effect of mislabelling as a result of an intrinsic re-weighting mechanism. We also give an upper-bound on the error of rLR using Rademacher complexities.
引用
收藏
页码:569 / 576
页数:8
相关论文
共 50 条
  • [41] Individual Transition Label Noise Logistic Regression in Binary Classification for Incorrectly Labeled Data
    Lee, Seokho
    Jung, Hyelim
    [J]. TECHNOMETRICS, 2022, 64 (01) : 18 - 29
  • [42] Multi-label feature selection based on logistic regression and manifold learning
    Zhang, Yao
    Ma, Yingcang
    Yang, Xiaofei
    [J]. APPLIED INTELLIGENCE, 2022, 52 (08) : 9256 - 9273
  • [43] Multi-label feature selection based on logistic regression and manifold learning
    Yao Zhang
    Yingcang Ma
    Xiaofei Yang
    [J]. Applied Intelligence, 2022, 52 : 9256 - 9273
  • [44] Weighted logistic regression and robust analysis of diverse toxicology data
    Simpson, DG
    Carroll, RJ
    Xie, MG
    Guth, DJ
    [J]. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1996, 25 (11) : 2615 - 2632
  • [45] Adaptive Sample Selection for Robust Learning under Label Noise
    Patel, Deep
    Sastry, P. S.
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 3921 - 3931
  • [46] Robust Deep Softmax Regression Against Label Noise for Unsupervised Domain Adaptation
    Wu, Guangbin
    Zhang, David
    Chen, Weishan
    Zuo, Wangmeng
    Xia, Zhuang
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2019, 33 (07)
  • [47] Deep Multi-Scale U-Net Architecture and Label-Noise Robust Training Strategies for Histopathological Image Segmentation
    Kurian, Nikhil Cherian
    Lohan, Amit
    Verghese, Gregory
    Dharamshi, Nimish
    Meena, Swati
    Li, Mengyuan
    Liu, Fangfang
    Gillet, Cheryl
    Rane, Swapnil
    Grigoriadis, Anita
    Sethi, Amit
    [J]. 2022 IEEE 22ND INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (BIBE 2022), 2022, : 91 - 96
  • [48] Algorithm for the Robust Estimation in Logistic Regression
    Kim, Bu-Yong
    Kahng, Myung Wook
    Choi, Mi-Ae
    [J]. KOREAN JOURNAL OF APPLIED STATISTICS, 2007, 20 (03) : 551 - 559
  • [49] ROBUST BINARY LOGISTIC REGRESSION METHODS
    Li, Hong
    [J]. ADVANCES AND APPLICATIONS IN STATISTICS, 2022, 77 : 93 - 108
  • [50] Robust testing in the logistic regression model
    Bianco, Ana M.
    Martinez, Elena
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2009, 53 (12) : 4095 - 4105