Efficient Testable Learning of Halfspaces with Adversarial Label Noise

被引:0
|
作者
Diakonikolas, Ilias [1 ]
Kane, Daniel M. [2 ]
Kontonis, Vasilis [3 ]
Liu, Sihan [2 ]
Zarifis, Nikos [1 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
[3] Univ Texas Austin, Austin, TX 78712 USA
关键词
MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a tester-learner such that if the data passes the tester, then one can trust the output of the robust learner on the data. Our tester-learner runs in time poly(d/epsilon) and outputs a halfspace with misclassification error O(opt) + epsilon, where opt is the 0-1 error of the best fitting halfspace. At a technical level, our algorithm employs an iterative soft localization technique enhanced with appropriate testers to ensure that the data distribution is sufficiently similar to a Gaussian. Finally, our algorithm can be readily adapted to yield an efficient and testable active learner requiring only d polylog(1/epsilon) labeled examples.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Learning General Halfspaces with General Massart Noise under the Gaussian Distribution
    Diakonikolas, Ilias
    Kane, Daniel M.
    Kontonis, Vasilis
    Tzamos, Christos
    Zarifis, Nikos
    [J]. PROCEEDINGS OF THE 54TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING (STOC '22), 2022, : 874 - 885
  • [32] Learning from Label Proportions by Learning with Label Noise
    Zhang, Jianxin
    Wang, Yutong
    Scott, Clayton
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [33] Adversarial Partial Multi-Label Learning with Label Disambiguation
    Yan, Yan
    Guo, Yuhong
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10568 - 10576
  • [34] Nrat: towards adversarial training with inherent label noise
    Chen, Zhen
    Wang, Fu
    Mu, Ronghui
    Xu, Peipei
    Huang, Xiaowei
    Ruan, Wenjie
    [J]. MACHINE LEARNING, 2024, 113 (06) : 3589 - 3610
  • [35] Nrat: towards adversarial training with inherent label noise
    Zhen Chen
    Fu Wang
    Ronghui Mu
    Peipei Xu
    Xiaowei Huang
    Wenjie Ruan
    [J]. Machine Learning, 2024, 113 : 3589 - 3610
  • [36] Label-Noise Robust Generative Adversarial Networks
    Kaneko, Takuhiro
    Ushiku, Yoshitaka
    Harada, Tatsuya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2462 - 2471
  • [37] Agnostically learning halfspaces
    Kalai, Adam Tauman
    Klivans, Adam R.
    Mansour, Yishay
    Servedio, Rocco A.
    [J]. SIAM JOURNAL ON COMPUTING, 2008, 37 (06) : 1777 - 1805
  • [38] Agnostically learning halfspaces
    Kalai, AT
    Klivans, AR
    Mansour, Y
    Servedio, RA
    [J]. 46TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2005, : 11 - 20
  • [39] Near-Optimal Bounds for Learning Gaussian Halfspaces with Random Classification Noise
    Diakonikolas, Ilias
    Diakonikolas, Jelena
    Kane, Daniel M.
    Wang, Puqian
    Zarifis, Nikos
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [40] Reflective Learning With Label Noise
    Wang, Lin
    Xu, Xiangmin
    Guo, Kailing
    Cai, Bolun
    Liu, Fang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) : 3343 - 3357