Efficient Testable Learning of Halfspaces with Adversarial Label Noise

被引:0
|
作者
Diakonikolas, Ilias [1 ]
Kane, Daniel M. [2 ]
Kontonis, Vasilis [3 ]
Liu, Sihan [2 ]
Zarifis, Nikos [1 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
[3] Univ Texas Austin, Austin, TX 78712 USA
关键词
MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a tester-learner such that if the data passes the tester, then one can trust the output of the robust learner on the data. Our tester-learner runs in time poly(d/epsilon) and outputs a halfspace with misclassification error O(opt) + epsilon, where opt is the 0-1 error of the best fitting halfspace. At a technical level, our algorithm employs an iterative soft localization technique enhanced with appropriate testers to ensure that the data distribution is sufficiently similar to a Gaussian. Finally, our algorithm can be readily adapted to yield an efficient and testable active learner requiring only d polylog(1/epsilon) labeled examples.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] IDENTIFYMIX: AN EFFICIENT TWO-STAGE LEARNING APPROACH TO COMBATING LABEL NOISE
    Tong K.
    Ke X.
    [J]. Journal of Applied and Numerical Optimization, 2023, 5 (02): : 237 - 253
  • [42] Information-Computation Tradeoffs for Learning Margin Halfspaces with Random Classification Noise
    Diakonikolas, Ilias
    Diakonikolas, Jelena
    Kane, Daniel
    Wang, Puqian
    Zarifis, Nikos
    [J]. THIRTY SIXTH ANNUAL CONFERENCE ON LEARNING THEORY, VOL 195, 2023, 195
  • [43] Efficient Interactive Coding Against Adversarial Noise
    Brakerski, Zvika
    Kalai, Yael Tauman
    [J]. 2012 IEEE 53RD ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2012, : 160 - 166
  • [44] Learning intersections and thresholds of halfspaces
    Klivans, AR
    O'Donnell, R
    Servedio, RA
    [J]. FOCS 2002: 43RD ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2002, : 177 - 186
  • [45] Learning intersections of halfspaces with a margin
    Klivans, AR
    Servedio, RA
    [J]. LEARNING THEORY, PROCEEDINGS, 2004, 3120 : 348 - 362
  • [46] Learning intersections and thresholds of halfspaces
    Klivans, AR
    O'Donnell, R
    Servedio, RA
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2004, 68 (04) : 808 - 840
  • [47] Learning intersections of halfspaces with a margin
    Klivans, Adam R.
    Servedio, Rocco A.
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2008, 74 (01) : 35 - 48
  • [48] Efficient Algorithms for Adversarial Contextual Learning
    Syrgkanis, Vasilis
    Krishnamurthy, Akshay
    Schapire, Robert E.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [49] Efficient Reinforcement Learning in Adversarial Games
    Skoulakis, Ioannis E.
    Lagoudakis, Michail G.
    [J]. 2012 IEEE 24TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2012), VOL 1, 2012, : 704 - 711
  • [50] Learning from Label Proportions with Generative Adversarial Networks
    Liu, Jiabin
    Wang, Bo
    Qi, Zhiquan
    Tian, Yingjie
    Shi, Yong
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32