Efficient Testable Learning of Halfspaces with Adversarial Label Noise

被引:0
|
作者
Diakonikolas, Ilias [1 ]
Kane, Daniel M. [2 ]
Kontonis, Vasilis [3 ]
Liu, Sihan [2 ]
Zarifis, Nikos [1 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Univ Calif San Diego, La Jolla, CA 92093 USA
[3] Univ Texas Austin, Austin, TX 78712 USA
关键词
MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a tester-learner such that if the data passes the tester, then one can trust the output of the robust learner on the data. Our tester-learner runs in time poly(d/epsilon) and outputs a halfspace with misclassification error O(opt) + epsilon, where opt is the 0-1 error of the best fitting halfspace. At a technical level, our algorithm employs an iterative soft localization technique enhanced with appropriate testers to ensure that the data distribution is sufficiently similar to a Gaussian. Finally, our algorithm can be readily adapted to yield an efficient and testable active learner requiring only d polylog(1/epsilon) labeled examples.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Learning General Halfspaces with Adversarial Label Noise via Online Gradient Descent
    Diakonikolas, Ilias
    Kontonis, Vasilis
    Tzamos, Christos
    Zarifis, Nikos
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [2] On the Power of Localized Perceptron for Label-Optimal Learning of Halfspaces with Adversarial Noise
    Shen, Jie
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [3] Provable Robustness of Adversarial Training for Learning Halfspaces with Noise
    Zou, Difan
    Frei, Spencer
    Gu, Quanquan
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [4] Non-Convex SGD Learns Halfspaces with Adversarial Label Noise
    Diakonikolas, Ilias
    Kontonis, Vasilis
    Tzamos, Christos
    Zarifis, Nikos
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] Attribute-Efficient Learning of Halfspaces with Malicious Noise: Near-Optimal Label Complexity and Noise Tolerance
    Shen, Jie
    Zhang, Chicheng
    [J]. ALGORITHMIC LEARNING THEORY, VOL 132, 2021, 132
  • [6] Revisiting Perceptron: Efficient and Label-Optimal Learning of Halfspaces
    Yan, Songbai
    Zhang, Chicheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [7] Learning Halfspaces with Malicious Noise
    Klivans, Adam R.
    Long, Philip M.
    Servedio, Rocco A.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 2715 - 2740
  • [8] Wasserstein Adversarial Regularization for Learning With Label Noise
    Fatras, Kilian
    Damodaran, Bharath Bhushan
    Lobry, Sylvain
    Flamary, Remi
    Tuia, Devis
    Courty, Nicolas
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7296 - 7306
  • [9] Learning Halfspaces with Malicious Noise
    Klivans, Adam R.
    Long, Philip M.
    Servedio, Rocco A.
    [J]. AUTOMATA, LANGUAGES AND PROGRAMMING, PT I, 2009, 5555 : 609 - +
  • [10] Hardness of learning halfspaces with noise
    Guruswami, Venkatesan
    Raghavendra, Prasad
    [J]. 47TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2006, : 543 - +