Learning intersections and thresholds of halfspaces

被引:0
|
作者
Klivans, AR [1 ]
O'Donnell, R [1 ]
Servedio, RA [1 ]
机构
[1] MIT, Dept Math, Cambridge, MA 02139 USA
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We give the first polynomial time algorithm to learn any function of a constant number of halfspaces under the uniform distribution to within any constant error parameter We also give the first quasipolynomial time algorithm for learning any function of a polylog number of polynomial-weight halfspaces under any distribution. As special cases of these results we obtain algorithms for learning intersections and thresholds of halfspaces. Our uniform distribution learning algorithms involve a novel non-geometric approach to learning halfspaces; we use Fourier techniques together with a careful analysis of the noise sensitivity of functions of halfspaces. Our algorithms for learning under any distribution use techniques from real approximation theory to construct low degree polynomial threshold functions.
引用
下载
收藏
页码:177 / 186
页数:10
相关论文
共 50 条
  • [31] Private Center Points and Learning of Halfspaces
    Beimel, Amos
    Moran, Shay
    Nissim, Kobbi
    Stemmer, Uri
    [J]. CONFERENCE ON LEARNING THEORY, VOL 99, 2019, 99
  • [32] Efficient Active Learning of Halfspaces: An Aggressive Approach
    Gonen, Alon
    Sabato, Sivan
    Shalev-Shwartz, Shai
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2013, 14 : 2583 - 2615
  • [33] Efficiently Learning Halfspaces with Tsybakov Noise
    Diakonikolas, Ilias
    Kane, Daniel M.
    Kontonis, Vasilis
    Tzamos, Christos
    Zarifis, Nikos
    [J]. STOC '21: PROCEEDINGS OF THE 53RD ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING, 2021, : 88 - 101
  • [34] ON AGNOSTIC LEARNING OF PARITIES, MONOMIALS, AND HALFSPACES
    Feldman, Vitaly
    Gopalan, Parikshit
    Khot, Subhash
    Ponnuswami, Ashok Kumar
    [J]. SIAM JOURNAL ON COMPUTING, 2009, 39 (02) : 606 - 645
  • [35] Learning nested halfspaces and uphill decision trees
    Kalai, Adam Tauman
    [J]. LEARNING THEORY, PROCEEDINGS, 2007, 4539 : 378 - 392
  • [36] Baum's Algorithm Learns Intersections of Halfspaces with Respect to Log-Concave Distributions
    Klivans, Adam R.
    Long, Philip M.
    Tang, Alex K.
    [J]. APPROXIMATION, RANDOMIZATION, AND COMBINATORIAL OPTIMIZATION: ALGORITHMS AND TECHNIQUES, 2009, 5687 : 588 - 600
  • [37] Cryptographic Hardness of Learning Halfspaces with Massart Noise
    Diakonikolas, Ilias
    Kane, Daniel M.
    Manurangsi, Pasin
    Ren, Lisheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [38] Efficient active learning of halfspaces: An aggressive approach
    Gonen, Alon
    Sabato, Sivan
    Shalev-Shwartz, Shai
    [J]. 1600, Microtome Publishing (14): : 2513 - 2615
  • [39] Point Location and Active Learning: Learning Halfspaces Almost Optimally
    Hopkins, Max
    Kane, Daniel
    Lovett, Shachar
    Mahajan, Gaurav
    [J]. 2020 IEEE 61ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS 2020), 2020, : 1034 - 1044
  • [40] A Random Sampling Algorithm for Learning an Intersection of Halfspaces
    Vempala, Santosh S.
    [J]. 2010 IEEE 51ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 2010, : 123 - 123