Optimal algorithms for continuous non-monotone submodular and DR-submodular maximization

被引:0
|
作者
Niazadeh, Rad [1 ]
Roughgarden, Tim [2 ]
Wang, Joshua R. [3 ]
机构
[1] Chicago Booth School of Business, University of Chicago, 5807 S Woodlawn Ave, Chicago,IL,60637, United States
[2] Department of Computer Science, Columbia University, 500 West 120th Street, Room 450, New York,NY,10027, United States
[3] Google Research, 1600 Amphitheatre Pkwy, Mountain View,CA,94043, United States
来源
关键词
Game theory - Machine learning;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper we study the fundamental problems of maximizing a continuous nonmonotone submodular function over the hypercube, both with and without coordinate-wise concavity. This family of optimization problems has several applications in machine learning, economics, and communication systems. Our main result is the first 1/2-approximation algorithm for continuous submodular function maximization; this approximation factor of 1/2 is the best possible for algorithms that only query the objective function at polynomially many points. For the special case of DR-submodular maximization, i.e. when the submodular function is also coordinate-wise concave along all coordinates, we provide a different 1/2 -approximation algorithm that runs in quasi-linear time. Both these results improve upon prior work (Bian et al., 2017a, b; Soma and Yoshida, 2017). Our first algorithm uses novel ideas such as reducing the guaranteed approximation problem to analyzing a zero-sum game for each coordinate, and incorporates the geometry of this zero-sum game to fix the value at this coordinate. Our second algorithm exploits coordinate-wise concavity to identify a monotone equilibrium condition sufficient for getting the required approximation guarantee, and hunts for the equilibrium point using binary search. We further run experiments to verify the performance of our proposed algorithms in related machine learning applications. © 2020 Rad Niazadeh, Tim Roughgarden, Joshua R. Wang.
引用
下载
收藏
相关论文
共 50 条
  • [41] Non-monotone Submodular Maximization under Matroid and Knapsack Constraints
    Lee, Jon
    Mirrokni, Vahab S.
    Nagarajan, Viswanath
    Sviridenko, Maxim
    STOC'09: PROCEEDINGS OF THE 2009 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2009, : 323 - 332
  • [42] Bounds on Double-Sided Myopic Algorithms for Unconstrained Non-monotone Submodular Maximization
    Huang, Norman
    Borodin, Allan
    ALGORITHMS AND COMPUTATION, ISAAC 2014, 2014, 8889 : 528 - 539
  • [43] Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization
    Zhang, Qixin
    Deng, Zengde
    Jian, Xiangru
    Chen, Zaiyi
    Hu, Haoyuan
    Yang, Yu
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 3330 - 3339
  • [44] Online non-monotone diminishing return submodular maximization in the bandit setting
    Ju, Jiachen
    Wang, Xiao
    Xu, Dachuan
    JOURNAL OF GLOBAL OPTIMIZATION, 2024, : 619 - 649
  • [45] Efficient Streaming Algorithms for Maximizing Monotone DR-Submodular Function on the Integer Lattice
    Nguyen, Bich-Ngan T.
    Pham, Phuong N. H.
    Le, Van-Vang
    Snasel, Vaclav
    MATHEMATICS, 2022, 10 (20)
  • [46] Subspace Selection via DR-Submodular Maximization on Lattices
    Nakashima, So
    Maehara, Takanori
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4618 - 4625
  • [47] Fast Adaptive Non-Monotone Submodular Maximization Subject to a Knapsack Constraint
    Amanatidis G.
    Fusco F.
    Lazos P.
    Leonardi S.
    Reiffenhäuser R.
    Journal of Artificial Intelligence Research, 2022, 74 : 661 - 690
  • [48] Approximation Algorithms for Size-Constrained Non-Monotone Submodular Maximization in Deterministic Linear Time
    Chen, Yixin
    Kuhnle, Alan
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 250 - 261
  • [49] Fast Adaptive Non-Monotone Submodular Maximization Subject to a Knapsack Constraint
    Amanatidis, Georgios
    Fusco, Federico
    Lazos, Philip
    Leonardi, Stefano
    Reiffenhauser, Rebecca
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2022, 74 : 661 - 690
  • [50] Non-Monotone Submodular Maximization with Multiple Knapsacks in Static and Dynamic Settings
    Doskoc, Vanja
    Friedrich, Tobias
    Gobel, Andreas
    Neumann, Frank
    Neumann, Aneta
    Quinzan, Francesco
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 435 - 442