Optimal algorithms for continuous non-monotone submodular and DR-submodular maximization

被引:0
|
作者
Niazadeh, Rad [1 ]
Roughgarden, Tim [2 ]
Wang, Joshua R. [3 ]
机构
[1] Chicago Booth School of Business, University of Chicago, 5807 S Woodlawn Ave, Chicago,IL,60637, United States
[2] Department of Computer Science, Columbia University, 500 West 120th Street, Room 450, New York,NY,10027, United States
[3] Google Research, 1600 Amphitheatre Pkwy, Mountain View,CA,94043, United States
来源
关键词
Game theory - Machine learning;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper we study the fundamental problems of maximizing a continuous nonmonotone submodular function over the hypercube, both with and without coordinate-wise concavity. This family of optimization problems has several applications in machine learning, economics, and communication systems. Our main result is the first 1/2-approximation algorithm for continuous submodular function maximization; this approximation factor of 1/2 is the best possible for algorithms that only query the objective function at polynomially many points. For the special case of DR-submodular maximization, i.e. when the submodular function is also coordinate-wise concave along all coordinates, we provide a different 1/2 -approximation algorithm that runs in quasi-linear time. Both these results improve upon prior work (Bian et al., 2017a, b; Soma and Yoshida, 2017). Our first algorithm uses novel ideas such as reducing the guaranteed approximation problem to analyzing a zero-sum game for each coordinate, and incorporates the geometry of this zero-sum game to fix the value at this coordinate. Our second algorithm exploits coordinate-wise concavity to identify a monotone equilibrium condition sufficient for getting the required approximation guarantee, and hunts for the equilibrium point using binary search. We further run experiments to verify the performance of our proposed algorithms in related machine learning applications. © 2020 Rad Niazadeh, Tim Roughgarden, Joshua R. Wang.
引用
下载
收藏
相关论文
共 50 条
  • [1] Optimal Algorithms for Continuous Non-monotone Submodular and DR-Submodular Maximization
    Niazadeh, Rad
    Roughgarden, Tim
    Wang, Joshua R.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [2] Optimal Algorithms for Continuous Non-monotone Submodular and DR-Submodular Maximization
    Niazadeh, Rad
    Roughgarden, Tim
    Wang, Joshua R.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [3] Online Non-Monotone DR-Submodular Maximization
    Nguyen Kim Thang
    Srivastav, Abhinav
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9868 - 9876
  • [4] Non-Monotone DR-Submodular Function Maximization
    Soma, Tasuku
    Yoshida, Yuichi
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 898 - 904
  • [5] Parallel Algorithm for Non-Monotone DR-Submodular Maximization
    Ene, Alina
    Nguyen, Huy L.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [6] Parallel Algorithm for Non-Monotone DR-Submodular Maximization
    Ene, Alina
    Nguyen, Huy L.
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [7] Profit maximization in social networks and non-monotone DR-submodular maximization
    Gu, Shuyang
    Gao, Chuangen
    Huang, Jun
    Wu, Weili
    THEORETICAL COMPUTER SCIENCE, 2023, 957
  • [8] Non-monotone DR-submodular Maximization over General Convex Sets
    Durr, Christoph
    Nguyen Kim Thang
    Srivastav, Abhinav
    Tible, Leo
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2148 - 2154
  • [9] Continuous DR-submodular Maximization: Structure and Algorithms
    Bian, An
    Levy, Kfir Y.
    Krause, Andreas
    Buhmann, Joachim M.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [10] A fast double greedy algorithm for non-monotone DR-submodular function maximization
    Gu, Shuyang
    Shi, Ganquan
    Wu, Weili
    Lu, Changhong
    DISCRETE MATHEMATICS ALGORITHMS AND APPLICATIONS, 2020, 12 (01)