The Power of Subsampling in Submodular Maximization

被引:3
|
作者
Harshaw, Christopher [1 ]
Kazemi, Ehsan [2 ]
Feldman, Moran [3 ]
Karbasi, Amin [1 ,4 ,5 ]
机构
[1] Yale Univ, Dept Comp Sci, New Haven, CT 06520 USA
[2] Google, CH-8002 Zurich, Switzerland
[3] Univ Haifa, Dept Comp Sci, IL-3498838 Haifa, Israel
[4] Yale Univ, Dept Elect Engn, New Haven, CT 06520 USA
[5] Yale Univ, Dept Stat & Data Sci, New Haven, CT 06520 USA
基金
美国国家科学基金会; 以色列科学基金会;
关键词
submodular maximization; subsampling; streaming algorithms; approximation algorithms; p-extendible systems; p-matchoids; APPROXIMATIONS; ALGORITHM; GREEDY;
D O I
10.1287/moor.2021.1172
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We propose subsampling as a unified algorithmic technique for submodular maximization in centralized and online settings. The idea is simple: independently sample elements from the ground set and use simple combinatorial techniques (such as greedy or local search) on these sampled elements. We show that this approach leads to optimal/state-of-the-art results despite being much simpler than existing methods. In the usual off-line setting, we present SAMPLEGREEDY, which obtains a (p + 2 + o(1))-approximation for maximizing a submodular function subject to a p-extendible system using O(n + nk/p) evaluation and feasibility queries, where k is the size of the largest feasible set. The approximation ratio improves to p + 1 and p for monotone submodular and linear objectives, respectively. In the streaming setting, we present Sample-Streaming, which obtains a (4p + 2 - o(1))-approximation for maximizing a submodular function subject to a p-matchoid using O(k) memory and O(km/p) evaluation and feasibility queries per element, and m is the number of matroids defining the p-matchoid. The approximation ratio improves to 4p for monotone submodular objectives. We empirically demonstrate the effectiveness of our algorithms on video summarization, location summarization, and movie recommendation tasks.
引用
收藏
页码:1365 / 1393
页数:29
相关论文
共 50 条
  • [1] Do Less, Get More: Streaming Submodular Maximization with Subsampling
    Feldman, Moran
    Karbasi, Amin
    Kazemi, Ehsan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [2] The Power of Randomization: Distributed Submodular Maximization on Massive Datasets
    Barbosa, Rafael
    Ene, Alina
    Le Nguyen, Huy
    Ward, Justin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 : 1236 - 1244
  • [3] Distributed Maximization of Submodular and Approximately Submodular Functions
    Ye, Lintao
    Sundaram, Shreyas
    2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 2979 - 2984
  • [4] Distributed Submodular Maximization
    Mirzasoleiman, Baharan
    Karbasi, Amin
    Sarkar, Rik
    Krause, Andreas
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [5] Differentiable Submodular Maximization
    Tschiatschek, Sebastian
    Sahin, Aytunc
    Krause, Andreas
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2731 - 2738
  • [6] Stochastic Submodular Maximization
    Asadpour, Arash
    Nazerzadeh, Hamid
    Saberi, Amin
    INTERNET AND NETWORK ECONOMICS, PROCEEDINGS, 2008, 5385 : 477 - 489
  • [7] Online Continuous Submodular Maximization
    Chen, Lin
    Hassani, Hamed
    Karbasi, Amin
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [8] Robust Sequence Submodular Maximization
    Sallam, Gamal
    Zheng, Zizhan
    Wu, Jie
    Ji, Bo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [9] Robust Adaptive Submodular Maximization
    Tang, Shaojie
    INFORMS JOURNAL ON COMPUTING, 2022, 34 (06) : 3277 - 3291
  • [10] Regularized Submodular Maximization at Scale
    Kazemi, Ehsan
    Minaee, Shervin
    Feldman, Moran
    Karbasi, Amin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139