Decentralized Randomized Block-Coordinate Frank-Wolfe Algorithms for Submodular Maximization Over Networks

被引:2
|
作者
Zhang, Mingchuan [1 ]
Zhou, Yangfan [1 ]
Ge, Quanbo [2 ]
Zheng, Ruijuan [1 ]
Wu, Qingtao [1 ]
机构
[1] Henan Univ Sci & Technol, Sch Informat Engn, Luoyang 471023, Peoples R China
[2] Tongji Univ, Sch Elect & Informat Engn, Shanghai 200092, Peoples R China
基金
中国国家自然科学基金;
关键词
Optimization; Approximation algorithms; Heuristic algorithms; Convergence; Greedy algorithms; Linear programming; Germanium; Conditional gradient methods; decentralized optimization; randomized block-coordinate descent; submodular maximization; DISTRIBUTED OPTIMIZATION; CONSENSUS; CONVERGENCE; CONVEX;
D O I
10.1109/TSMC.2021.3112691
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider decentralized large-scale continuous submodular constrained optimization problems over networks, where the goal is to maximize a sum of nonconvex functions with diminishing returns property. However, the computations of the projection step and the whole gradient can become prohibitive in high-dimensional constrained optimization problems. For this reason, a decentralized randomized block-coordinate Frank-Wolfe algorithm is proposed for submoduar maximization over networks by local communication and computation, which adopts the randomized block-coordinate descent and the Frank-Wolfe technique. We also show that the proposed algorithm converges to an approximation fact (1-e(-pmax)/(pmin)) of the global maximal points at a rate of O(1/T) by choosing a suitable stepsize, where T is the number of iterations. In addition, we confirm the theoretical results by experiments.
引用
下载
收藏
页码:5081 / 5091
页数:11
相关论文
共 19 条
  • [1] Parallel and Distributed Block-Coordinate Frank-Wolfe Algorithms
    Wang, Yu-Xiang
    Sadhanala, Veeranjaneyulu
    Dai, Wei
    Neiswanger, Willie
    Sra, Suvrit
    Xing, Eric P.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [2] Randomised block-coordinate Frank-Wolfe algorithm for distributed online learning over networks
    Li, Jingchao
    Wu, Qingtao
    Zheng, Ruijuan
    Zhu, Junlong
    Ge, Quanbo
    Zhang, Mingchuan
    COGNITIVE COMPUTATION AND SYSTEMS, 2020, 2 (02) : 72 - 79
  • [3] MAP inference via Block-Coordinate Frank-Wolfe Algorithm
    Swoboda, Paul
    Kolmogorov, Vladimir
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11138 - 11147
  • [4] Stochastic Block-Coordinate Gradient Projection Algorithms for Submodular Maximization
    Li, Zhigang
    Zhang, Mingchuan
    Zhu, Junlong
    Zheng, Ruijuan
    Zhang, Qikun
    Wu, Qingtao
    COMPLEXITY, 2018,
  • [5] Sample Efficient Decentralized Stochastic Frank-Wolfe Methods for Continuous DR-Submodular Maximization
    Gao, Hongchang
    Xu, Hanzi
    Vucetic, Slobodan
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3501 - 3507
  • [6] BLOCK-COORDINATE FRANK-WOLFE ALGORITHM AND CONVERGENCE ANALYSIS FOR SEMI-RELAXED OPTIMAL TRANSPORT PROBLEM
    Fukunaga, Takumi
    Kasai, Hiroyuki
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5433 - 5437
  • [7] A Multi-Plane Block-Coordinate Frank-Wolfe Algorithm for Training Structural SVMs with a Costly max-Oracle
    Shah, Neel
    Kolmogorov, Vladimir
    Lampert, Christoph H.
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2737 - 2745
  • [8] A privacy-preserving decentralized randomized block-coordinate subgradient algorithm over time-varying networks
    Wang, Lin
    Zhang, Mingchuan
    Zhu, Junlong
    Xing, Ling
    Wu, Qingtao
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 208
  • [9] A privacy-preserving decentralized randomized block-coordinate subgradient algorithm over time-varying networks
    Wang, Lin
    Zhang, Mingchuan
    Zhu, Junlong
    Xing, Ling
    Wu, Qingtao
    Expert Systems with Applications, 2022, 208
  • [10] Randomized Block Frank-Wolfe for Convergent Large-Scale Learning
    Zhang, Liang
    Wang, Gang
    Romero, Daniel
    Giannakis, Georgios B.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (24) : 6448 - 6461