Distributed projection-free algorithm for constrained aggregative optimization

被引:4
|
作者
Wang, Tongyu [1 ,2 ]
Yi, Peng [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai, Peoples R China
[2] Shanghai Res Inst Intelligent Autonomous Syst, Shanghai, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai, Peoples R China
[4] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
aggregative optimization; distributed algorithm; gradient projection-free; time-varying graph; FRANK-WOLFE ALGORITHM; CONVEX; GAMES;
D O I
10.1002/rnc.6640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of all agents' decision variables. The decision variable is constrained within a feasible set. In order to minimize the sum of the cost functions when each agent only knows its local cost function, we propose a distributed Frank-Wolfe algorithm based on gradient tracking for the aggregative optimization problem where each node maintains two estimates, namely an estimate of the sum of agents' decision variable and an estimate of the gradient of global function. The algorithm is projection-free, but only involves solving a linear optimization to get a search direction at each step. We show the convergence of the proposed algorithm for convex and smooth objective functions over a time-varying network. Finally, we demonstrate the convergence and computational efficiency of the proposed algorithm via numerical simulations.
引用
收藏
页码:5273 / 5288
页数:16
相关论文
共 50 条
  • [41] Structured Projection-free Online Convex Optimization with Multi-point Bandit Feedback
    Ding, Yuhao
    Lavaei, Javad
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 954 - 961
  • [42] Frank–Wolfe and friends: a journey into projection-free first-order optimization methods
    Immanuel M. Bomze
    Francesco Rinaldi
    Damiano Zeffiro
    4OR, 2021, 19 : 313 - 345
  • [43] Projection-free Adaptive Regret with Membership Oracles
    Lu, Zhou
    Brukhim, Nataly
    Gradu, Paula
    Hazan, Elad
    INTERNATIONAL CONFERENCE ON ALGORITHMIC LEARNING THEORY, VOL 201, 2023, 201 : 1055 - 1073
  • [44] Distributed Random Projection Algorithm for Convex Optimization
    Lee, Soomin
    Nedic, Angelia
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2013, 7 (02) : 221 - 229
  • [45] Distributed Subgradient Projection Algorithm for Convex Optimization
    Ram, S. Sundhar
    Nedic, A.
    Veeravalli, V. V.
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 3653 - 3656
  • [46] Accelerated Stochastic Gradient-free and Projection-free Methods
    Huang, Feihu
    Tao, Lue
    Chen, Songcan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [47] A Distributed Robust Two-Time-Scale Switched Algorithm for Constrained Aggregative Games
    Wang, Xue-Fang
    Teel, Andrew R.
    Sun, Xi-Ming
    Liu, Kun-Zhi
    Shao, Guangru
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (11) : 6525 - 6540
  • [48] Distributed Smoothing Projection Neurodynamic Approaches for Constrained Nonsmooth Optimization
    Zhao, You
    Liao, Xiaofeng
    He, Xing
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (02): : 675 - 688
  • [49] Projection-Free Methods for Stochastic Simple Bilevel Optimization with Convex Lower-level Problem
    Cao, Jincheng
    Jiang, Ruichen
    Abolfazli, Nazanin
    Hamedani, Erfan Yazdandoost
    Mokhtari, Aryan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,