Distributed projection-free algorithm for constrained aggregative optimization

被引:4
|
作者
Wang, Tongyu [1 ,2 ]
Yi, Peng [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai, Peoples R China
[2] Shanghai Res Inst Intelligent Autonomous Syst, Shanghai, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai, Peoples R China
[4] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
aggregative optimization; distributed algorithm; gradient projection-free; time-varying graph; FRANK-WOLFE ALGORITHM; CONVEX; GAMES;
D O I
10.1002/rnc.6640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of all agents' decision variables. The decision variable is constrained within a feasible set. In order to minimize the sum of the cost functions when each agent only knows its local cost function, we propose a distributed Frank-Wolfe algorithm based on gradient tracking for the aggregative optimization problem where each node maintains two estimates, namely an estimate of the sum of agents' decision variable and an estimate of the gradient of global function. The algorithm is projection-free, but only involves solving a linear optimization to get a search direction at each step. We show the convergence of the proposed algorithm for convex and smooth objective functions over a time-varying network. Finally, we demonstrate the convergence and computational efficiency of the proposed algorithm via numerical simulations.
引用
收藏
页码:5273 / 5288
页数:16
相关论文
共 50 条
  • [1] Distributed gradient-free and projection-free algorithm for stochastic constrained optimization
    Hou J.
    Zeng X.
    Chen C.
    Autonomous Intelligent Systems, 2024, 4 (01):
  • [2] A Projection-free Algorithm for Constrained Stochastic Multi-level Composition Optimization
    Xiao, Tesi
    Balasubramanian, Krishnakumar
    Ghadimi, Saeed
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [3] Quantized Distributed Online Projection-Free Convex Optimization
    Zhang, Wentao
    Shi, Yang
    Zhang, Baoyong
    Lu, Kaihong
    Yuan, Deming
    IEEE CONTROL SYSTEMS LETTERS, 2023, 7 : 1837 - 1842
  • [4] Fast Projection-Free Algorithm for Distributed Online Learning in Networks
    Wang, Jun-ya
    Li, De-quan
    Zhou, Yue-jin
    Lv, Jing-ge
    Dong, Qiao
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT), 2018, : 1335 - 1341
  • [5] Distributed Optimization With Projection-Free Dynamics: A Frank-Wolfe Perspective
    Chen, Guanpu
    Yi, Peng
    Hong, Yiguang
    Chen, Jie
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 599 - 610
  • [6] A PROJECTION-FREE DECENTRALIZED ALGORITHM FOR NON-CONVEX OPTIMIZATION
    Wai, Hoi-To
    Scaglione, Anna
    Lafond, Jean
    Moulines, Eric
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 475 - 479
  • [7] Projection-Free Bandit Optimization with Privacy Guarantees
    Ene, Alina
    Nguyen, Huy L.
    Vladu, Adrian
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7322 - 7330
  • [8] A Projection-Free Adaptive Momentum Optimization Algorithm for Mobile Multimedia Computing
    Wang, Lin
    Zhou, Yangfan
    Wang, Xin
    Ji, Zhihang
    Liu, Xin
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [9] Projection-free Distributed Online Learning in Networks
    Zhang, Wenpeng
    Zhao, Peilin
    Zhu, Wenwu
    Hoi, Steven C. H.
    Zhang, Tong
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [10] Projection-Free Bandit Convex Optimization
    Chen, Lin
    Zhang, Mingrui
    Karbasi, Amin
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89