Distributed projection-free algorithm for constrained aggregative optimization

被引:4
|
作者
Wang, Tongyu [1 ,2 ]
Yi, Peng [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai, Peoples R China
[2] Shanghai Res Inst Intelligent Autonomous Syst, Shanghai, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai, Peoples R China
[4] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
aggregative optimization; distributed algorithm; gradient projection-free; time-varying graph; FRANK-WOLFE ALGORITHM; CONVEX; GAMES;
D O I
10.1002/rnc.6640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of all agents' decision variables. The decision variable is constrained within a feasible set. In order to minimize the sum of the cost functions when each agent only knows its local cost function, we propose a distributed Frank-Wolfe algorithm based on gradient tracking for the aggregative optimization problem where each node maintains two estimates, namely an estimate of the sum of agents' decision variable and an estimate of the gradient of global function. The algorithm is projection-free, but only involves solving a linear optimization to get a search direction at each step. We show the convergence of the proposed algorithm for convex and smooth objective functions over a time-varying network. Finally, we demonstrate the convergence and computational efficiency of the proposed algorithm via numerical simulations.
引用
收藏
页码:5273 / 5288
页数:16
相关论文
共 50 条
  • [31] Efficient projection-free online convex optimization using stochastic gradients
    Jiahao Xie
    Chao Zhang
    Zebang Shen
    Hui Qian
    Machine Learning, 2025, 114 (4)
  • [32] Compressed Gradient Tracking Algorithm for Distributed Aggregative Optimization
    Chen, Liyuan
    Wen, Guanghui
    Liu, Hongzhe
    Yu, Wenwu
    Cao, Jinde
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (10) : 6576 - 6591
  • [33] Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity
    Chen, Lin
    Harshaw, Christopher
    Hassani, Hamed
    Karbasi, Amin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [34] Projection-Free Bandit Convex Optimization over Strongly Convex Sets
    Zhang, Chenxu
    Wang, Yibo
    Tian, Peng
    Cheng, Xiao
    Wan, Yuanyu
    Song, Mingli
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT III, PAKDD 2024, 2024, 14647 : 118 - 129
  • [35] Riemannian Projection-free Online Learning
    Hu, Zihao
    Wang, Guanghui
    Abernethy, Jacob
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [36] Projection-Free Online Convex Optimization via Efficient Newton Iterations
    Gatmiry, Khashayar
    Mhammedi, Zakaria
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] A Learning-based Distributed Algorithm for Personalized Aggregative Optimization
    Carnevale, Guido
    Notarstefano, Giuseppe
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 1576 - 1581
  • [38] Projection-free Online Learning in Dynamic Environments
    Wan, Yuanyu
    Xue, Bo
    Zhang, Lijun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10067 - 10075
  • [39] Fixed-Time Projection Algorithm for Distributed Constrained Optimization on Time-Varying Digraphs
    Chen, Gang
    Yang, Qing
    Song, Yongduan
    Lewis, Frank L.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (01) : 390 - 397
  • [40] Distributed Randomized Gradient-Free Mirror Descent Algorithm for Constrained Optimization
    Yu, Zhan
    Ho, Daniel W. C.
    Yuan, Deming
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (02) : 957 - 964