Distributed projection-free algorithm for constrained aggregative optimization

被引:4
|
作者
Wang, Tongyu [1 ,2 ]
Yi, Peng [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai, Peoples R China
[2] Shanghai Res Inst Intelligent Autonomous Syst, Shanghai, Peoples R China
[3] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai, Peoples R China
[4] Tongji Univ, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
aggregative optimization; distributed algorithm; gradient projection-free; time-varying graph; FRANK-WOLFE ALGORITHM; CONVEX; GAMES;
D O I
10.1002/rnc.6640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of all agents' decision variables. The decision variable is constrained within a feasible set. In order to minimize the sum of the cost functions when each agent only knows its local cost function, we propose a distributed Frank-Wolfe algorithm based on gradient tracking for the aggregative optimization problem where each node maintains two estimates, namely an estimate of the sum of agents' decision variable and an estimate of the gradient of global function. The algorithm is projection-free, but only involves solving a linear optimization to get a search direction at each step. We show the convergence of the proposed algorithm for convex and smooth objective functions over a time-varying network. Finally, we demonstrate the convergence and computational efficiency of the proposed algorithm via numerical simulations.
引用
收藏
页码:5273 / 5288
页数:16
相关论文
共 50 条
  • [21] A distributed gradient algorithm based on randomized block-coordinate and projection-free over networks
    Zhu, Junlong
    Wang, Xin
    Zhang, Mingchuan
    Liu, Muhua
    Wu, Qingtao
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (01) : 267 - 283
  • [22] Improved Regret Bounds for Projection-free Bandit Convex Optimization
    Garber, Dan
    Kretzu, Ben
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 2196 - 2205
  • [23] A distributed gradient algorithm based on randomized block-coordinate and projection-free over networks
    Junlong Zhu
    Xin Wang
    Mingchuan Zhang
    Muhua Liu
    Qingtao Wu
    Complex & Intelligent Systems, 2023, 9 : 267 - 283
  • [24] Distributed Projection-Free Online Learning for Smooth and Convex Losses
    Wang, Yibo
    Wan, Yuanyu
    Zhang, Shimao
    Zhang, Lijun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 8, 2023, : 10226 - 10234
  • [25] Variance-Reduced and Projection-Free Stochastic Optimization
    Hazan, Elad
    Luo, Haipeng
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [26] Projection-Free Stochastic Bi-Level Optimization
    Akhtar, Zeeshan
    Bedi, Amrit Singh
    Thomdapu, Srujan Teja
    Rajawat, Ketan
    IEEE Transactions on Signal Processing, 2022, 70 : 6332 - 6347
  • [27] Faster Projection-free Convex Optimization over the Spectrahedron
    Garber, Dan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [28] Projection-free Distributed Online Learning with Sublinear Communication Complexity
    Wan, Yuanyu
    Wang, Guanghui
    Tu, Wei-Wei
    Zhang, Lijun
    Journal of Machine Learning Research, 2022, 23 : 1 - 53
  • [29] Revisiting Projection-Free Optimization for Strongly Convex Constraint Sets
    Rector-Brooks, Jarrid
    Wang, Jun-Kun
    Mozafari, Barzan
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 1576 - 1583
  • [30] A Stochastic Gradient-Based Projection Algorithm for Distributed Constrained Optimization
    Zhang, Keke
    Gao, Shanfu
    Chen, Yingjue
    Zheng, Zuqing
    Lu, Qingguo
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT I, 2024, 14447 : 356 - 367