Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm

被引:14
|
作者
Wang, Cong [1 ]
Xu, Shengyuan [1 ]
Yuan, Deming [1 ]
Zhang, Baoyong [1 ]
Zhang, Zhengqiang [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
[2] Qufu Normal Univ, Sch Elect Engn & Automat, Rizhao 276826, Peoples R China
关键词
Distributed online convex optimization; Time-varying directed network topology; Time-varying constraint; Bandit feedback; SUBGRADIENT METHODS;
D O I
10.1016/j.neucom.2022.05.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The distributed online convex optimization problem with time-varying constraints for multi-agent networks is addressed in this article. The purpose is to optimize a sequence of time-varying global cost functions defined as the accumulated values of local cost functions, also attempt to meet the requirement of a sequence of time-varying coupled constraint functions which denote the sum of local constraint functions. Cost functions and constraint functions are unknown to agents beforehand. It is supposed that each agent in the network communicates with its neighbours through a uniformly strongly connected sequence of time-varying directed communication topologies. This paper proposes the bandit distributed primal-dual mirror descent push-sum (BDPDMDPS) algorithm constructed by bandit primal-dual, mirror descent and push-sum methods. Operational performance of the presented algorithm is measured by expected regret and expected constraint violation, both of which are proved to be sublinear with respect to the total iteration span T in this paper. Finally, a numerical simulation example is shown, which confirms the results for expected regret and expected constraint violation of BDPDMDPS algorithm. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:204 / 215
页数:12
相关论文
共 50 条
  • [1] Push-sum Distributed Dual Averaging Online Convex Optimization With Bandit Feedback
    Yang, Ju
    Wei, Mengli
    Wang, Yan
    Zhao, Zhongyuan
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (05) : 1461 - 1471
  • [2] Push-Sum Distributed Online Optimization With Bandit Feedback
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2263 - 2273
  • [3] Push-Sum Distributed Dual Averaging for Convex Optimization
    Tsianos, Konstantinos I.
    Lawlor, Sean
    Rabbat, Michael G.
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5453 - 5458
  • [4] A Distributed Primal-Dual Algorithm for Bandit Online Convex Optimization with Time-Varying Coupled Inequality Constraints
    Yi, Xinlei
    Li, Xiuxian
    Yang, Tao
    Xie, Lihua
    Chai, Tianyou
    Johansson, Karl H.
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 327 - 332
  • [5] Differentially private distributed online optimization via push-sum one-point bandit dual averaging
    Zhao, Zhongyuan
    Yang, Ju
    Gao, Wang
    Wang, Yan
    Wei, Mengli
    [J]. NEUROCOMPUTING, 2024, 572
  • [6] Primal-dual stochastic distributed algorithm for constrained convex optimization
    Niu, Youcheng
    Wang, Haijing
    Wang, Zheng
    Xia, Dawen
    Li, Huaqing
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2019, 356 (16): : 9763 - 9787
  • [7] Push-Sum Distributed Dual Averaging for Convex Optimization in Multiagent Systems With Communication Delays
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (03): : 1420 - 1430
  • [8] A Coordinate Descent Primal-Dual Algorithm and Application to Distributed Asynchronous Optimization
    Bianchi, Pascal
    Hachem, Walid
    Iutzeler, Franck
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (10) : 2947 - 2957
  • [9] A Primal-Dual Algorithm for Distributed Optimization
    Bianchi, P.
    Hachem, W.
    [J]. 2014 IEEE 53RD ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2014, : 4240 - 4245
  • [10] Cooperative convex optimization with subgradient delays using push-sum distributed dual averaging
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Chu, Yuming
    Zhang, Zhengqiang
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2021, 358 (14): : 7254 - 7269