Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm

被引:14
|
作者
Wang, Cong [1 ]
Xu, Shengyuan [1 ]
Yuan, Deming [1 ]
Zhang, Baoyong [1 ]
Zhang, Zhengqiang [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
[2] Qufu Normal Univ, Sch Elect Engn & Automat, Rizhao 276826, Peoples R China
关键词
Distributed online convex optimization; Time-varying directed network topology; Time-varying constraint; Bandit feedback; SUBGRADIENT METHODS;
D O I
10.1016/j.neucom.2022.05.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The distributed online convex optimization problem with time-varying constraints for multi-agent networks is addressed in this article. The purpose is to optimize a sequence of time-varying global cost functions defined as the accumulated values of local cost functions, also attempt to meet the requirement of a sequence of time-varying coupled constraint functions which denote the sum of local constraint functions. Cost functions and constraint functions are unknown to agents beforehand. It is supposed that each agent in the network communicates with its neighbours through a uniformly strongly connected sequence of time-varying directed communication topologies. This paper proposes the bandit distributed primal-dual mirror descent push-sum (BDPDMDPS) algorithm constructed by bandit primal-dual, mirror descent and push-sum methods. Operational performance of the presented algorithm is measured by expected regret and expected constraint violation, both of which are proved to be sublinear with respect to the total iteration span T in this paper. Finally, a numerical simulation example is shown, which confirms the results for expected regret and expected constraint violation of BDPDMDPS algorithm. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:204 / 215
页数:12
相关论文
共 50 条
  • [31] A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization
    Xinlei Yi
    Shengjun Zhang
    Tao Yang
    Tianyou Chai
    Karl Henrik Johansson
    [J]. IEEE/CAA Journal of Automatica Sinica, 2022, (05) : 812 - 833
  • [32] Adaptive quantized online distributed mirror descent algorithm with Bandit feedback
    Xie, Jun-Ru
    Gao, Wen-Hua
    Xie, Yi-Bin
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2023, 40 (10): : 1774 - 1782
  • [33] A Golden Ratio Primal-Dual Algorithm for Structured Convex Optimization
    Chang, Xiaokai
    Yang, Junfeng
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2021, 87 (02)
  • [34] Projected Primal-Dual Dynamics for Distributed Constrained Nonsmooth Convex Optimization
    Zhu, Yanan
    Yu, Wenwu
    Wen, Guanghui
    Chen, Guanrong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) : 1776 - 1782
  • [35] A Prediction-Correction Primal-Dual Algorithm for Distributed Optimization
    Paternain, Santiago
    Fazlyab, Mahyar
    Preciado, Victor M.
    Ribeiro, Alejandro
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 835 - 841
  • [36] A Primal-Dual Algorithm for Distributed Stochastic Optimization with Equality Constraints
    Du, Kai-Xin
    Chen, Xing-Min
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5586 - 5591
  • [37] Linear convergence of a primal-dual algorithm for distributed interval optimization
    Wang, Yinghui
    Wang, Jiuwei
    Song, Xiaobo
    Hu, Yanpeng
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (02): : 857 - 873
  • [38] A Stochastic Primal-Dual algorithm for Distributed Asynchronous Composite Optimization
    Bianchi, Pascal
    Hachem, Walid
    Iutzeler, Franck
    [J]. 2014 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2014, : 732 - 736
  • [39] An Accelerated Distributed Online Gradient Push-Sum Algorithm in Time-varying Networks
    Fang, Runyue
    Li, Dequan
    Shen, Xiuyu
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5269 - 5274
  • [40] A second order primal-dual algorithm for nonsmooth convex composite optimization
    Dhingra, Neil K.
    Khong, Sei Zhen
    Jovanovic, Mihailo R.
    [J]. 2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,