Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm

被引:14
|
作者
Wang, Cong [1 ]
Xu, Shengyuan [1 ]
Yuan, Deming [1 ]
Zhang, Baoyong [1 ]
Zhang, Zhengqiang [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Peoples R China
[2] Qufu Normal Univ, Sch Elect Engn & Automat, Rizhao 276826, Peoples R China
关键词
Distributed online convex optimization; Time-varying directed network topology; Time-varying constraint; Bandit feedback; SUBGRADIENT METHODS;
D O I
10.1016/j.neucom.2022.05.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The distributed online convex optimization problem with time-varying constraints for multi-agent networks is addressed in this article. The purpose is to optimize a sequence of time-varying global cost functions defined as the accumulated values of local cost functions, also attempt to meet the requirement of a sequence of time-varying coupled constraint functions which denote the sum of local constraint functions. Cost functions and constraint functions are unknown to agents beforehand. It is supposed that each agent in the network communicates with its neighbours through a uniformly strongly connected sequence of time-varying directed communication topologies. This paper proposes the bandit distributed primal-dual mirror descent push-sum (BDPDMDPS) algorithm constructed by bandit primal-dual, mirror descent and push-sum methods. Operational performance of the presented algorithm is measured by expected regret and expected constraint violation, both of which are proved to be sublinear with respect to the total iteration span T in this paper. Finally, a numerical simulation example is shown, which confirms the results for expected regret and expected constraint violation of BDPDMDPS algorithm. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:204 / 215
页数:12
相关论文
共 50 条
  • [41] A primal-dual algorithm framework for convex saddle-point optimization
    Zhang, Benxin
    Zhu, Zhibin
    [J]. JOURNAL OF INEQUALITIES AND APPLICATIONS, 2017,
  • [42] Projected Push-Sum Gradient Descent-Ascent for Convex Optimization with Application to Economic Dispatch Problems
    Zimmermann, Jan
    Tatarenko, Tatiana
    Willert, Volker
    Adamy, Juergen
    [J]. 2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 542 - 547
  • [43] A primal-dual algorithm framework for convex saddle-point optimization
    Benxin Zhang
    Zhibin Zhu
    [J]. Journal of Inequalities and Applications, 2017
  • [44] A Universal Primal-Dual Convex Optimization Framework
    Yurtsever, Alp
    Quoc Tran-Dinh
    Cevher, Volkan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [45] Hierarchical Convex Optimization With Primal-Dual Splitting
    Ono, Shunsuke
    Yamada, Isao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (02) : 373 - 388
  • [46] Primal-Dual Solution Perturbations in Convex Optimization
    A. L. Dontchev
    R. T. Rockafellar
    [J]. Set-Valued Analysis, 2001, 9 : 49 - 65
  • [47] Accelerated Primal-Dual Gradient Descent with Linesearch for Convex, Nonconvex, and Nonsmooth Optimization Problems
    S. V. Guminov
    Yu. E. Nesterov
    P. E. Dvurechensky
    A. V. Gasnikov
    [J]. Doklady Mathematics, 2019, 99 : 125 - 128
  • [48] Accelerated Primal-Dual Gradient Descent with Linesearch for Convex, Nonconvex, and Nonsmooth Optimization Problems
    Guminov, S. V.
    Nesterov, Yu. E.
    Dvurechensky, P. E.
    Gasnikov, A. V.
    [J]. DOKLADY MATHEMATICS, 2019, 99 (02) : 125 - 128
  • [49] Primal-dual solution perturbations in convex optimization
    Dontchev, AL
    Rockafellar, RT
    [J]. SET-VALUED ANALYSIS, 2001, 9 (1-2): : 49 - 65
  • [50] Distributed Primal-Dual Optimization for Online Multi-Task Learning
    Yang, Peng
    Li, Ping
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6631 - 6638