A Distributed Algorithm for Online Convex Optimization with Time-Varying Coupled Inequality Constraints

被引:0
|
作者
Yi, Xinlei [1 ]
Li, Xiuxian [2 ]
Xie, Lihua [2 ]
Johansson, Karl H. [1 ]
机构
[1] KTH Royal Inst Technol, Sch Elect Engn & Comp Sci, Div Decis & Control Syst, S-10044 Stockholm, Sweden
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, 50 Nanyang Ave, Singapore 639798, Singapore
基金
瑞典研究理事会;
关键词
REGRET;
D O I
10.1109/cdc40024.2019.9030264
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the sum of local convex constraint functions. A distributed online primal-dual mirror descent algorithm is proposed to solve this problem, where the local cost, regularization, and constraint functions are held privately and revealed only after each time slot. We first derive regret and constraint violation bounds for the algorithm and show how they depend on the stepsize sequences, the accumulated variation of the comparator sequence, the number of agents, and the network connectivity. As a result, we prove that the algorithm achieves sublinear dynamic regret and constraint violation if the accumulated variation of the optimal sequence also grows sublinearly. We also prove that the algorithm achieves sublinear static regret and constraint violation under mild conditions. In addition, smaller bounds on the static regret are achieved when the objective functions are strongly convex. Finally, numerical simulations are provided to illustrate the effectiveness of the theoretical results.
引用
收藏
页码:555 / 560
页数:6
相关论文
共 50 条
  • [1] Distributed Online Convex Optimization With Time-Varying Coupled Inequality Constraints
    Yi, Xinlei
    Li, Xiuxian
    Xie, Lihua
    Johansson, Karl H.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 : 731 - 746
  • [2] Distributed Bandit Online Convex Optimization With Time-Varying Coupled Inequality Constraints
    Yi, Xinlei
    Li, Xiuxian
    Yang, Tao
    Xie, Lihua
    Chai, Tianyou
    Johansson, Karl Henrik
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (10) : 4620 - 4635
  • [3] A Distributed Primal-Dual Algorithm for Bandit Online Convex Optimization with Time-Varying Coupled Inequality Constraints
    Yi, Xinlei
    Li, Xiuxian
    Yang, Tao
    Xie, Lihua
    Chai, Tianyou
    Johansson, Karl H.
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 327 - 332
  • [4] Online Learning Algorithm for Distributed Convex Optimization With Time-Varying Coupled Constraints and Bandit Feedback
    Li, Jueyou
    Gu, Chuanye
    Wu, Zhiyou
    Huang, Tingwen
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (02) : 1009 - 1020
  • [5] Distributed Convex Optimization with Inequality Constraints over Time-Varying Unbalanced Digraphs
    Xie, Pei
    You, Keyou
    Tempo, Roberto
    Song, Shiji
    Wu, Cheng
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (12) : 4331 - 4337
  • [6] Time-varying distributed optimization problem with inequality constraints
    Chen, Yong
    Yu, Tao
    Meng, Qing
    Niu, Fuxi
    Wang, Haibo
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (16): : 11314 - 11330
  • [7] On the Time-Varying Constraints and Bandit Feedback of Online Convex Optimization
    Cao, Xuanyu
    Liu, K. J. Ray
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2018,
  • [8] Online Convex Optimization With Time-Varying Constraints and Bandit Feedback
    Cao, Xuanyu
    Liu, K. J. Ray
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (07) : 2665 - 2680
  • [9] Online distributed stochastic learning algorithm for convex optimization in time-varying directed networks
    Li, Jueyou
    Gu, Chuanye
    Wu, Zhiyou
    [J]. NEUROCOMPUTING, 2020, 416 : 85 - 94
  • [10] Distributed Online Convex Optimization on Time-Varying Directed Graphs
    Akbari, Mohammad
    Gharesifard, Bahman
    Linder, Tamas
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2017, 4 (03): : 417 - 428