An Accelerated Distributed Online Gradient Push-Sum Algorithm in Time-varying Networks

被引:0
|
作者
Fang, Runyue [1 ]
Li, Dequan [1 ]
Shen, Xiuyu [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Math & Big Data, Huainan 232000, Peoples R China
关键词
Distributed convex optimization; Online convex optimization; Time-varying directed network; Momentum acceleration; CONVEX-OPTIMIZATION;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates an online convex optimization problem on time-varying directed networks, where each agent holds its own convex cost function and the goal is to cooperatively minimize the sum of the global cost function. To tackle such optimization problems, an accelerated distributed online gradient push-sum algorithm is firstly proposed, which combines the momentum acceleration technique and push-sum strategy. Then, we specifically analyze the regret for the proposed algorithm. The theoretical result shows that the individual regret of the proposed algorithm achieves an improved rate with order of O(root 1 + log T), where T is the time horizon. Moreover, we implement the proposed algorithm in sensor networks for solving the distributed online estimation problem, and the results demonstrate the effectiveness of the proposed algorithm.
引用
收藏
页码:5269 / 5274
页数:6
相关论文
共 50 条
  • [1] An accelerated distributed online gradient push-sum algorithm on time-varying directed networks
    Fang, Runyue
    Li, Dequan
    Shen, Xiuyu
    Zhou, Yuejin
    [J]. ASIAN JOURNAL OF CONTROL, 2022, 24 (06) : 3278 - 3288
  • [2] Push-Sum Distributed Online Optimization With Bandit Feedback
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2263 - 2273
  • [3] Share Factors Optimization in the Push-Sum Algorithm for Sensor Networks
    Zanaj, Ehna
    Baldi, Marco
    Chiaraluce, Franco
    [J]. 2008 INTERNATIONAL CONFERENCE ON SOFTWARE, TELECOMMUNICATIONS AND COMPUTER NETWORKS, 2008, : 172 - 176
  • [4] Distributed zero-gradient-sum algorithm for convex optimization with time-varying communication delays and switching networks
    Guo, Zhijun
    Chen, Gang
    [J]. INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2018, 28 (16) : 4900 - 4915
  • [5] Convergence of an accelerated distributed optimisation algorithm over time-varying directed networks
    Hu, Jinhui
    Yan, Yu
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Guo, Jing
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (01): : 24 - 39
  • [6] Design of gradient push algorithm in time-varying directed graph
    Zhu, Qingchao
    Wang, Yue
    Song, Xiao-ou
    Huang, Hongmei
    [J]. Advances in Intelligent Systems and Computing, 2021, 1195 AISC : 354 - 363
  • [7] Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. NEUROCOMPUTING, 2022, 497 : 204 - 215
  • [8] Distributed Proximal Gradient Algorithm for Nonconvex Optimization Over Time-Varying Networks
    Jiang, Xia
    Zeng, Xianlin
    Sun, Jian
    Chen, Jie
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (02): : 1005 - 1017
  • [9] Differentially Private Distributed Online Optimization in Time-varying Networks via Dual Averaging Push
    Liu, Yang
    Wang, Zhu
    Zhu, Chaowen
    Wang, Dong
    Wang, Wei
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 558 - 563
  • [10] Push-sum Distributed Dual Averaging Online Convex Optimization With Bandit Feedback
    Yang, Ju
    Wei, Mengli
    Wang, Yan
    Zhao, Zhongyuan
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (05) : 1461 - 1471