An accelerated distributed online gradient push-sum algorithm on time-varying directed networks

被引:0
|
作者
Fang, Runyue [1 ]
Li, Dequan [1 ,2 ]
Shen, Xiuyu [1 ,3 ]
Zhou, Yuejin [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Math & Big Data, Huainan 232001, Anhui, Peoples R China
[2] Anhui Univ Sci & Technol, Sch Artificial Intelligence, Huainan 232001, Anhui, Peoples R China
[3] Southeast Univ, Sch Transportat, Nanjing 211189, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
distributed convex optimization; momentum acceleration; online convex optimization; time-varying directed network; CONVEX-OPTIMIZATION;
D O I
10.1002/asjc.2721
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates a distributed online optimization problem with convex objective functions on time-varying directed networks, where each agent holds its own convex cost function and the goal is to cooperatively minimize the sum of the local cost functions. To tackle such optimization problems, an accelerated distributed online gradient push-sum algorithm is firstly proposed, which combines the momentum acceleration technique and the push-sum strategy. Then, we specifically analyze the regret for the proposed algorithm. The theoretical result shows that the individual regret of the proposed algorithm achieves a sublinear regret with order of O(root T), where T is the time horizon. Moreover, we implement the proposed algorithm in sensor networks for solving the distributed online estimation problem, and the results illustrate the effectiveness of the proposed algorithm.
引用
收藏
页码:3278 / 3288
页数:11
相关论文
共 50 条
  • [1] An Accelerated Distributed Online Gradient Push-Sum Algorithm in Time-varying Networks
    Fang, Runyue
    Li, Dequan
    Shen, Xiuyu
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5269 - 5274
  • [2] Design of gradient push algorithm in time-varying directed graph
    Zhu, Qingchao
    Wang, Yue
    Song, Xiao-ou
    Huang, Hongmei
    [J]. Advances in Intelligent Systems and Computing, 2021, 1195 AISC : 354 - 363
  • [3] Convergence of an accelerated distributed optimisation algorithm over time-varying directed networks
    Hu, Jinhui
    Yan, Yu
    Li, Huaqing
    Wang, Zheng
    Xia, Dawen
    Guo, Jing
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2021, 15 (01): : 24 - 39
  • [4] Push-Sum Distributed Online Optimization With Bandit Feedback
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2263 - 2273
  • [5] Accelerated AB/Push-Pull Methods for Distributed Optimization Over Time-Varying Directed Networks
    Nguyen, Duong Thuy Anh
    Nguyen, Duong Tung
    Nedic, Angelia
    [J]. IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2024, 11 (03): : 1395 - 1407
  • [6] Online distributed stochastic learning algorithm for convex optimization in time-varying directed networks
    Li, Jueyou
    Gu, Chuanye
    Wu, Zhiyou
    [J]. NEUROCOMPUTING, 2020, 416 : 85 - 94
  • [7] Distributed subgradient-push online convex optimization on time-varying directed graphs
    Akbari, Mohammad
    Gharesifard, Bahman
    Linder, Tamas
    [J]. 2014 52ND ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2014, : 264 - 269
  • [8] Stochastic gradient-push for economic dispatch on time-varying directed networks with delays
    Yuan, Ye
    Li, Huaqing
    Hu, Jinhui
    Wang, Zheng
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2019, 113 : 564 - 572
  • [9] AB/Push-Pull method for distributed optimization in time-varying directed networks
    Nedic, Angelia
    Nguyen, Duong Thuy Anh
    Nguyen, Duong Tung
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2023,
  • [10] Share Factors Optimization in the Push-Sum Algorithm for Sensor Networks
    Zanaj, Ehna
    Baldi, Marco
    Chiaraluce, Franco
    [J]. 2008 INTERNATIONAL CONFERENCE ON SOFTWARE, TELECOMMUNICATIONS AND COMPUTER NETWORKS, 2008, : 172 - 176