Differentially private distributed online optimization via push-sum one-point bandit dual averaging

被引:3
|
作者
Zhao, Zhongyuan [1 ]
Yang, Ju [1 ]
Gao, Wang [1 ]
Wang, Yan [1 ]
Wei, Mengli [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Key Lab Big Data Anal Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Coll Automat, Nanjing 210044, Peoples R China
[2] Southeast Univ, Sch Cyber Sci & Engn, Nanjing 211189, Peoples R China
关键词
Distributed online optimization; Differential privacy; One-point gradient estimate; Decentralized federated learning; CONVEX-OPTIMIZATION; STOCHASTIC OPTIMIZATION; ALGORITHMS;
D O I
10.1016/j.neucom.2023.127184
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper focuses on the distributed online optimization problem in multi -agent systems considering privacy preservation. Each agent exchanges local information with neighboring agents on the strongly connected timevarying directed graphs. Since the process of information transmission is prone to information leakage, a distributed push -sum dual averaging algorithm based on the differential privacy mechanism is proposed to protect the privacy of the data. In addition, to handle situations where the gradient information of the node cost function is unknown, the one -point gradient estimation is designed to calculate the true gradient information and guide the update of the decision variables. With the appropriate choice of the stepsizes and the exploration parameters, the algorithm can effectively protect the privacy of agents while achieving sublinear regret with 3 the convergence rate O(T 4 ). Furthermore, this paper also explores the effect of one -point estimation parameters on the regret in the online setting and investigates the relation between the convergence effect of individual regret and differential privacy levels. Finally, several federated learning experiments were conducted to verify the efficacy of the algorithm.
引用
收藏
页数:12
相关论文
共 17 条
  • [1] Push-sum Distributed Dual Averaging Online Convex Optimization With Bandit Feedback
    Yang, Ju
    Wei, Mengli
    Wang, Yan
    Zhao, Zhongyuan
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2024, 22 (05) : 1461 - 1471
  • [2] Push-Sum Distributed Online Optimization With Bandit Feedback
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2263 - 2273
  • [3] Push-Sum Distributed Dual Averaging for Convex Optimization
    Tsianos, Konstantinos I.
    Lawlor, Sean
    Rabbat, Michael G.
    [J]. 2012 IEEE 51ST ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2012, : 5453 - 5458
  • [4] Distributed Push-Sum Algorithm for Multi-Agent Optimization Via One-Point Gradient Estimator
    Wang, Cong
    Yuan, Deming
    Zhang, Baoyong
    [J]. PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 6013 - 6018
  • [5] Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. NEUROCOMPUTING, 2022, 497 : 204 - 215
  • [6] Differentially Private Distributed Online Optimization in Time-varying Networks via Dual Averaging Push
    Liu, Yang
    Wang, Zhu
    Zhu, Chaowen
    Wang, Dong
    Wang, Wei
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 558 - 563
  • [7] Push-Sum Distributed Dual Averaging for Convex Optimization in Multiagent Systems With Communication Delays
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Zhang, Baoyong
    Zhang, Zhengqiang
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (03): : 1420 - 1430
  • [8] Cooperative convex optimization with subgradient delays using push-sum distributed dual averaging
    Wang, Cong
    Xu, Shengyuan
    Yuan, Deming
    Chu, Yuming
    Zhang, Zhengqiang
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2021, 358 (14): : 7254 - 7269
  • [9] Privacy-Preserving Dual Stochastic Push-Sum Algorithm for Distributed Constrained Optimization
    Chuanye Gu
    Lin Jiang
    Jueyou Li
    Zhiyou Wu
    [J]. Journal of Optimization Theory and Applications, 2023, 197 : 22 - 50
  • [10] Online Distributed Optimization via Dual Averaging
    Hosseini, Saghar
    Chapman, Airlie
    Mesbahi, Mehran
    [J]. 2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 1484 - 1489