Differentially private distributed online mirror descent algorithm

被引:3
|
作者
Yuan, Meng [1 ]
Lei, Jinlong [1 ]
Hong, Yiguang [1 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Coll Elect & Informat Engn, Shanghai 200092, Peoples R China
关键词
Differential privacy; Distributed online optimization; Mirror descent; Expected regret; Strongly convex; OPTIMIZATION; CONSENSUS;
D O I
10.1016/j.neucom.2023.126531
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines a private distributed online convex optimization problem in which each agent strives to minimize the sum of objective functions while also tending to keep their individual objective functions confidential. We use differential privacy as the metric to safeguard each agent's privacy and offer a distributed online mirror descent technique that is differentially private. We demonstrate that for strongly convex objective functions, our proposed algorithm satisfies the expected regret bound of O(ln (T)) while maintaining differential privacy, where T is the number of iterations. The established expected regret bound matches the optimal theoretical regret bound with respect to T. We further illu-minate the trade-off between the extent of privacy-preserving and the expected regret bound through numerical simulations.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Differentially private block coordinate descent
    Riaz, Shazia
    Ali, Saqib
    Wang, Guojun
    Anees, Asad
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (01) : 283 - 295
  • [22] Differentially Private Stochastic Coordinate Descent
    Damaskinos, Georgios
    Mendler-Duenner, Celestine
    Guerraoui, Rachid
    Papandreou, Nikolaos
    Parnell, Thomas
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 7176 - 7184
  • [23] Differentially Private Gossip Gradient Descent
    Liu, Yang
    Liu, Ji
    Basar, Tamer
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 2777 - 2782
  • [24] Distributed Mirror Descent Algorithm With Bregman Damping for Nonsmooth Constrained Optimization
    Chen, Guanpu
    Xu, Gehui
    Li, Weijian
    Hong, Yiguang
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (11) : 6921 - 6928
  • [25] Distributed Online Mirror Descent With Delayed Subgradient and Event-Triggered Communications
    Xiong, Menghui
    Ho, Daniel W. C.
    Zhang, Baoyong
    Yuan, Deming
    Xu, Shengyuan
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02): : 1702 - 1715
  • [26] Differentially private resilient distributed cooperative online estimation over digraphs
    Wang, Jimin
    Zhang, Ji-Feng
    Liu, Xiao-Kang
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (15) : 8670 - 8688
  • [27] Distributed Randomized Gradient-Free Mirror Descent Algorithm for Constrained Optimization
    Yu, Zhan
    Ho, Daniel W. C.
    Yuan, Deming
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (02) : 957 - 964
  • [28] Distributed Stochastic Mirror Descent Algorithm Over Time-varying Network
    Wang, Yinghui
    Zhou, Hongbing
    Hong, Yiguang
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2018, : 716 - 721
  • [29] Stochastic gradient descent with differentially private updates
    Song, Shuang
    Chaudhuri, Kamalika
    Sarwate, Anand D.
    2013 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2013, : 245 - 248
  • [30] Improving Dynamic Regret in Distributed Online Mirror Descent Using Primal and Dual Information
    Eshraghi, Nima
    Liang, Ben
    LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 168, 2022, 168