Differentially private distributed online mirror descent algorithm

被引:3
|
作者
Yuan, Meng [1 ]
Lei, Jinlong [1 ]
Hong, Yiguang [1 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Coll Elect & Informat Engn, Shanghai 200092, Peoples R China
关键词
Differential privacy; Distributed online optimization; Mirror descent; Expected regret; Strongly convex; OPTIMIZATION; CONSENSUS;
D O I
10.1016/j.neucom.2023.126531
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines a private distributed online convex optimization problem in which each agent strives to minimize the sum of objective functions while also tending to keep their individual objective functions confidential. We use differential privacy as the metric to safeguard each agent's privacy and offer a distributed online mirror descent technique that is differentially private. We demonstrate that for strongly convex objective functions, our proposed algorithm satisfies the expected regret bound of O(ln (T)) while maintaining differential privacy, where T is the number of iterations. The established expected regret bound matches the optimal theoretical regret bound with respect to T. We further illu-minate the trade-off between the extent of privacy-preserving and the expected regret bound through numerical simulations.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Distributed Online Mirror Descent Algorithm with Event Triggered Communication
    Paul, Anik Kumar
    Mahindrakar, Arun D.
    Kalaimani, Rachel K.
    IFAC PAPERSONLINE, 2022, 55 (30): : 448 - 453
  • [2] Adaptive quantized online distributed mirror descent algorithm with Bandit feedback
    Xie J.-R.
    Gao W.-H.
    Xie Y.-B.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2023, 40 (10): : 1774 - 1782
  • [3] Distributed Mirror Descent for Online Composite Optimization
    Yuan, Deming
    Hong, Yiguang
    Ho, Daniel W. C.
    Xu, Shengyuan
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2021, 66 (02) : 714 - 729
  • [4] Differentially Private Distributed Online Learning
    Li, Chencheng
    Zhou, Pan
    Xiong, Li
    Wang, Qian
    Wang, Ting
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (08) : 1440 - 1453
  • [5] Differentially-Private Federated Learning with Long-Term Constraints Using Online Mirror Descent
    Odeyomi, Olusola
    Zaruba, Gergely
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 1308 - 1313
  • [6] Analysis of Online Composite Mirror Descent Algorithm
    Lei, Yunwen
    Zhou, Ding-Xuan
    NEURAL COMPUTATION, 2017, 29 (03) : 825 - 860
  • [7] Differentially Private Federated Learning With Stragglers’ Delays in Cross-Silo Settings: An Online Mirror Descent Approach
    Odeyomi, Olusola
    Tankard, Earl
    Rawat, Danda
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (01) : 308 - 321
  • [8] Distributed Differentially Private Stochastic Gradient Descent: An Empirical Study
    Hegedus, Istvan
    Jelasity, Mark
    2016 24TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP), 2016, : 566 - 573
  • [9] Distributed Online Optimization in Dynamic Environments Using Mirror Descent
    Shahrampour, Shahin
    Jadbabaie, Ali
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (03) : 714 - 725
  • [10] Distributed stochastic mirror descent algorithm for resource allocation problem
    Wang, Yinghui
    Tu, Zhipeng
    Qin, Huashu
    CONTROL THEORY AND TECHNOLOGY, 2020, 18 (04) : 339 - 347