Differentially private distributed online mirror descent algorithm

被引:3
|
作者
Yuan, Meng [1 ]
Lei, Jinlong [1 ]
Hong, Yiguang [1 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Coll Elect & Informat Engn, Shanghai 200092, Peoples R China
关键词
Differential privacy; Distributed online optimization; Mirror descent; Expected regret; Strongly convex; OPTIMIZATION; CONSENSUS;
D O I
10.1016/j.neucom.2023.126531
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines a private distributed online convex optimization problem in which each agent strives to minimize the sum of objective functions while also tending to keep their individual objective functions confidential. We use differential privacy as the metric to safeguard each agent's privacy and offer a distributed online mirror descent technique that is differentially private. We demonstrate that for strongly convex objective functions, our proposed algorithm satisfies the expected regret bound of O(ln (T)) while maintaining differential privacy, where T is the number of iterations. The established expected regret bound matches the optimal theoretical regret bound with respect to T. We further illu-minate the trade-off between the extent of privacy-preserving and the expected regret bound through numerical simulations.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Distributed Online Optimization over a Heterogeneous Network with Any-Batch Mirror Descent
    Eshraghi, Nima
    Liang, Ben
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [32] Distributed Online Optimization over a Heterogeneous Network with Any-Batch Mirror Descent
    Eshraghi, Nima
    Liang, Ben
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [33] Distributed Load Shedding via Differentially Private Average Consensus Algorithm
    Qiao, Zixin
    Guo, Fanghong
    Pan, Xiping
    Sun, Yue
    Wang, Lei
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1503 - 1508
  • [34] Differentially Private Distributed Learning
    Zhou, Yaqin
    Tang, Shaojie
    INFORMS JOURNAL ON COMPUTING, 2020, 32 (03) : 779 - 789
  • [35] Online algorithm for differentially private genome-wide association studies
    Aziz M.M.A.
    Kamali S.
    Mohammed N.
    Jiang X.
    ACM Transactions on Computing for Healthcare, 2021, 2 (02):
  • [36] Differentially Private Distributed Sensing
    Fink, Glenn A.
    2016 IEEE 3RD WORLD FORUM ON INTERNET OF THINGS (WF-IOT), 2016, : 216 - 221
  • [37] Differentially Private Distributed Optimization
    Huang, Zhenqi
    Mitra, Sayan
    Vaidya, Nitin
    PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND NETWORKING, 2015,
  • [38] Distributed mirror descent algorithm over unbalanced digraphs based on gradient weighting technique
    Shi, Chong-Xiao
    Yang, Guang-Hong
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (14): : 10656 - 10680
  • [39] Dual Mirror Descent for Online Allocation Problems
    Balseiro, Santiago
    Lu, Haihao
    Mirrokni, Vahab
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [40] Differentially Private Variance Reduced Stochastic Gradient Descent
    Lee, Jaewoo
    2017 INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS), 2017, : 161 - 166