Differentially private distributed online mirror descent algorithm

被引:3
|
作者
Yuan, Meng [1 ]
Lei, Jinlong [1 ]
Hong, Yiguang [1 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Coll Elect & Informat Engn, Shanghai 200092, Peoples R China
关键词
Differential privacy; Distributed online optimization; Mirror descent; Expected regret; Strongly convex; OPTIMIZATION; CONSENSUS;
D O I
10.1016/j.neucom.2023.126531
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines a private distributed online convex optimization problem in which each agent strives to minimize the sum of objective functions while also tending to keep their individual objective functions confidential. We use differential privacy as the metric to safeguard each agent's privacy and offer a distributed online mirror descent technique that is differentially private. We demonstrate that for strongly convex objective functions, our proposed algorithm satisfies the expected regret bound of O(ln (T)) while maintaining differential privacy, where T is the number of iterations. The established expected regret bound matches the optimal theoretical regret bound with respect to T. We further illu-minate the trade-off between the extent of privacy-preserving and the expected regret bound through numerical simulations.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] A Novel Differentially Private Online Learning Algorithm for Group Lasso in Big Data
    Li, Jinxia
    Lu, Liwei
    IET INFORMATION SECURITY, 2024, 2024
  • [42] Differentially Private Distributed Online Algorithms Over Time-Varying Directed Networks
    Zhu, Junlong
    Xu, Changqiao
    Guan, Jianfeng
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2018, 4 (01): : 4 - 17
  • [43] Differentially Private Distributed Online Convex Optimization Towards Low Regret and Communication Cost
    Liu, Jiandong
    Zhang, Lan
    Yu, Xiaojing
    Li, Xiang-Yang
    PROCEEDINGS OF THE 2023 INTERNATIONAL SYMPOSIUM ON THEORY, ALGORITHMIC FOUNDATIONS, AND PROTOCOL DESIGN FOR MOBILE NETWORKS AND MOBILE COMPUTING, MOBIHOC 2023, 2023, : 171 - 180
  • [44] Differentially Private Distributed Frequency Estimation
    Yang, Mengmeng
    Tjuawinata, Ivan
    Lam, Kwok-Yan
    Zhu, Tianqing
    Zhao, Jun
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (05) : 3910 - 3926
  • [45] Distributed Differentially Private Ranking Aggregation
    Lan, Qiujun
    Song, Baobao
    Li, Yang
    Li, Gang
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (01) : 503 - 513
  • [46] Differentially Private Distributed Data Analysis
    Takabi, Hassan
    Koppikar, Samir
    Zargar, Saman Taghavi
    2016 IEEE 2ND INTERNATIONAL CONFERENCE ON COLLABORATION AND INTERNET COMPUTING (IEEE CIC), 2016, : 212 - 218
  • [47] Differentially Private Distributed Parameter Estimation
    WANG Jimin
    TAN Jianwei
    ZHANG Ji-Feng
    Journal of Systems Science & Complexity, 2023, 36 (01) : 187 - 204
  • [48] Distributed Differentially Private Ranking Aggregation
    Song, Baobao
    Lan, Qiujun
    Li, Yang
    Li, Gang
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT I, 2022, 13280 : 236 - 248
  • [49] Differentially Private Distributed Constrained Optimization
    Han, Shuo
    Topcu, Ufuk
    Pappas, George J.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (01) : 50 - 64
  • [50] Differentially Private Distributed Parameter Estimation
    Jimin Wang
    Jianwei Tan
    Ji-Feng Zhang
    Journal of Systems Science and Complexity, 2023, 36 : 187 - 204