Distributed Consensus Optimization under Zeroth-Order Oracles and Uniform Quantization

被引:0
|
作者
Ding, Jingjing [1 ]
Yuan, Deming [1 ]
Jiang, Guo-Ping [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210023, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Multi-agent system; consensus; uniform quantizer; zeroth-order oracles; MULTIAGENT OPTIMIZATION; SUBGRADIENT METHODS; NETWORKS; COMMUNICATION; SYSTEMS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider a constrained multi-agent optimization problem where the bit rate of communication in the network is limited. This problem arises in a network with time-varying connectivity where all the agents try to minimize a sum of non smooth but Lipschitz continuous functions, and the estimates of each agent are restricted to lie in the same convex set. We design a uniform quantizer and present a distributed zeroth-order method, which relies on the functional evaluations and quantized estimates. We establish conditions on the hit rate and the initial quantization intervals that ensures the convergence of the algorithm. In particular, we provide convergence analysis results, and highlight the dependence on the smoothing parameters and the quantization resolution.
引用
收藏
页码:6103 / 6107
页数:5
相关论文
共 50 条
  • [1] Optimisation with Zeroth-Order Oracles in Formation
    Michael, Elad
    Zelazo, Daniel
    Wood, Tony A.
    Manzie, Chris
    Shames, Iman
    [J]. 2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 5354 - 5359
  • [2] Asynchronous Zeroth-Order Distributed Optimization with Residual Feedback
    Shen, Yi
    Zhang, Yan
    Nivison, Scott
    Bell, Zachary, I
    Zavlanos, Michael M.
    [J]. 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 3349 - 3354
  • [3] Zeroth-Order Method for Distributed Optimization With Approximate Projections
    Yuan, Deming
    Ho, Daniel W. C.
    Xu, Shengyuan
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (02) : 284 - 294
  • [4] Zeroth-order algorithms for stochastic distributed nonconvex optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Johansson, Karl H.
    [J]. AUTOMATICA, 2022, 142
  • [5] Zeroth-order Gradient Tracking for Distributed Constrained Optimization
    Cheng, Songsong
    Yu, Xin
    Fan, Yuan
    Xiao, Gaoxi
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 5197 - 5202
  • [6] Stochastic Zeroth-Order Optimization under Nonstationarity and Nonconvexity
    Roy, Abhishek
    Balasubramanian, Krishnakumar
    Ghadimi, Saeed
    Mohapatra, Prasant
    [J]. Journal of Machine Learning Research, 2022, 23
  • [7] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Yinghui Wang
    Xianlin Zeng
    Wenxiao Zhao
    Yiguang Hong
    [J]. Science China Information Sciences, 2023, 66
  • [8] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Wang, Yinghui
    Zeng, Xianlin
    Zhao, Wenxiao
    Hong, Yiguang
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (09)
  • [9] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Yinghui WANG
    Xianlin ZENG
    Wenxiao ZHAO
    Yiguang HONG
    [J]. Science China(Information Sciences), 2023, 66 (09) : 297 - 298
  • [10] Stochastic Zeroth-Order Optimization under Nonstationarity and Nonconvexity
    Roy, Abhishek
    Balasubramanian, Krishnakumar
    Ghadimi, Saeed
    Mohapatra, Prasant
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23