Zeroth-Order Method for Distributed Optimization With Approximate Projections

被引:41
|
作者
Yuan, Deming [1 ]
Ho, Daniel W. C. [2 ,3 ]
Xu, Shengyuan [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210023, Jiangsu, Peoples R China
[2] City Univ Hong Kong, Dept Math, Hong Kong, Hong Kong, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Approximate projection; convex optimization; distributed optimization; gradient estimator; networked systems; SUBGRADIENT METHODS; MULTIAGENT OPTIMIZATION; CONVEX-OPTIMIZATION; CONSENSUS; ALGORITHMS; NETWORKS; SYSTEMS; AGENTS;
D O I
10.1109/TNNLS.2015.2480419
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the problem of minimizing a sum of (possible nonsmooth) convex functions that are corresponding to multiple interacting nodes, subject to a convex state constraint set. Time-varying directed network is considered here. Two types of computational constraints are investigated in this paper: one where the information of gradients is not available and the other where the projection steps can only be calculated approximately. We devise a distributed zeroth-order method, the implementation of which needs only functional evaluations and approximate projection. In particular, we show that the proposed method generates expected function value sequences that converge to the optimal value, provided that the projection errors decrease at appropriate rates.
引用
收藏
页码:284 / 294
页数:11
相关论文
共 50 条
  • [1] Asynchronous Zeroth-Order Distributed Optimization with Residual Feedback
    Shen, Yi
    Zhang, Yan
    Nivison, Scott
    Bell, Zachary, I
    Zavlanos, Michael M.
    [J]. 2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 3349 - 3354
  • [2] Zeroth-order algorithms for stochastic distributed nonconvex optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Johansson, Karl H.
    [J]. AUTOMATICA, 2022, 142
  • [3] Zeroth-order Gradient Tracking for Distributed Constrained Optimization
    Cheng, Songsong
    Yu, Xin
    Fan, Yuan
    Xiao, Gaoxi
    [J]. IFAC PAPERSONLINE, 2023, 56 (02): : 5197 - 5202
  • [4] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Yinghui Wang
    Xianlin Zeng
    Wenxiao Zhao
    Yiguang Hong
    [J]. Science China Information Sciences, 2023, 66
  • [5] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Wang, Yinghui
    Zeng, Xianlin
    Zhao, Wenxiao
    Hong, Yiguang
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (09)
  • [6] A zeroth-order algorithm for distributed optimization with stochastic stripe observations
    Yinghui WANG
    Xianlin ZENG
    Wenxiao ZHAO
    Yiguang HONG
    [J]. Science China(Information Sciences), 2023, 66 (09) : 297 - 298
  • [7] Privacy-Preserved Distributed Learning With Zeroth-Order Optimization
    Gratton, Cristiano
    Venkategowda, Naveen K. D.
    Arablouei, Reza
    Werner, Stefan
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 265 - 279
  • [8] Distributed Consensus Optimization under Zeroth-Order Oracles and Uniform Quantization
    Ding, Jingjing
    Yuan, Deming
    Jiang, Guo-Ping
    [J]. 2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 6103 - 6107
  • [9] Distributed zeroth-order optimization: Convergence rates that match centralized counterpart
    Yuan, Deming
    Wang, Lei
    Proutiere, Alexandre
    Shi, Guodong
    [J]. AUTOMATICA, 2024, 159
  • [10] Certified Multifidelity Zeroth-Order Optimization
    de Montbrun, Etienne
    Gerchinovitz, Sebastien
    [J]. SIAM-ASA Journal on Uncertainty Quantification, 2024, 12 (04): : 1135 - 1164