Zeroth-Order Method for Distributed Optimization With Approximate Projections

被引:41
|
作者
Yuan, Deming [1 ]
Ho, Daniel W. C. [2 ,3 ]
Xu, Shengyuan [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210023, Jiangsu, Peoples R China
[2] City Univ Hong Kong, Dept Math, Hong Kong, Hong Kong, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Automat, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Approximate projection; convex optimization; distributed optimization; gradient estimator; networked systems; SUBGRADIENT METHODS; MULTIAGENT OPTIMIZATION; CONVEX-OPTIMIZATION; CONSENSUS; ALGORITHMS; NETWORKS; SYSTEMS; AGENTS;
D O I
10.1109/TNNLS.2015.2480419
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the problem of minimizing a sum of (possible nonsmooth) convex functions that are corresponding to multiple interacting nodes, subject to a convex state constraint set. Time-varying directed network is considered here. Two types of computational constraints are investigated in this paper: one where the information of gradients is not available and the other where the projection steps can only be calculated approximately. We devise a distributed zeroth-order method, the implementation of which needs only functional evaluations and approximate projection. In particular, we show that the proposed method generates expected function value sequences that converge to the optimal value, provided that the projection errors decrease at appropriate rates.
引用
收藏
页码:284 / 294
页数:11
相关论文
共 50 条
  • [41] ZONE: Zeroth-Order Nonconvex Multiagent Optimization Over Networks
    Hajinezhad, Davood
    Hong, Mingyi
    Garcia, Alfredo
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2019, 64 (10) : 3995 - 4010
  • [42] Automatic controller tuning using a zeroth-order optimization algorithm
    Zalkind, Daniel S.
    Dall'Anese, Emiliano
    Pao, Lucy Y.
    [J]. WIND ENERGY SCIENCE, 2020, 5 (04) : 1579 - 1600
  • [43] Lazy Queries Can Reduce Variance in Zeroth-Order Optimization
    Xiao, Quan
    Ling, Qing
    Chen, Tianyi
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 3695 - 3709
  • [44] Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization
    Yi, Xinlei
    Zhang, Shengjun
    Yang, Tao
    Chai, Tianyou
    Johansson, Karl H.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (08) : 4194 - 4201
  • [45] ZO-AdaMM: Zeroth-Order Adaptive Momentum Method for Black-Box Optimization
    Chen, Xiangyi
    Liu, Sijia
    Xu, Kaidi
    Li, Xingguo
    Lin, Xue
    Hong, Mingyi
    Cox, David
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [46] A Zeroth-Order Continuation Method for Antenna Tuning in Wireless Networks
    Li, Wenjie
    Lopez-Perez, David
    Geng, Xinli
    Bao, Harvey
    Song, Qitao
    Chen, Xin
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [47] Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization
    Ji, Kaiyi
    Wang, Zhe
    Zhou, Yi
    Liang, Yingbin
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [48] Contrasting Exploration in Parameter and Action Space: A Zeroth-Order Optimization Perspective
    Vemula, Anirudh
    Sun, Wen
    Bagnell, J. Andrew
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [49] Optimisation with Zeroth-Order Oracles in Formation
    Michael, Elad
    Zelazo, Daniel
    Wood, Tony A.
    Manzie, Chris
    Shames, Iman
    [J]. 2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 5354 - 5359
  • [50] On the zeroth-order general Randic index
    Zhang, Minjie
    Li, Shuchao
    [J]. JOURNAL OF MATHEMATICAL CHEMISTRY, 2011, 49 (02) : 325 - 327