A Stochastic Gradient-Based Projection Algorithm for Distributed Constrained Optimization

被引:0
|
作者
Zhang, Keke [1 ,2 ]
Gao, Shanfu [1 ]
Chen, Yingjue [1 ]
Zheng, Zuqing [3 ]
Lu, Qingguo [1 ,2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Key Lab Smart Grid, Chengdu 610065, Sichuan, Peoples R China
[3] Cent South Univ, Sch Automat, Changsha 410000, Peoples R China
基金
中国博士后科学基金;
关键词
Stochastic gradient algorithm; Distributed constrained optimization; Multi-agent systems; Constant step-size; Linear convergence; PRIMAL-DUAL ALGORITHM; CONVEX-OPTIMIZATION; CONVERGENCE; NETWORKS; PUSH;
D O I
10.1007/978-981-99-8079-6_28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates a category of constrained convex optimization problems, where the collective objective function is represented as the sum of all local objective functions subjected to local bounds and equality constraints. This kind of problems is important and can be formulated form a variety of applications, such as power control, sensor networks and source localization. To solve this problem more reliable and effective, we propose a novel distributed stochastic gradient-based projection algorithm under the presence of noisy gradients, where the gradients are infiltrated by arbitrary but uniformly bounded noise sample through local gradient observation. The proposed algorithm allows the adoption of constant step-size, which guarantees it can possess faster convergence rate compared with existing distributed algorithms with diminishing step-size. The effectiveness of the proposed algorithm is verified and testified by simulation experiments.
引用
收藏
页码:356 / 367
页数:12
相关论文
共 50 条
  • [1] Distributed Continuous-Time Gradient-Based Algorithm for Constrained Optimization
    Yi, Peng
    Hong, Yiguang
    [J]. 2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, : 1563 - 1567
  • [2] Distributed gradient-free and projection-free algorithm for stochastic constrained optimization
    Hou J.
    Zeng X.
    Chen C.
    [J]. Autonomous Intelligent Systems, 4 (1):
  • [3] ON THE ADAPTIVITY OF STOCHASTIC GRADIENT-BASED OPTIMIZATION
    Lei, Lihua
    Jordan, Michael I.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (02) : 1473 - 1500
  • [4] A gradient-based dissipative continuous-time algorithm for distributed optimization
    Yu, Weiyong
    Yi, Peng
    Hong, Yiguang
    [J]. PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 7908 - 7912
  • [5] Gradient-based constrained well placement optimization
    Volkov, O.
    Bellout, M. C.
    [J]. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2018, 171 : 1052 - 1066
  • [6] Constrained Optimization by the Evolutionary Algorithm with Lower Dimensional Crossover and Gradient-Based Mutation
    Zhang, Qing
    Zeng, Sanyou
    Wang, Rui
    Shi, Hui
    Chen, Guang
    Ding, Lixin
    Kang, Lishan
    [J]. 2008 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-8, 2008, : 273 - 279
  • [7] A skeletonization algorithm for gradient-based optimization
    Menten, Martin J.
    Paetzold, Johannes C.
    Zimmer, Veronika A.
    Shit, Suprosanna
    Ezhov, Ivan
    Holland, Robbie
    Probst, Monika
    Schnabel, Julia A.
    Rueckert, Daniel
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21337 - 21346
  • [8] A Gradient-Based Optimization Algorithm for LASSO
    Kim, Jinseog
    Kim, Yuwon
    Kim, Yongdai
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2008, 17 (04) : 994 - 1009
  • [9] Edge-Based Stochastic Gradient Algorithm for Distributed Optimization
    Wang, Zheng
    Li, Huaqing
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 1421 - 1430
  • [10] COMBINING GRADIENT-BASED OPTIMIZATION WITH STOCHASTIC SEARCH
    Zhou, Enlu
    Hu, Jiaqiao
    [J]. 2012 WINTER SIMULATION CONFERENCE (WSC), 2012,