A Stochastic Gradient-Based Projection Algorithm for Distributed Constrained Optimization

被引:0
|
作者
Zhang, Keke [1 ,2 ]
Gao, Shanfu [1 ]
Chen, Yingjue [1 ]
Zheng, Zuqing [3 ]
Lu, Qingguo [1 ,2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Key Lab Smart Grid, Chengdu 610065, Sichuan, Peoples R China
[3] Cent South Univ, Sch Automat, Changsha 410000, Peoples R China
基金
中国博士后科学基金;
关键词
Stochastic gradient algorithm; Distributed constrained optimization; Multi-agent systems; Constant step-size; Linear convergence; PRIMAL-DUAL ALGORITHM; CONVEX-OPTIMIZATION; CONVERGENCE; NETWORKS; PUSH;
D O I
10.1007/978-981-99-8079-6_28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates a category of constrained convex optimization problems, where the collective objective function is represented as the sum of all local objective functions subjected to local bounds and equality constraints. This kind of problems is important and can be formulated form a variety of applications, such as power control, sensor networks and source localization. To solve this problem more reliable and effective, we propose a novel distributed stochastic gradient-based projection algorithm under the presence of noisy gradients, where the gradients are infiltrated by arbitrary but uniformly bounded noise sample through local gradient observation. The proposed algorithm allows the adoption of constant step-size, which guarantees it can possess faster convergence rate compared with existing distributed algorithms with diminishing step-size. The effectiveness of the proposed algorithm is verified and testified by simulation experiments.
引用
收藏
页码:356 / 367
页数:12
相关论文
共 50 条
  • [11] COMBINING GRADIENT-BASED OPTIMIZATION WITH STOCHASTIC SEARCH
    Zhou, Enlu
    Hu, Jiaqiao
    [J]. 2012 WINTER SIMULATION CONFERENCE (WSC), 2012,
  • [12] Edge-Based Stochastic Gradient Algorithm for Distributed Optimization
    Wang, Zheng
    Li, Huaqing
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (03): : 1421 - 1430
  • [13] An Accelerated Distributed Gradient-Based Algorithm for Constrained Optimization With Application to Economic Dispatch in a Large-Scale Power System
    Guo, Fanghong
    Li, Guoqi
    Wen, Changyun
    Wang, Lei
    Meng, Ziyang
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (04): : 2041 - 2053
  • [14] Gradient Based Projection Method for Constrained Optimization
    Mills, Greg
    Krstic, Miroslav
    [J]. 2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 2966 - 2971
  • [15] Relaxed gradient projection algorithm for constrained node-based shape optimization
    Antonau, Ihar
    Hojjat, Majid
    Bletzinger, Kai-Uwe
    [J]. STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2021, 63 (04) : 1633 - 1651
  • [16] Relaxed gradient projection algorithm for constrained node-based shape optimization
    Ihar Antonau
    Majid Hojjat
    Kai-Uwe Bletzinger
    [J]. Structural and Multidisciplinary Optimization, 2021, 63 : 1633 - 1651
  • [17] SPGD: Search Party Gradient Descent Algorithm, a Simple Gradient-Based Parallel Algorithm for Bound-Constrained Optimization
    Syed Shahul Hameed, A. S.
    Rajagopalan, Narendran
    [J]. MATHEMATICS, 2022, 10 (05)
  • [18] SIMULATION OPTIMIZATION VIA GRADIENT-BASED STOCHASTIC SEARCH
    Zhou, Enlu
    Bhatnagar, Shalabh
    Chen, Xi
    [J]. PROCEEDINGS OF THE 2014 WINTER SIMULATION CONFERENCE (WSC), 2014, : 3869 - 3879
  • [19] An Approximate Gradient Algorithm for Constrained Distributed Convex Optimization
    Yanqiong Zhang
    Youcheng Lou
    Yiguang Hong
    [J]. IEEE/CAAJournalofAutomaticaSinica, 2014, 1 (01) - 67
  • [20] A Generalized Gradient Projection Filter Algorithm for Inequality Constrained Optimization
    Wang, Wei
    Hua, Shaoli
    Tang, Junjie
    [J]. JOURNAL OF APPLIED MATHEMATICS, 2013,