A Primal-Dual Forward-Backward Splitting Algorithm for Distributed Convex Optimization

被引:12
|
作者
Li, Huaqing [1 ]
Su, Enbing [1 ]
Wang, Chengbo [2 ]
Liu, Jiawei [2 ]
Zheng, Zuqing [1 ]
Wang, Zheng [3 ]
Xia, Dawen [4 ]
机构
[1] Southwest Univ, Chongqing Key Lab Nonlinear Circuits & Intelligen, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[2] Southwest Univ, Westa Coll, Chongqing 400715, Peoples R China
[3] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
[4] Guizhou Minzu Univ, Coll Data Sci & Informat Engn, Guiyang 550025, Peoples R China
基金
中国国家自然科学基金;
关键词
Optimization; Convex functions; Convergence; Wireless sensor networks; Wireless communication; Symmetric matrices; Smart grids; Forward-backward splitting method; distributed optimization; primal-dual algorithm; non-smooth function; SOLVING MONOTONE INCLUSIONS;
D O I
10.1109/TETCI.2021.3098831
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Motivated by modern large-scale information processing problems in engineering, this paper concentrates on studying distributed constrained convex optimization problems over a connected undirected network. The problem involves a sum of a differentiable convex function with Lipschitz continuous gradient and two non-smooth convex functions with a linear operator. To solve such a problem, we propose a novel distributed primal-dual forward-backward splitting algorithm, called D-PDFBS. Each agent locally computes the Lipschitz continuous gradient and two proximal operators, and exchanges information with its neighbors. D-PDFBS adopts non-identical stepsizes, and we reveal the relationship between selection of stepsizes and parameters of objective functions. The simulation results verify the feasibility of D-PDFBS and the correctness of theoretical findings.
引用
收藏
页码:278 / 284
页数:7
相关论文
共 50 条
  • [21] New Primal-Dual Proximal Algorithm for Distributed Optimization
    Latafat, Puya
    Stella, Lorenzo
    Patrinos, Panagiotis
    [J]. 2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 1959 - 1964
  • [22] A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization
    Xinlei Yi
    Shengjun Zhang
    Tao Yang
    Tianyou Chai
    Karl Henrik Johansson
    [J]. IEEE/CAA Journal of Automatica Sinica, 2022, (05) : 812 - 833
  • [23] A Golden Ratio Primal-Dual Algorithm for Structured Convex Optimization
    Chang, Xiaokai
    Yang, Junfeng
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2021, 87 (02)
  • [24] Projected Primal-Dual Dynamics for Distributed Constrained Nonsmooth Convex Optimization
    Zhu, Yanan
    Yu, Wenwu
    Wen, Guanghui
    Chen, Guanrong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (04) : 1776 - 1782
  • [25] NESTT: A Nonconvex Primal-Dual Splitting Method for Distributed and Stochastic Optimization
    Hajinezhad, Davood
    Hong, Mingyi
    Zhao, Tuo
    Wang, Zhaoran
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [26] An Inertial Parallel and Asynchronous Forward-Backward Iteration for Distributed Convex Optimization
    Stathopoulos, Giorgos
    Jones, Colin N.
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2019, 182 (03) : 1088 - 1119
  • [27] A forward-backward Bregman splitting scheme for regularized distributed optimization problems
    Xu, Jinming
    Zhu, Shanying
    Soh, Yeng Chai
    Xie, Lihua
    [J]. 2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 1093 - 1098
  • [28] A Prediction-Correction Primal-Dual Algorithm for Distributed Optimization
    Paternain, Santiago
    Fazlyab, Mahyar
    Preciado, Victor M.
    Ribeiro, Alejandro
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 835 - 841
  • [29] Linear convergence of a primal-dual algorithm for distributed interval optimization
    Wang, Yinghui
    Wang, Jiuwei
    Song, Xiaobo
    Hu, Yanpeng
    [J]. ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (02): : 857 - 873
  • [30] A Primal-Dual Algorithm for Distributed Stochastic Optimization with Equality Constraints
    Du, Kai-Xin
    Chen, Xing-Min
    [J]. 2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 5586 - 5591