Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method

被引:292
|
作者
Chang, Tsung-Hui [1 ]
Nedic, Angelia [2 ]
Scaglione, Anna [3 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect & Comp Engn, Taipei 10607, Taiwan
[2] Univ Illinois, Dept Ind & Enterprise Syst Engn, Urbana, IL 61801 USA
[3] Univ Calif Davis, Dept Elect & Comp Engn, Davis, CA 95616 USA
基金
美国国家科学基金会;
关键词
Average consensus; constrained optimization; demand side management control; distributed optimization; primal-dual subgradient method; regression; smart grid; CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; ALGORITHMS; REGRESSION;
D O I
10.1109/TAC.2014.2308612
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by emerging applications in smart grid and distributed sparse regression, this paper studies distributed optimization methods for solving general problems which have a coupled global cost function and have inequality constraints. We consider a network scenario where each agent has no global knowledge and can access only its local mapping and constraint functions. To solve this problem in a distributed manner, we propose a consensus-based distributed primal-dual perturbation (PDP) algorithm. In the algorithm, agents employ the average consensus technique to estimate the global cost and constraint functions via exchanging messages with neighbors, and meanwhile use a local primal-dual perturbed subgradient method to approach a global optimum. The proposed PDP method not only can handle smooth inequality constraints but also non-smooth constraints such as some sparsity promoting constraints arising in sparse optimization. We prove that the proposed PDP algorithm converges to an optimal primal-dual solution of the original problem, under standard problem and network assumptions. Numerical results illustrating the performance of the proposed algorithm for a distributed demand response control problem in smart grid are also presented.
引用
收藏
页码:1524 / 1538
页数:15
相关论文
共 50 条
  • [31] STOCHASTIC NESTED PRIMAL-DUAL METHOD FOR NONCONVEX CONSTRAINED COMPOSITION OPTIMIZATION
    Jin, Lingzi
    Wang, Xiao
    [J]. MATHEMATICS OF COMPUTATION, 2024,
  • [32] NESTT: A Nonconvex Primal-Dual Splitting Method for Distributed and Stochastic Optimization
    Hajinezhad, Davood
    Hong, Mingyi
    Zhao, Tuo
    Wang, Zhaoran
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [33] A stochastic primal-dual algorithm for composite constrained optimization
    Su, Enbing
    Hu, Zhihuan
    Xie, Wei
    Li, Li
    Zhang, Weidong
    [J]. NEUROCOMPUTING, 2024, 604
  • [34] A primal-dual flow for affine constrained convex optimization
    Luo, Hao
    [J]. ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2022, 28
  • [35] CONSTRAINED CONSENSUS-BASED OPTIMIZATION
    Borghi, Giacomo
    Herty, Michael
    Pareschi, Lorenzo
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (01) : 211 - 236
  • [36] A Second-Order Primal-Dual Dynamics for Set Constrained Distributed Optimization Problems
    Tao, Meng
    Guo, Luyao
    Cao, Jinde
    Rutkowski, Leszek
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (03) : 1316 - 1320
  • [37] Accelerated Primal-Dual Mirror Dynamics for Centralized and Distributed Constrained Convex Optimization Problems
    Zhao, You
    Liao, Xiaofeng
    He, Xing
    Zhou, Mingliang
    Li, Chaojie
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [38] A First-Order Primal-Dual Method for Nonconvex Constrained Optimization Based on the Augmented Lagrangian
    Zhu, Daoli
    Zhao, Lei
    Zhang, Shuzhong
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2024, 49 (01) : 125 - 150
  • [39] A CLASS OF RANDOMIZED PRIMAL-DUAL ALGORITHMS FOR DISTRIBUTED OPTIMIZATION
    Pesquet, Jean-Christophe
    Repetti, Audrey
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2015, 16 (12) : 2453 - 2490
  • [40] Primal-Dual Algorithm for Distributed Optimization with Coupled Constraints
    Gong, Kai
    Zhang, Liwei
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 201 (01) : 252 - 279