Distributed Coordination for Nonsmooth Convex Optimization via Saddle-Point Dynamics

被引:44
|
作者
Cortes, Jorge [1 ]
Niederlaender, Simon K. [2 ]
机构
[1] Univ Calif San Diego, Jacobs Sch Engn, Dept Mech & Aerosp Engn, 9500 Gilman Dr, La Jolla, CA 92093 USA
[2] Univ Stuttgart, Inst Syst Theory & Automat Control, D-70550 Stuttgart, Germany
关键词
Distributed multi-agent coordination; Nonsmooth convex optimization; Saddle-point dynamics; Continuous-time optimization algorithms; NASH EQUILIBRIA; STABILITY; CONVERGENCE; SYSTEMS; NETWORK; DECOMPOSITION; CONSENSUS; DESIGN;
D O I
10.1007/s00332-018-9516-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper considers continuous-time coordination algorithms for networks of agents that seek to collectively solve a general class of nonsmooth convex optimization problems with an inherent distributed structure. Our algorithm design builds on the characterization of the solutions of the nonsmooth convex program as saddle points of an augmented Lagrangian. We show that the associated saddle-point dynamics are asymptotically correct but, in general, not distributed because of the presence of a global penalty parameter. This motivates the design of a discontinuous saddle-point-like algorithm that enjoys the same convergence properties and is fully amenable to distributed implementation. Our convergence proofs rely on the identification of a novel global Lyapunov function for saddle-point dynamics. This novelty also allows us to identify mild convexity and regularity conditions on the objective function that guarantee the exponential convergence rate of the proposed algorithms for convex optimization problems subject to equality constraints. Various examples illustrate our discussion.
引用
收藏
页码:1247 / 1272
页数:26
相关论文
共 50 条
  • [1] Distributed Coordination for Nonsmooth Convex Optimization via Saddle-Point Dynamics
    Jorge Cortés
    Simon K. Niederländer
    [J]. Journal of Nonlinear Science, 2019, 29 : 1247 - 1272
  • [2] Saddle-point Dynamics for Distributed Convex Optimization on General Directed Graphs
    Touri, Behrouz
    Gharesifard, Bahman
    [J]. 2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 862 - 866
  • [3] A Modified Saddle-Point Dynamics for Distributed Convex Optimization on General Directed Graphs
    Touri, Behrouz
    Gharesifard, Bahman
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (07) : 3098 - 3103
  • [4] A Unified Distributed Method for Constrained Networked Optimization via Saddle-Point Dynamics
    Huang, Yi
    Meng, Ziyang
    Sun, Jian
    Ren, Wei
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (03) : 1818 - 1825
  • [5] Distributed Stochastic Optimization of Regularized Risk via Saddle-Point Problem
    Matsushima, Shin
    Yun, Hyokun
    Zhang, Xinhua
    Vishwanathan, S. V. N.
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 460 - 476
  • [6] A simple algorithm for a class of nonsmooth convex-concave saddle-point problems
    Drori, Yoel
    Sabach, Shoham
    Teboulle, Marc
    [J]. OPERATIONS RESEARCH LETTERS, 2015, 43 (02) : 209 - 214
  • [7] Nonsmooth Interval-Valued Optimization and Saddle-Point Optimality Criteria
    Anurag Jayswal
    I. Ahmad
    Jonaki Banerjee
    [J]. Bulletin of the Malaysian Mathematical Sciences Society, 2016, 39 : 1391 - 1411
  • [8] Nonsmooth Interval-Valued Optimization and Saddle-Point Optimality Criteria
    Jayswal, Anurag
    Ahmad, I.
    Banerjee, Jonaki
    [J]. BULLETIN OF THE MALAYSIAN MATHEMATICAL SCIENCES SOCIETY, 2016, 39 (04) : 1391 - 1411
  • [9] Exponentially Fast Distributed Coordination for Nonsmooth Convex Optimization
    Niederlaender, Simon K.
    Allgoewer, Frank
    Cortes, Jorge
    [J]. 2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 1036 - 1041
  • [10] A DISTRIBUTED FIRST-ORDER OPTIMIZATION METHOD FOR STRONGLY CONCAVE-CONVEX SADDLE-POINT PROBLEMS
    Qureshi, Muhammad I.
    Khan, Usman A.
    [J]. 2023 IEEE 9TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING, CAMSAP, 2023, : 121 - 125