ON SIMPLIFYING THE PRIMAL-DUAL METHOD OF MULTIPLIERS

被引:0
|
作者
Zhang, Guoqiang [1 ]
Heusdens, Richard [1 ]
机构
[1] Delft Univ Technol, Circuits & Syst Grp, NL-2600 AA Delft, Netherlands
关键词
Distributed optimization; PDMM; ADMM; SVM;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Recently, the primal-dual method of multipliers (PDMM) has been proposed to solve a convex optimization problem defined over a general graph. In this paper, we consider simplifying PDMM for a subclass of the convex optimization problems. This subclass includes the consensus problem as a special form. By using algebra, we show that the update expressions of PDMM can be simplified significantly. We then evaluate PDMM for training a support vector machine (SVM). The experimental results indicate that PDMM converges considerably faster than the alternating direction method of multipliers (ADMM).
引用
收藏
页码:4826 / 4830
页数:5
相关论文
共 50 条
  • [1] Distributed Optimization Using the Primal-Dual Method of Multipliers
    Zhang, Guoqiang
    Heusdens, Richard
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2018, 4 (01): : 173 - 187
  • [2] ON CONVERGENCE ANALYSIS OF GRADIENT BASED PRIMAL-DUAL METHOD OF MULTIPLIERS
    Zhang, Guoqiang
    O'Connor, Matthew
    Li, Le
    [J]. 2018 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2018, : 11 - 15
  • [3] Revisiting the Primal-Dual Method of Multipliers for Optimisation Over Centralised Networks
    Zhang, Guoqiang
    Niwa, Kenta
    Kleijn, W. Bastiaan
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 : 228 - 243
  • [4] Ad Hoc Microphone Array Beamforming Using the Primal-Dual Method of Multipliers
    Tavakoli, Vincent M.
    Jensen, Jesper R.
    Heusdens, Richard
    Benesty, Jacob
    Christensen, Mads G.
    [J]. 2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 1088 - 1092
  • [5] Derivation and Analysis of the Primal-Dual Method of Multipliers Based on Monotone Operator Theory
    Sherson, Thomas William
    Heusdens, Richard
    Kleijn, W. Bastiaan
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2019, 5 (02): : 334 - 347
  • [6] QUADRATIC CONVERGENCE IN A PRIMAL-DUAL METHOD
    MEHROTRA, S
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 1993, 18 (03) : 741 - 751
  • [7] A primal-dual method for SVM training
    Djemai, Samia
    Brahmi, Belkacem
    Bibi, Mohand Ouamer
    [J]. NEUROCOMPUTING, 2016, 211 : 34 - 40
  • [8] Distributed Regularized Primal-Dual Method
    Badiei, Masoud
    Li, Na
    [J]. 2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 540 - 544
  • [9] PRIMAL-DUAL METHOD FOR BOUNDED VARIABLES
    EISEMANN, K
    [J]. OPERATIONS RESEARCH, 1964, 12 (01) : 110 - &
  • [10] The primal-dual method for approximation algorithms
    Williamson, DP
    [J]. MATHEMATICAL PROGRAMMING, 2002, 91 (03) : 447 - 478