A fast dual proximal-gradient method for separable convex optimization with linear coupled constraints

被引:17
|
作者
Li, Jueyou [1 ,2 ]
Chen, Guo [2 ]
Dong, Zhaoyang [2 ]
Wu, Zhiyou [1 ]
机构
[1] Chongqing Normal Univ, Sch Math Sci, Chongqing 400047, Peoples R China
[2] Univ Sydney, Sch Elect & Informat Engn, Sydney, NSW 2006, Australia
关键词
Convex optimization; Dual decomposition; Smoothing technique; Fast proximal-gradient method; Parallel computation; SMOOTHING TECHNIQUE; DECOMPOSITION; ALGORITHM; MINIMIZATION; PROJECTION;
D O I
10.1007/s10589-016-9826-0
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
In this paper we consider a class of separable convex optimization problems with linear coupled constraints arising in many applications. Based on Nesterov's smoothing technique and a fast gradient scheme, we present a fast dual proximal-gradient method to solve this class of problems. Under some conditions, we then give the convergence analysis of the proposed method and show that the computational complexity bound of the method for achieving an -optimal feasible solution is . To further accelerate the proposed algorithm, we utilize a restart technique by successively decreasing the smoothing parameter. The advantage of our algorithms allows us to obtain the dual and primal approximate solutions simultaneously, which is fast and can be implemented in a parallel fashion. Several numerical experiments are presented to illustrate the effectiveness of the proposed algorithms. The numerical results validate the efficiency of our methods.
引用
收藏
页码:671 / 697
页数:27
相关论文
共 50 条
  • [1] A fast dual proximal-gradient method for separable convex optimization with linear coupled constraints
    Jueyou Li
    Guo Chen
    Zhaoyang Dong
    Zhiyou Wu
    [J]. Computational Optimization and Applications, 2016, 64 : 671 - 697
  • [2] An Inexact Dual Fast Gradient-Projection Method for Separable Convex Optimization with Linear Coupled Constraints
    Jueyou Li
    Zhiyou Wu
    Changzhi Wu
    Qiang Long
    Xiangyu Wang
    [J]. Journal of Optimization Theory and Applications, 2016, 168 : 153 - 171
  • [3] An Inexact Dual Fast Gradient-Projection Method for Separable Convex Optimization with Linear Coupled Constraints
    Li, Jueyou
    Wu, Zhiyou
    Wu, Changzhi
    Long, Qiang
    Wang, Xiangyu
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 168 (01) : 153 - 171
  • [4] DISTRIBUTED PROXIMAL-GRADIENT METHOD FOR CONVEX OPTIMIZATION WITH INEQUALITY CONSTRAINTS
    Li, Jueyou
    Wu, Changzhi
    Wu, Zhiyou
    Long, Qiang
    Wang, Xiangyu
    [J]. ANZIAM JOURNAL, 2014, 56 (02): : 160 - 178
  • [5] A FAST DUAL GRADIENT METHOD FOR SEPARABLE CONVEX OPTIMIZATION VIA SMOOTHING
    Li, Jueyou
    Wu, Zhiyou
    Wu, Changzhi
    Long, Qiang
    Wang, Xiangyu
    Lee, Jae-Myung
    Jung, Kwang-Hyo
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2016, 12 (02): : 289 - +
  • [6] A Fast Distributed Proximal-Gradient Method
    Chen, Annie I.
    Ozdaglar, Asuman
    [J]. 2012 50TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2012, : 601 - 608
  • [7] Numerical experiments on stochastic block proximal-gradient type method for convex constrained optimization involving coordinatewise separable problems
    Promsinchai, Porntip
    Petrot, Narin
    [J]. CARPATHIAN JOURNAL OF MATHEMATICS, 2019, 35 (03) : 371 - 378
  • [8] Inexact Online Proximal-gradient Method for Time-varying Convex Optimization
    Ajalloeian, Amirhossein
    Simonetto, Andrea
    Dall'Anese, Emiliano
    [J]. 2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 2850 - 2857
  • [9] A partially proximal S-ADMM for separable convex optimization with linear constraints
    Shen, Yuan
    Zuo, Yannian
    Yu, Aolin
    [J]. APPLIED NUMERICAL MATHEMATICS, 2021, 160 : 65 - 83
  • [10] An Inertial Proximal-Gradient Penalization Scheme for Constrained Convex Optimization Problems
    Boţ R.I.
    Csetnek E.R.
    Nimana N.
    [J]. Vietnam Journal of Mathematics, 2018, 46 (1) : 53 - 71