Fast Primal-Dual Gradient Method for Strongly Convex Minimization Problems with Linear Constraints

被引:24
|
作者
Chernov, Alexey [1 ]
Dvurechensky, Pavel [2 ,3 ]
Gasnikov, Alexander [4 ,5 ]
机构
[1] Moscow Inst Phys & Technol, Dolgoprudnyi 141700, Moscow Oblast, Russia
[2] Weierstrass Inst Appl Anal & Stochast, D-10117 Berlin, Germany
[3] Inst Informat Transmiss Problems, Moscow 127051, Russia
[4] Moscow Inst Phys & Technol, Dolgoprudnyi 141700, Moscow Oblast, Russia
[5] Inst Informat Transmiss Problems, Moscow 127051, Russia
关键词
Convex optimization; Algorithm complexity; Entropy-linear programming; Dual problem; Primal-dual method; DECOMPOSITION;
D O I
10.1007/978-3-319-44914-2_31
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality constraints. Quite a number of optimization problems in applications can be stated in this form, examples being entropy-linear programming, ridge regression, elastic net, regularized optimal transport, etc. We extend the Fast Gradient Method applied to the dual problem in order to make it primal-dual, so that it allows not only to solve the dual problem, but also to construct nearly optimal and nearly feasible solution of the primal problem. We also prove a theorem about the convergence rate for the proposed algorithm in terms of the objective function residual and the linear constraints infeasibility.
引用
收藏
页码:391 / 403
页数:13
相关论文
共 50 条
  • [1] A New Prediction-Correction Primal-Dual Hybrid Gradient Algorithm for Solving Convex Minimization Problems with Linear Constraints
    Alipour, Fahimeh
    Eslahchi, Mohammad Reza
    Hajarian, Masoud
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2024, 66 (03) : 231 - 245
  • [2] A Decentralized Primal-Dual Method for Constrained Minimization of a Strongly Convex Function
    Hamedani, Erfan Yazdandoost
    Aybat, Necdet Serhat
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (11) : 5682 - 5697
  • [3] A prediction-correction primal-dual hybrid gradient method for convex programming with linear constraints
    Bing, Pibin
    Sui, Jialei
    Sun, Min
    [J]. SCIENCEASIA, 2018, 44 (01): : 34 - 39
  • [4] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Jalilzadeh, Afrooz
    [J]. OPTIMIZATION LETTERS, 2021, 15 (08) : 2541 - 2554
  • [5] Primal-dual incremental gradient method for nonsmooth and convex optimization problems
    Afrooz Jalilzadeh
    [J]. Optimization Letters, 2021, 15 : 2541 - 2554
  • [6] PRIMAL-DUAL STOCHASTIC GRADIENT METHOD FOR CONVEX PROGRAMS WITH MANY FUNCTIONAL CONSTRAINTS
    Xu, Yangyang
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (02) : 1664 - 1692
  • [7] A primal-dual dynamical approach to structured convex minimization problems
    Bot, Radu Ioan
    Csetnek, Erno Robert
    Laszlo, Szilard Csaba
    [J]. JOURNAL OF DIFFERENTIAL EQUATIONS, 2020, 269 (12) : 10717 - 10757
  • [8] Variable Metric Primal-Dual Method for Convex Optimization Problems with Changing Constraints
    Konnov I.V.
    [J]. Lobachevskii Journal of Mathematics, 2023, 44 (1) : 354 - 365
  • [9] A New Prediction–Correction Primal–Dual Hybrid Gradient Algorithm for Solving Convex Minimization Problems with Linear Constraints
    Fahimeh Alipour
    Mohammad Reza Eslahchi
    Masoud Hajarian
    [J]. Journal of Mathematical Imaging and Vision, 2024, 66 : 231 - 245
  • [10] Gradient Descent Averaging and Primal-dual Averaging for Strongly Convex Optimization
    Tao, Wei
    Li, Wei
    Pan, Zhisong
    Tao, Qing
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 9843 - 9850