An optimal gradient method for smooth strongly convex minimization

被引:0
|
作者
Adrien Taylor
Yoel Drori
机构
[1] PSL Research University,INRIA, Département d’informatique de l’ENS, École normale supérieure, CNRS
[2] Google Research Israel,undefined
来源
Mathematical Programming | 2023年 / 199卷
关键词
D O I
暂无
中图分类号
学科分类号
摘要
We present an optimal gradient method for smooth strongly convex optimization. The method is optimal in the sense that its worst-case bound on the distance to an optimal point exactly matches the lower bound on the oracle complexity for the class of problems, meaning that no black-box first-order method can have a better worst-case guarantee without further assumptions on the class of problems at hand. In addition, we provide a constructive recipe for obtaining the algorithmic parameters of the method and illustrate that it can be used for deriving methods for other optimality criteria as well.
引用
收藏
页码:557 / 594
页数:37
相关论文
共 50 条
  • [1] An optimal gradient method for smooth strongly convex minimization
    Taylor, Adrien
    Drori, Yoel
    [J]. MATHEMATICAL PROGRAMMING, 2023, 199 (1-2) : 557 - 594
  • [2] GENERALIZING THE OPTIMIZED GRADIENT METHOD FOR SMOOTH CONVEX MINIMIZATION
    Kim, Donghwan
    Fessler, Jeffrey A.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (02) : 1920 - 1950
  • [3] An Extended Gradient Method for Smooth and Strongly Convex Functions
    Zhang, Xuexue
    Liu, Sanyang
    Zhao, Nannan
    [J]. MATHEMATICS, 2023, 11 (23)
  • [4] On convergence of inexact projection gradient method for strongly convex minimization
    Necoara, Ion
    Patrascu, Andrei
    Clipici, Dragos
    Barbu, Marian
    [J]. 2017 21ST INTERNATIONAL CONFERENCE ON SYSTEM THEORY, CONTROL AND COMPUTING (ICSTCC), 2017, : 506 - 511
  • [5] On the oracle complexity of smooth strongly convex minimization
    Drori, Yoel
    Taylor, Adrien
    [J]. JOURNAL OF COMPLEXITY, 2022, 68
  • [6] OPTIMAL METHODS OF SMOOTH CONVEX MINIMIZATION
    NEMIROVSKII, AS
    NESTEROV, YE
    [J]. USSR COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 1985, 25 (02): : 21 - 30
  • [7] Optimal processes in smooth-convex minimization problems
    Tsintsadze Z.A.
    [J]. Journal of Mathematical Sciences, 2008, 148 (3) : 399 - 480
  • [8] Fast Primal-Dual Gradient Method for Strongly Convex Minimization Problems with Linear Constraints
    Chernov, Alexey
    Dvurechensky, Pavel
    Gasnikov, Alexander
    [J]. DISCRETE OPTIMIZATION AND OPERATIONS RESEARCH, DOOR 2016, 2016, 9869 : 391 - 403
  • [9] THE UNIT VECTOR METHOD OF SMOOTH CONVEX MINIMIZATION
    NEMIROVSKIY, AS
    [J]. ENGINEERING CYBERNETICS, 1982, 20 (02): : 13 - 23
  • [10] Alternating Proximal Gradient Method for Convex Minimization
    Shiqian Ma
    [J]. Journal of Scientific Computing, 2016, 68 : 546 - 572