Nesterov's Method for Convex Optimization

被引:2
|
作者
Walkington, Noel J. [1 ]
机构
[1] Carnegie Mellon Univ, Dept Math, Pittsburgh, PA 15213 USA
关键词
convex optimization; Nesterov's algorithm; steepest descent;
D O I
10.1137/21M1390037
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
While Nesterov's algorithm for computing the minimum of a convex function is now over forty years old, it is rarely presented in texts for a first course in optimization. This is unfortunate since for many problems this algorithm is superior to the ubiquitous steepest descent algorithm, and it is equally simple to implement. This article presents an elementary analysis of Nesterov's algorithm that parallels that of steepest descent. It is envisioned that this presentation of Nesterov's algorithm could easily be covered in a few lectures following the introductory material on convex functions and steepest descent included in every course on optimization.
引用
收藏
页码:539 / 562
页数:24
相关论文
共 50 条
  • [1] On the transient growth of Nesterov's accelerated method for strongly convex optimization problems
    Samuelson, Samantha
    Mohammadi, Hesameddin
    Jovanovic, Mihailo R.
    [J]. 2020 59TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2020, : 5911 - 5916
  • [2] Nesterov Accelerated Shuffling Gradient Method for Convex Optimization
    Tran, Trang H.
    Scheinberg, Katya
    Nguyen, Lam M.
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [3] Performance of noisy Nesterov's accelerated method for strongly convex optimization problems
    Mohammadi, Hesameddin
    Razaviyayn, Meisam
    Jovanovic, Mihailo R.
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 3426 - 3431
  • [4] A Stochastic Nesterov's Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Wang, Ruyu
    Zhang, Chao
    Wang, Lichun
    Shao, Yuanhai
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (02)
  • [5] A Stochastic Nesterov’s Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Ruyu Wang
    Chao Zhang
    Lichun Wang
    Yuanhai Shao
    [J]. Journal of Scientific Computing, 2022, 93
  • [6] A secant-based Nesterov method for convex functions
    Alli-Oke, Razak O.
    Heath, William P.
    [J]. OPTIMIZATION LETTERS, 2017, 11 (01) : 81 - 105
  • [7] An Extension of the Second Order Dynamical System that Models Nesterov’s Convex Gradient Method
    Cristian Daniel Alecsa
    Szilárd Csaba László
    Titus Pinţa
    [J]. Applied Mathematics & Optimization, 2021, 84 : 1687 - 1716
  • [8] A secant-based Nesterov method for convex functions
    Razak O. Alli-Oke
    William P. Heath
    [J]. Optimization Letters, 2017, 11 : 81 - 105
  • [9] An Extension of the Second Order Dynamical System that Models Nesterov's Convex Gradient Method
    Alecsa, Cristian Daniel
    Laszlo, Szilard Csaba
    Pinta, Titus
    [J]. APPLIED MATHEMATICS AND OPTIMIZATION, 2021, 84 (02): : 1687 - 1716
  • [10] Domain Decomposition with Nesterov's Method
    Andzembe, Firmin
    Koko, Jonas
    Sassi, Taoufik
    [J]. DOMAIN DECOMPOSITION METHODS IN SCIENCE AND ENGINEERING XXI, 2014, 98 : 947 - 954