Nesterov's Method for Convex Optimization

被引:2
|
作者
Walkington, Noel J. [1 ]
机构
[1] Carnegie Mellon Univ, Dept Math, Pittsburgh, PA 15213 USA
关键词
convex optimization; Nesterov's algorithm; steepest descent;
D O I
10.1137/21M1390037
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
While Nesterov's algorithm for computing the minimum of a convex function is now over forty years old, it is rarely presented in texts for a first course in optimization. This is unfortunate since for many problems this algorithm is superior to the ubiquitous steepest descent algorithm, and it is equally simple to implement. This article presents an elementary analysis of Nesterov's algorithm that parallels that of steepest descent. It is envisioned that this presentation of Nesterov's algorithm could easily be covered in a few lectures following the introductory material on convex functions and steepest descent included in every course on optimization.
引用
收藏
页码:539 / 562
页数:24
相关论文
共 50 条
  • [21] Understanding Nesterov's Acceleration via Proximal Point Method
    Ahn, Kwangjun
    Sra, Suvrit
    2022 SYMPOSIUM ON SIMPLICITY IN ALGORITHMS, SOSA, 2022, : 117 - 130
  • [22] An Explicit Convergence Rate for Nesterov's Method from SDP
    Safavi, Sam
    Joshi, Bikash
    Franca, Guilherme
    Bento, Jose
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 1560 - 1564
  • [23] ePlace: Electrostatics Based Placement Using Nesterov's Method
    Lu, Jingwei
    Chen, Pengwen
    Chang, Chin-Chih
    Sha, Lu
    Huang, Dennis J-H
    Teng, Chin-Chi
    Cheng, Chung-Kuan
    2014 51ST ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2014,
  • [24] Vaidya's Method for Convex Stochastic Optimization Problems in Small Dimension
    Gladin, E. L.
    Gasnikov, A., V
    Ermakova, E. S.
    MATHEMATICAL NOTES, 2022, 112 (1-2) : 183 - 190
  • [25] Vaidya’s Method for Convex Stochastic Optimization Problems in Small Dimension
    E. L. Gladin
    A. V. Gasnikov
    E. S. Ermakova
    Mathematical Notes, 2022, 112 : 183 - 190
  • [26] A decentralized Nesterov gradient method for stochastic optimization over unbalanced directed networks
    Hu, Jinhui
    Xia, Dawen
    Cheng, Huqiang
    Feng, Liping
    Ji, Lianghao
    Guo, Jing
    Li, Huaqing
    ASIAN JOURNAL OF CONTROL, 2022, 24 (02) : 576 - 593
  • [27] On the Convergence of Nesterov's Accelerated Gradient Method in Stochastic Settings
    Assran, Mahmoud
    Rabbat, Michael
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [28] Nesterov's Smoothing and Excessive Gap Methods for an Optimization Problem in VLSI Placement
    Chen, Jian-Li
    Cui, Yan
    Zhu, Wen-Xing
    JOURNAL OF THE OPERATIONS RESEARCH SOCIETY OF CHINA, 2014, 2 (04) : 423 - 443
  • [29] Polyak Minorant Method for Convex Optimization
    Devanathan, Nikhil
    Boyd, Stephen
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2024, 203 (3) : 2263 - 2282
  • [30] Accelerated Distributed Nesterov Gradient Descent for Convex and Smooth Functions
    Qu, Guannan
    Li, Na
    2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,