THE METHOD OF GRADIENT DESCENT FOR MINIMIZING NONCONVEX FUNCTIONS

被引：0
|
作者：
IZMAILOV, AF
TRETYAKOV, AA
机构：
来源：
COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS | 1994年 / 34卷 / 03期
关键词：
D O I：
暂无
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
The conditions for strong convergence and the possibility of estimating the rate of convergence of the method of gradient descent are investigated. This method is effective for the unconditional minimization of a wider class of functions than is conventionally assumed.
引用
收藏
页码：287 / 299
页数：13
相关论文
共 50 条
  • [1] ON DISTRIBUTED STOCHASTIC GRADIENT DESCENT FOR NONCONVEX FUNCTIONS IN THE PRESENCE OF BYZANTINES
    Bulusu, Saikiran
    Khanduri, Prashant
    Sharma, Pranay
    Varshney, Pramod K.
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3137 - 3141
  • [2] On Nonconvex Decentralized Gradient Descent
    Zeng, Jinshan
    Yin, Wotao
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (11) : 2834 - 2848
  • [3] Convergence of the steepest descent method for minimizing quasiconvex functions
    Kiwiel, KC
    Murty, K
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1996, 89 (01) : 221 - 226
  • [4] A modified descent Polak-Ribiere-Polyak conjugate gradient method with global convergence property for nonconvex functions
    Aminifard, Zohre
    Babaie-Kafaki, Saman
    [J]. CALCOLO, 2019, 56 (02)
  • [5] A modified descent Polak–Ribiére–Polyak conjugate gradient method with global convergence property for nonconvex functions
    Zohre Aminifard
    Saman Babaie-Kafaki
    [J]. Calcolo, 2019, 56
  • [6] On the diffusion approximation of nonconvex stochastic gradient descent
    Hu, Wenqing
    Li, Chris Junchi
    Li, Lei
    Liu, Jian-Guo
    [J]. ANNALS OF MATHEMATICAL SCIENCES AND APPLICATIONS, 2019, 4 (01) : 3 - 32
  • [7] DECOMPOSITION METHOD OF DESCENT FOR MINIMIZING THE SUM OF CONVEX NONSMOOTH FUNCTIONS
    KIWIEL, KC
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1987, 52 (02) : 255 - 271
  • [8] Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization
    Zheng, Taoli
    Zhu, Linglingzhi
    So, Anthony Man-Cho
    Blanchet, Jose
    Li, Jiajin
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization
    Zheng, Taoli
    Zhu, Linglingzhi
    So, Anthony Man-Cho
    Blanchet, José
    Li, Jiajin
    [J]. Advances in Neural Information Processing Systems, 2023, 36 : 54075 - 54110
  • [10] Global convergence of a descent PRP type conjugate gradient method for nonconvex optimization
    Hu, Qingjie
    Zhang, Hongrun
    Chen, Yu
    [J]. APPLIED NUMERICAL MATHEMATICS, 2022, 173 : 38 - 50
12345