Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization∗

被引：0
|
作者：
Li, Zhize [1 ]
Li, Jian [2 ]
机构：
[1] Department of Electrical and Computer Engineering Carnegie Mellon University, Pittsburgh,PA,15213, United States
[2] Institute for Interdisciplinary Information Sciences Tsinghua University, Beijing,100084, China
来源：
Journal of Machine Learning Research | 2022年 / 23卷
基金：
中国国家自然科学基金;
关键词：
Gradient-descent - Local minimums - Nonconvex optimization - Nonconvex-optimization - Optimal algorithm - Proximal gradient descent - Simple++ - Stationary points - Stochastic gradient algorithms - Variance reductions;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
相关论文
共 50 条
  • [21] Stochastic subgradient algorithm for nonsmooth nonconvex optimization
    Yalcin, Gulcin Dinc
    JOURNAL OF APPLIED MATHEMATICS AND COMPUTING, 2024, 70 (01) : 317 - 334
  • [22] PAGE: A Simple and Optimal Probabilistic Gradient Estimator for Nonconvex Optimization
    Li, Zhize
    Bao, Hongyan
    Zhang, Xiangliang
    Richtarik, Peter
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [23] Convergence of the gradient sampling algorithm for nonsmooth nonconvex optimization
    Kiwiel, Krzysztof C.
    SIAM JOURNAL ON OPTIMIZATION, 2007, 18 (02) : 379 - 388
  • [24] Gradient set splitting in nonconvex nonsmooth numerical optimization
    Gaudioso, Manlio
    Gorgone, Enrico
    OPTIMIZATION METHODS & SOFTWARE, 2010, 25 (01): : 59 - 74
  • [25] A robust gradient sampling algorithm for nonsmooth, nonconvex optimization
    Burke, JV
    Lewis, AS
    Overton, ML
    SIAM JOURNAL ON OPTIMIZATION, 2005, 15 (03) : 751 - 779
  • [26] Stability and Generalization of Stochastic Optimization with Nonconvex and Nonsmooth Problems
    Lei, Yunwen
    THIRTY SIXTH ANNUAL CONFERENCE ON LEARNING THEORY, VOL 195, 2023, 195 : 191 - 227
  • [27] A STOCHASTIC SEMISMOOTH NEWTON METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION
    Milzarek, Andre
    Xiao, Xiantao
    Cen, Shicong
    Wen, Zaiwen
    Ulbrich, Michael
    SIAM JOURNAL ON OPTIMIZATION, 2019, 29 (04) : 2916 - 2948
  • [28] pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Nonconvex Optimization
    Zhou, Beitong
    Liu, Jun
    Sun, Weigao
    Chen, Ruijuan
    Tomlin, Claire
    Yuan, Ye
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3258 - 3266
  • [29] An Algorithm with Optimal Dimension-Dependence for Zero-Order Nonsmooth Nonconvex Stochastic Optimization
    Kornowski, Guy
    Orabona, Francesco
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 : 1 - 14
  • [30] Proximal gradient method for nonconvex and nonsmooth optimization on Hadamard manifolds
    Feng, Shuailing
    Huang, Wen
    Song, Lele
    Ying, Shihui
    Zeng, Tieyong
    OPTIMIZATION LETTERS, 2022, 16 (08) : 2277 - 2297
12345