Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization∗

被引：0
|
作者：
Li, Zhize [1 ]
Li, Jian [2 ]
机构：
[1] Department of Electrical and Computer Engineering Carnegie Mellon University, Pittsburgh,PA,15213, United States
[2] Institute for Interdisciplinary Information Sciences Tsinghua University, Beijing,100084, China
来源：
Journal of Machine Learning Research | 2022年 / 23卷
基金：
中国国家自然科学基金;
关键词：
Gradient-descent - Local minimums - Nonconvex optimization - Nonconvex-optimization - Optimal algorithm - Proximal gradient descent - Simple++ - Stationary points - Stochastic gradient algorithms - Variance reductions;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
相关论文
共 50 条
  • [41] Gradient-Free Multi-Agent Nonconvex Nonsmooth Optimization
    Hajinezhad, Davood
    Zavlanos, Michael M.
    2018 IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2018, : 4939 - 4944
  • [42] An accelerated stochastic ADMM for nonconvex and nonsmooth finite-sum optimization
    Zeng, Yuxuan
    Wang, Zhiguo
    Bai, Jianchao
    Shen, Xiaojing
    AUTOMATICA, 2024, 163
  • [43] Combination of steepest descent and BFGS methods for nonconvex nonsmooth optimization
    Rohollah Yousefpour
    Numerical Algorithms, 2016, 72 : 57 - 90
  • [44] Combination of steepest descent and BFGS methods for nonconvex nonsmooth optimization
    Yousefpour, Rohollah
    NUMERICAL ALGORITHMS, 2016, 72 (01) : 57 - 90
  • [45] On the local convergence of a stochastic semismooth Newton method for nonsmooth nonconvex optimization
    Andre Milzarek
    Xiantao Xiao
    Zaiwen Wen
    Michael Ulbrich
    Science China(Mathematics), 2022, 65 (10) : 2151 - 2170
  • [46] Direct Search and Stochastic Optimization Applied to Two Nonconvex Nonsmooth Problems
    Easterling, David R.
    Watson, Layne T.
    Madigan, Michael L.
    Castle, Brent S.
    Trosset, Michael W.
    HIGH PERFORMANCE COMPUTING SYMPOSIUM 2012 (HPC 2012), 2012, 44 (06): : 66 - 72
  • [47] A FUNCTIONAL MODEL METHOD FOR NONCONVEX NONSMOOTH CONDITIONAL STOCHASTIC OPTIMIZATION\ast
    Ruszczynski, Andrzej
    Yang, Shangzhe
    SIAM JOURNAL ON OPTIMIZATION, 2024, 34 (03) : 3064 - 3087
  • [48] Proximal stochastic recursive momentum algorithm for nonsmooth nonconvex optimization problems
    Wang, Zhaoxin
    Wen, Bo
    OPTIMIZATION, 2024, 73 (02) : 481 - 495
  • [49] Convergence of a stochastic subgradient method with averaging for nonsmooth nonconvex constrained optimization
    Ruszczynski, Andrzej
    OPTIMIZATION LETTERS, 2020, 14 (07) : 1615 - 1625
  • [50] Convergence of a stochastic subgradient method with averaging for nonsmooth nonconvex constrained optimization
    Andrzej Ruszczyński
    Optimization Letters, 2020, 14 : 1615 - 1625
12345