A dual-based stochastic inexact algorithm for a class of stochastic nonsmooth convex composite problems

被引:0
|
作者
Gui-Hua Lin
Zhen-Ping Yang
Hai-An Yin
Jin Zhang
机构
[1] Shanghai University,School of Management
[2] Jiaying University,School of Mathematics
[3] Southern University of Science and Technology,Department of Mathematics
[4] Peng Cheng Laboratory,Department of Mathematics, SUSTech International Center for Mathematics, Southern University of Science and Technology, National Center for Applied Mathematics Shenzhen
关键词
Stochastic programming; Stochastic approximation; Duality; Convergence rate; 90C06; 90C15; 90C25;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a dual-based stochastic inexact algorithm is developed to solve a class of stochastic nonsmooth convex problems with underlying structure. This algorithm can be regarded as an integration of a deterministic augmented Lagrangian method and some stochastic approximation techniques. By utilizing the sparsity of the second order information, each subproblem is efficiently solved by a superlinearly convergent semismooth Newton method. We derive some almost surely convergence properties and convergence rate of objective values. Furthermore, we present some results related to convergence rate of distance between iteration points and solution set under error bound conditions. Numerical results demonstrate favorable comparison of the proposed algorithm with some existing methods.
引用
收藏
页码:669 / 710
页数:41
相关论文
共 50 条
  • [31] Inexact tensor methods and their application to stochastic convex optimization
    Agafonov, Artem
    Kamzolov, Dmitry
    Dvurechensky, Pavel
    Gasnikov, Alexander
    Takac, Martin
    OPTIMIZATION METHODS & SOFTWARE, 2023, 39 (01): : 42 - 83
  • [32] An inexact accelerated stochastic ADMM for separable convex optimization
    Jianchao Bai
    William W. Hager
    Hongchao Zhang
    Computational Optimization and Applications, 2022, 81 : 479 - 518
  • [33] Accelerated Stochastic Variance Reduction for a Class of Convex Optimization Problems
    He, Lulu
    Ye, Jimin
    Jianwei, E.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 196 (03) : 810 - 828
  • [34] Accelerated Stochastic Variance Reduction for a Class of Convex Optimization Problems
    Lulu He
    Jimin Ye
    E. Jianwei
    Journal of Optimization Theory and Applications, 2023, 196 : 810 - 828
  • [35] Stochastic Gradient Estimation Algorithm for a class of Dual-Rate Stochastic Systems
    Cui Guimei
    Guan Yinghui
    Zhang Yong
    2010 IEEE 10TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS (ICSP2010), VOLS I-III, 2010, : 159 - 163
  • [36] An inexact accelerated stochastic ADMM for separable convex optimization
    Bai, Jianchao
    Hager, William W.
    Zhang, Hongchao
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 81 (02) : 479 - 518
  • [37] A second order primal-dual algorithm for nonsmooth convex composite optimization
    Dhingra, Neil K.
    Khong, Sei Zhen
    Jovanovic, Mihailo R.
    2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,
  • [38] Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses
    Bassily, Raef
    Feldman, Vitaly
    Guzman, Cristobal
    Talwar, Kunal
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [39] INEXACT CUTS IN STOCHASTIC DUAL DYNAMIC PROGRAMMING
    Guigues, Vincent
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (01) : 407 - 438
  • [40] PROXIMAL ITERATIVE GAUSSIAN SMOOTHING ALGORITHM FOR A CLASS OF NONSMOOTH CONVEX MINIMIZATION PROBLEMS
    Liu, Sanming
    Wang, Zhijie
    Liu, Chongyang
    NUMERICAL ALGEBRA CONTROL AND OPTIMIZATION, 2015, 5 (01): : 79 - 89