A dual-based stochastic inexact algorithm for a class of stochastic nonsmooth convex composite problems

被引:0
|
作者
Gui-Hua Lin
Zhen-Ping Yang
Hai-An Yin
Jin Zhang
机构
[1] Shanghai University,School of Management
[2] Jiaying University,School of Mathematics
[3] Southern University of Science and Technology,Department of Mathematics
[4] Peng Cheng Laboratory,Department of Mathematics, SUSTech International Center for Mathematics, Southern University of Science and Technology, National Center for Applied Mathematics Shenzhen
关键词
Stochastic programming; Stochastic approximation; Duality; Convergence rate; 90C06; 90C15; 90C25;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a dual-based stochastic inexact algorithm is developed to solve a class of stochastic nonsmooth convex problems with underlying structure. This algorithm can be regarded as an integration of a deterministic augmented Lagrangian method and some stochastic approximation techniques. By utilizing the sparsity of the second order information, each subproblem is efficiently solved by a superlinearly convergent semismooth Newton method. We derive some almost surely convergence properties and convergence rate of objective values. Furthermore, we present some results related to convergence rate of distance between iteration points and solution set under error bound conditions. Numerical results demonstrate favorable comparison of the proposed algorithm with some existing methods.
引用
收藏
页码:669 / 710
页数:41
相关论文
共 50 条
  • [41] Inexact Methods for Symmetric Stochastic Eigenvalue Problems
    Lee, Kookjin
    Sousedik, Bedrich
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2018, 6 (04): : 1744 - 1776
  • [42] A first-order inexact primal-dual algorithm for a class of convex-concave saddle point problems
    Jiang, Fan
    Wu, Zhongming
    Cai, Xingju
    Zhang, Hongchao
    NUMERICAL ALGORITHMS, 2021, 88 (03) : 1109 - 1136
  • [43] A first-order inexact primal-dual algorithm for a class of convex-concave saddle point problems
    Fan Jiang
    Zhongming Wu
    Xingju Cai
    Hongchao Zhang
    Numerical Algorithms, 2021, 88 : 1109 - 1136
  • [44] Rate of convergence analysis of dual-based variables decomposition methods for strongly convex problems
    Beck, Amir
    Tetruashvili, Luba
    Vaisbourd, Yakov
    Shemtov, Ariel
    OPERATIONS RESEARCH LETTERS, 2016, 44 (01) : 61 - 66
  • [45] A linearly convergent dual-based gradient projection algorithm for quadratically constrained convex minimization
    Beck, Amir
    Teboulle, Marc
    MATHEMATICS OF OPERATIONS RESEARCH, 2006, 31 (02) : 398 - 417
  • [46] Solution of Nonconvex Nonsmooth Stochastic Optimization Problems
    Yu. M. Ermoliev
    V. I. Norkin
    Cybernetics and Systems Analysis, 2003, 39 (5) : 701 - 715
  • [47] On nonsmooth and discontinuous problems of stochastic systems optimization
    Ermoliev, YM
    Norkin, VI
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1997, 101 (02) : 230 - 244
  • [48] Regularized stochastic dual dynamic programming for convex nonlinear optimization problems
    Guigues, Vincent
    Lejeune, Miguel A.
    Tekaya, Wajdi
    OPTIMIZATION AND ENGINEERING, 2020, 21 (03) : 1133 - 1165
  • [49] SI-ADMM: A STOCHASTIC INEXACT ADMM FRAMEWORK FOR RESOLVING STRUCTURED STOCHASTIC CONVEX PROGRAMS
    Xie, Yue
    Shanbhag, Uday V.
    2016 WINTER SIMULATION CONFERENCE (WSC), 2016, : 714 - 725
  • [50] Regularized stochastic dual dynamic programming for convex nonlinear optimization problems
    Vincent Guigues
    Migual A. Lejeune
    Wajdi Tekaya
    Optimization and Engineering, 2020, 21 : 1133 - 1165