A dual-based stochastic inexact algorithm for a class of stochastic nonsmooth convex composite problems

被引:0
|
作者
Gui-Hua Lin
Zhen-Ping Yang
Hai-An Yin
Jin Zhang
机构
[1] Shanghai University,School of Management
[2] Jiaying University,School of Mathematics
[3] Southern University of Science and Technology,Department of Mathematics
[4] Peng Cheng Laboratory,Department of Mathematics, SUSTech International Center for Mathematics, Southern University of Science and Technology, National Center for Applied Mathematics Shenzhen
关键词
Stochastic programming; Stochastic approximation; Duality; Convergence rate; 90C06; 90C15; 90C25;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a dual-based stochastic inexact algorithm is developed to solve a class of stochastic nonsmooth convex problems with underlying structure. This algorithm can be regarded as an integration of a deterministic augmented Lagrangian method and some stochastic approximation techniques. By utilizing the sparsity of the second order information, each subproblem is efficiently solved by a superlinearly convergent semismooth Newton method. We derive some almost surely convergence properties and convergence rate of objective values. Furthermore, we present some results related to convergence rate of distance between iteration points and solution set under error bound conditions. Numerical results demonstrate favorable comparison of the proposed algorithm with some existing methods.
引用
收藏
页码:669 / 710
页数:41
相关论文
共 50 条
  • [21] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Zehui Jia
    Zhongming Wu
    Xiaomei Dong
    Journal of Inequalities and Applications, 2019
  • [22] CONVERGENCE OF AN INEXACT ALGORITHM FOR COMPOSITE NONSMOOTH OPTIMIZATION
    WRIGHT, SJ
    IMA JOURNAL OF NUMERICAL ANALYSIS, 1990, 10 (03) : 299 - 321
  • [23] DISA: A Dual Inexact Splitting Algorithm for Distributed Convex Composite Optimization
    Guo, Luyao
    Shi, Xinli
    Yang, Shaofu
    Cao, Jinde
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (05) : 2995 - 3010
  • [24] STOCHASTIC METHODS FOR COMPOSITE AND WEAKLY CONVEX OPTIMIZATION PROBLEMS
    Duchi, John C.
    Ruan, Feng
    SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (04) : 3229 - 3259
  • [25] A DUAL-BASED HEURISTIC FOR THE SIMPLE FACILITY LOCATION PROBLEM WITH STOCHASTIC DEMAND
    TCHA, DW
    YOON, MG
    IIE TRANSACTIONS, 1985, 17 (04) : 364 - 369
  • [26] SI-ADMM: A Stochastic Inexact ADMM Framework for Stochastic Convex Programs
    Xie, Yue
    Shanbhag, Uday V.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (06) : 2355 - 2370
  • [27] Inexact SARAH algorithm for stochastic optimization
    Nguyen, Lam M.
    Scheinberg, Katya
    Takac, Martin
    OPTIMIZATION METHODS & SOFTWARE, 2021, 36 (01): : 237 - 258
  • [28] A dual-based combinatorial algorithm for solving cyclic optimization problems
    Alfares, Hesham K.
    Recent Patents on Computer Science, 2012, 5 (03): : 188 - 196
  • [29] An inexact algorithm for stochastic variational inequalities
    Buscaglia, Emelin L.
    Lotito, Pablo A.
    Parente, Lisandro A.
    OPERATIONS RESEARCH LETTERS, 2024, 52
  • [30] Proximal stochastic recursive momentum algorithm for nonsmooth nonconvex optimization problems
    Wang, Zhaoxin
    Wen, Bo
    OPTIMIZATION, 2024, 73 (02) : 481 - 495