LINEAR CONVERGENCE OF STOCHASTIC BLOCK-COORDINATE FIXED POINT ALGORITHMS

被引:0
|
作者
Combettes, Patrick L. [1 ]
Pesquet, Jean-Christophe [2 ]
机构
[1] North Carolina State Univ, Dept Math, Box 8205, Raleigh, NC 27695 USA
[2] Univ Paris Saclay, Cent Supelec, INRIA, Ctr Visual Comp, Gif Sur Yvette, France
基金
美国国家科学基金会;
关键词
Block-coordinate algorithm; fixed-point algorithm; linear convergence; stochastic algorithm; ITERATIONS;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent random block-coordinate fixed point algorithms are particularly well suited to large-scale optimization in signal and image processing. These algorithms feature random sweeping rules to select arbitrarily the blocks of variables that are activated over the course of the iterations and they allow for stochastic errors in the evaluation of the operators. The present paper provides new linear convergence results. These convergence rates are compared to those of standard deterministic algorithms both theoretically and experimentally in an image recovery problem.
引用
收藏
页码:742 / 746
页数:5
相关论文
共 50 条
  • [41] On the complexity analysis of randomized block-coordinate descent methods
    Zhaosong Lu
    Lin Xiao
    Mathematical Programming, 2015, 152 : 615 - 642
  • [42] Monotonic convergence of fixed-point algorithms for ICA
    Regalia, PA
    Kofidis, E
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (04): : 943 - 949
  • [43] Conical averagedness and convergence analysis of fixed point algorithms
    Sedi Bartz
    Minh N. Dao
    Hung M. Phan
    Journal of Global Optimization, 2022, 82 : 351 - 373
  • [44] Conical averagedness and convergence analysis of fixed point algorithms
    Bartz, Sedi
    Dao, Minh N.
    Phan, Hung M.
    JOURNAL OF GLOBAL OPTIMIZATION, 2022, 82 (02) : 351 - 373
  • [45] Random block-coordinate methods for inconsistent convex optimisation problems
    Staudigl, Mathias
    Jacquot, Paulin
    FIXED POINT THEORY AND ALGORITHMS FOR SCIENCES AND ENGINEERING, 2023, 2023 (01):
  • [46] A BLOCK-COORDINATE DESCENT METHOD FOR LINEARLY CONSTRAINED MINIMIZATION PROBLEM
    Xuefang Liu
    Zheng Peng
    AnnalsofAppliedMathematics, 2018, 34 (02) : 138 - 152
  • [47] BLOCK-COORDINATE FRANK-WOLFE ALGORITHM AND CONVERGENCE ANALYSIS FOR SEMI-RELAXED OPTIMAL TRANSPORT PROBLEM
    Fukunaga, Takumi
    Kasai, Hiroyuki
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5433 - 5437
  • [48] CONVERGENCE RATES AND DECOUPLING IN LINEAR STOCHASTIC APPROXIMATION ALGORITHMS
    Kouritzin, Michael A.
    Sadeghi, Samira
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2015, 53 (03) : 1484 - 1508
  • [49] STOCHASTIC REFORMULATIONS OF LINEAR SYSTEMS: ALGORITHMS AND CONVERGENCE THEORY
    Richtarik, Peter
    Takac, Martin
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2020, 41 (02) : 487 - 524
  • [50] A Randomized Block-Coordinate Adam online learning optimization algorithm
    Zhou, Yangfan
    Zhang, Mingchuan
    Zhu, Junlong
    Zheng, Ruijuan
    Wu, Qingtao
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (16): : 12671 - 12684