Convergence of a block coordinate descent method for nondifferentiable minimization

被引:1418
|
作者
Tseng, P [1 ]
机构
[1] Univ Washington, Dept Math, Seattle, WA 98195 USA
基金
美国国家科学基金会;
关键词
block coordinate descent; nondifferentiable minimization; stationary point; Gauss-Seidel method; convergence; quasiconvex functions; pseudoconvex functions;
D O I
10.1023/A:1017501703105
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We study the convergence properties of a (block) coordinate descent method applied to minimize a nondifferentiable (nonconvex) function f(x(I),..., x(n)) with certain separability and regularity properties. Assuming that f is continuous on a compact level set, the subsequence convergence of the iterates to a stationary point is shown when either f is pseudoconvex in every pair of coordinate blocks from among N - 1 coordinate blocks orf has at most one minimum in each of N - 2 coordinate blocks. If f is quasiconvex and hemivariate in every coordinate block, then the assumptions of continuity off and compactness of the level set may be relaxed further. These results are applied to derive new land old) convergence results for the proximal minimization algorithm, an algorithm of Arimoto and Blahut, and an algorithm of Han. They are applied also to a problem of blind source separation.
引用
收藏
页码:475 / 494
页数:20
相关论文
共 50 条
  • [31] On the convergence of a Block-Coordinate Incremental Gradient method
    Palagi, Laura
    Seccia, Ruggiero
    SOFT COMPUTING, 2021, 25 (19) : 12615 - 12626
  • [32] On the convergence of a Block-Coordinate Incremental Gradient method
    Laura Palagi
    Ruggiero Seccia
    Soft Computing, 2021, 25 : 12615 - 12626
  • [33] Parallel and distributed random coordinate descent method for convex error bound minimization
    Necoara, Ion
    Findeisen, Rolf
    2015 AMERICAN CONTROL CONFERENCE (ACC), 2015, : 527 - 532
  • [34] Convergence of Slice-Based Block Coordinate Descent Algorithm for Convolutional Sparse Coding
    Li, Jing
    Yu, Hui
    Wei, Xiao
    Wang, Jinjia
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [35] Markov chain block coordinate descent
    Sun, Tao
    Sun, Yuejiao
    Xu, Yangyang
    Yin, Wotao
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 75 (01) : 35 - 61
  • [36] Differentially private block coordinate descent
    Riaz, Shazia
    Ali, Saqib
    Wang, Guojun
    Anees, Asad
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (01) : 283 - 295
  • [37] Alternating Randomized Block Coordinate Descent
    Diakonikolas, Jelena
    Orecchia, Lorenzo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [38] Markov chain block coordinate descent
    Tao Sun
    Yuejiao Sun
    Yangyang Xu
    Wotao Yin
    Computational Optimization and Applications, 2020, 75 : 35 - 61
  • [39] ITERATION COMPLEXITY OF A BLOCK COORDINATE GRADIENT DESCENT METHOD FOR CONVEX OPTIMIZATION
    Hua, Xiaoqin
    Yamashita, Nobuo
    SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (03) : 1298 - 1313
  • [40] The randomized block coordinate descent method in the Hölder smooth setting
    Maia, Leandro Farias
    Gutman, David Huckleberry
    OPTIMIZATION LETTERS, 2025, 19 (01) : 1 - 20