On convergence of a q-random coordinate constrained algorithm for non-convex problems

被引:0
|
作者
Ghaffari-Hadigheh, A. [1 ]
Sinjorgo, L. [2 ]
Sotirov, R. [2 ]
机构
[1] Azarbaijan Shahid Madani Univ, Tabriz, Iran
[2] Tilburg Univ, EOR Dept, Tilburg, Netherlands
关键词
Random coordinate descent algorithm; Convergence analysis; Densest k-subgraph problem; Eigenvalue complementarity problem; DESCENT ALGORITHMS; SIMPLEX;
D O I
10.1007/s10898-024-01429-6
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We propose a random coordinate descent algorithm for optimizing a non-convex objective function subject to one linear constraint and simple bounds on the variables. Although it is common use to update only two random coordinates simultaneously in each iteration of a coordinate descent algorithm, our algorithm allows updating arbitrary number of coordinates. We provide a proof of convergence of the algorithm. The convergence rate of the algorithm improves when we update more coordinates per iteration. Numerical experiments on large scale instances of different optimization problems show the benefit of updating many coordinates simultaneously.
引用
收藏
页码:843 / 868
页数:26
相关论文
共 50 条
  • [2] Damping proximal coordinate descent algorithm for non-convex regularization
    Pan, Zheng
    Lin, Ming
    Hou, Guangdong
    Zhang, Changshui
    NEUROCOMPUTING, 2015, 152 : 151 - 163
  • [3] A two scale Γ-convergence approach for random non-convex homogenization
    Berlyand, Leonid
    Sandier, Etienne
    Serfaty, Sylvia
    CALCULUS OF VARIATIONS AND PARTIAL DIFFERENTIAL EQUATIONS, 2017, 56 (06)
  • [4] On Robustness of the Normalized Random Block Coordinate Method for Non-Convex Optimization
    Turan, Berkay
    Uribe, Cesar A.
    Wai, Hoi-To
    Alizadeh, Mahnoosh
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 974 - 980
  • [5] Adaptive Global Algorithm for Solving Box-Constrained Non-convex Quadratic Minimization Problems
    Amar Andjouh
    Mohand Ouamer Bibi
    Journal of Optimization Theory and Applications, 2022, 192 : 360 - 378
  • [6] Adaptive Global Algorithm for Solving Box-Constrained Non-convex Quadratic Minimization Problems
    Andjouh, Amar
    Bibi, Mohand Ouamer
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 192 (01) : 360 - 378
  • [7] Linear Convergence of Random Dual Coordinate Descent on Nonpolyhedral Convex Problems
    Necoara, Ion
    Fercoq, Olivier
    MATHEMATICS OF OPERATIONS RESEARCH, 2022, 47 (04) : 2641 - 2666
  • [8] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [9] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    Journal of Machine Learning Research, 2019, 20
  • [10] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80