Iteratively Linearized Reweighted Alternating Direction Method of Multipliers for a Class of Nonconvex Problems

被引:30
|
作者
Sun, Tao [1 ]
Jiang, Hao [2 ]
Cheng, Lizhi [1 ,3 ]
Zhu, Wei [4 ]
机构
[1] Natl Univ Def Technol, Dept Math, Changsha 410073, Hunan, Peoples R China
[2] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
[3] Natl Univ Def Technol, State Key Lab High Performance Computat, Changsha 410073, Hunan, Peoples R China
[4] Xiangtan Univ, Sch Math & Computat Sci, Hunan Key Lab Computat & Simulat Sci & Engn, Xiangtan 411105, Peoples R China
基金
美国国家科学基金会;
关键词
Alternating direction method of multipliers; Iteratively reweighted algorithm; Nonconvex and nonsmooth minimization; Kurdyka-Lojasiewicz property; Semi-algebraic functions; GLOBAL CONVERGENCE; IMAGE-RESTORATION; MINIMIZATION; ALGORITHM; APPROXIMATION;
D O I
10.1109/TSP.2018.2868269
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing andmachine learning research. The traditional alternating directionmethod of multipliers encounters troubles in both mathematics and computations in solving the nonconvex and nonsmooth subproblem. In view of this, we propose a reweighted alternating direction method of multipliers. In this algorithm, all subproblems are convex and easy to solve. We also provide several guarantees for the convergence and prove that the algorithm globally converges to a critical point of an auxiliary function with the help of the Kurdyka-Lojasiewicz property. Several numerical results are presented to demonstrate the efficiency of the proposed algorithm.
引用
收藏
页码:5380 / 5391
页数:12
相关论文
共 50 条
  • [41] An alternating direction method of multipliers for tensor complementarity problems
    Haoran Zhu
    Liping Zhang
    Computational and Applied Mathematics, 2021, 40
  • [42] An alternating direction method of multipliers for tensor complementarity problems
    Zhu, Haoran
    Zhang, Liping
    COMPUTATIONAL & APPLIED MATHEMATICS, 2021, 40 (04):
  • [43] Network Traffic Signal Control with Nonconvex Alternating Direction Method of Multipliers Formulations
    Timotheou, Stelios
    Panayiotou, Christos G.
    Polycarpou, Marios M.
    TRANSPORTATION RESEARCH RECORD, 2015, (2490) : 11 - 20
  • [44] NONCONVEX ALTERNATING DIRECTION METHOD OF MULTIPLIERS FOR DISTRIBUTED SPARSE PRINCIPAL COMPONENT ANALYSIS
    Hajinezhad, Davood
    Hong, Mingyi
    2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 255 - 259
  • [45] Alternating direction method of multipliers for nonconvex log total variation image restoration
    Zhang, Benxin
    Zhu, Guopu
    Zhu, Zhibin
    Kwong, Sam
    APPLIED MATHEMATICAL MODELLING, 2023, 114 : 338 - 359
  • [46] The Proximal Alternating Direction Method of Multipliers in the Nonconvex Setting: Convergence Analysis and Rates
    Bot, Radu Ioan
    Dang-Khoa Nguyen
    MATHEMATICS OF OPERATIONS RESEARCH, 2020, 45 (02) : 682 - 712
  • [47] The Iterative Reweighted Alternating Direction Method of Multipliers for Separating Structural Layovers in SAR Tomography
    Wang, Xiao
    Xu, Feng
    Jin, Ya-Qiu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (11) : 1883 - 1887
  • [48] Linearized Proximal Alternating Direction Method of Multipliers for Parallel Magnetic Resonance Imaging
    Zhang, Benxin
    Zhu, Zhibin
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2017, 4 (04) : 763 - 769
  • [49] Solving Blind Ptychography Effectively Via Linearized Alternating Direction Method of Multipliers
    Li, Ji
    JOURNAL OF SCIENTIFIC COMPUTING, 2023, 94 (01)
  • [50] Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization
    Aybat, N. S.
    Wang, Z.
    Lin, T.
    Ma, S.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (01) : 5 - 20