A fast proximal iteratively reweighted nuclear norm algorithm for nonconvex low-rank matrix minimization problems

被引:3
|
作者
Ge, Zhili [1 ]
Zhang, Xin [2 ]
Wu, Zhongming [3 ]
机构
[1] Nanjing Normal Univ Special Educ, Sch Math & Informat Sci, Nanjing 210038, Peoples R China
[2] Suqian Coll, Sch Arts & Sci, Suqian 223800, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Management Sci & Engn, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-rank minimization; Nonconvex optimization; Proximal iteratively reweighted method; Extrapolation; Convergence analysis; VARIABLE SELECTION; GRADIENT ALGORITHM; REGRESSION; CONVERGENCE;
D O I
10.1016/j.apnum.2022.04.008
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we propose a fast proximal iteratively reweighted nuclear norm algorithm with extrapolation for solving a class of nonconvex low-rank matrix minimization problems. The proposed method incorporates two different extrapolation steps with respect to the previous iterations into the backward proximal step and the forward gradient step of the classic proximal iteratively reweighted method. We prove that the proposed method generates a convergent subsequence under general parameter constraints, and that any limit point is a stationary point of the problem. Furthermore, we prove that if the objective function satisfies the Kurdyka-Lojasiewicz property, the algorithm is globally convergent to a stationary point of the considered problem. Finally, we perform numerical experiments on a practical matrix completion problem with both synthetic and real data, the results of which demonstrate the efficiency and superior performance of the proposed algorithm. (C) 2022 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:66 / 86
页数:21
相关论文
共 50 条
  • [31] Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization
    Yao, Quanming
    Wang, Yaqing
    Han, Bo
    Kwok, James T.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [32] Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization
    Yao, Quanming
    Wang, Yaqing
    Han, Bo
    Kwok, James T.
    [J]. Journal of Machine Learning Research, 2022, 23
  • [33] Efficient Recovery of Low-Rank Matrix via Double Nonconvex Nonsmooth Rank Minimization
    Zhang, Hengmin
    Gong, Chen
    Qian, Jianjun
    Zhang, Bob
    Xu, Chunyan
    Yang, Jian
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) : 2916 - 2925
  • [34] A Proximal-Proximal Majorization-Minimization Algorithm for Nonconvex Rank Regression Problems
    Tang, Peipei
    Wang, Chengjing
    Jiang, Bo
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 3502 - 3517
  • [35] Generalized Nonconvex Nonsmooth Low-Rank Minimization
    Lu, Canyi
    Tang, Jinhui
    Yan, Shuicheng
    Lin, Zhouchen
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 4130 - 4137
  • [36] Robust Low-Rank Matrix Factorization via Block Iteratively Reweighted Least-Squares
    Li, Nanxi
    He, Zhen-Qing
    Zhu, Jianchi
    She, Xiaoming
    Chen, Peng
    Liang, Ying-Chang
    [J]. 2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 725 - 730
  • [37] Necessary and Sufficient Null Space Condition for Nuclear Norm Minimization in Low-Rank Matrix Recovery
    Yi, Jirong
    Xu, Weiyu
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (10) : 6597 - 6604
  • [38] HIGH DYNAMIC RANGE IMAGING VIA TRUNCATED NUCLEAR NORM MINIMIZATION OF LOW-RANK MATRIX
    Lee, Chul
    Lam, Edmund Y.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1229 - 1233
  • [39] A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION
    Chen, Wei
    [J]. 2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 146 - 150
  • [40] CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY
    Cai, Yun
    Li, Song
    [J]. INVERSE PROBLEMS AND IMAGING, 2017, 11 (04) : 643 - 661